-- Logs begin at Thu 2022-06-16 15:21:57 UTC, end at Thu 2022-06-16 16:32:48 UTC. -- Jun 16 16:02:02.445418 dv-cinder-837355-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 16:02:02.455142 dv-cinder-837355-2-smb devstack@keystone.service[80313]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 16:02:02.457167 dv-cinder-837355-2-smb devstack@keystone.service[80313]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 16:02:02 2022] *** Jun 16 16:02:02.457167 dv-cinder-837355-2-smb devstack@keystone.service[80313]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 16:02:02.457167 dv-cinder-837355-2-smb devstack@keystone.service[80313]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 16:02:02.457167 dv-cinder-837355-2-smb devstack@keystone.service[80313]: nodename: dv-cinder-837355-2-smb Jun 16 16:02:02.457167 dv-cinder-837355-2-smb devstack@keystone.service[80313]: machine: x86_64 Jun 16 16:02:02.457167 dv-cinder-837355-2-smb devstack@keystone.service[80313]: clock source: unix Jun 16 16:02:02.457167 dv-cinder-837355-2-smb devstack@keystone.service[80313]: pcre jit disabled Jun 16 16:02:02.457167 dv-cinder-837355-2-smb devstack@keystone.service[80313]: detected number of CPU cores: 4 Jun 16 16:02:02.457167 dv-cinder-837355-2-smb devstack@keystone.service[80313]: current working directory: / Jun 16 16:02:02.457167 dv-cinder-837355-2-smb devstack@keystone.service[80313]: detected binary path: /usr/bin/uwsgi-core Jun 16 16:02:02.457723 dv-cinder-837355-2-smb devstack@keystone.service[80313]: your processes number limit is 47680 Jun 16 16:02:02.457723 dv-cinder-837355-2-smb devstack@keystone.service[80313]: your memory page size is 4096 bytes Jun 16 16:02:02.457723 dv-cinder-837355-2-smb devstack@keystone.service[80313]: detected max file descriptor number: 2048 Jun 16 16:02:02.457723 dv-cinder-837355-2-smb devstack@keystone.service[80313]: lock engine: pthread robust mutexes Jun 16 16:02:02.457723 dv-cinder-837355-2-smb devstack@keystone.service[80313]: thunder lock: enabled Jun 16 16:02:02.457723 dv-cinder-837355-2-smb devstack@keystone.service[80313]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 16:02:02.457723 dv-cinder-837355-2-smb devstack@keystone.service[80313]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 16:02:02.501516 dv-cinder-837355-2-smb devstack@keystone.service[80313]: Python main interpreter initialized at 0x560037b1f9c0 Jun 16 16:02:02.501516 dv-cinder-837355-2-smb devstack@keystone.service[80313]: python threads support enabled Jun 16 16:02:02.501516 dv-cinder-837355-2-smb devstack@keystone.service[80313]: your server socket listen backlog is limited to 100 connections Jun 16 16:02:02.501516 dv-cinder-837355-2-smb devstack@keystone.service[80313]: your mercy for graceful operations on workers is 90 seconds Jun 16 16:02:02.501874 dv-cinder-837355-2-smb devstack@keystone.service[80313]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 16:02:02.501952 dv-cinder-837355-2-smb devstack@keystone.service[80313]: *** Operational MODE: preforking *** Jun 16 16:02:02.502213 dv-cinder-837355-2-smb devstack@keystone.service[80313]: *** uWSGI is running in multiple interpreter mode *** Jun 16 16:02:02.502213 dv-cinder-837355-2-smb devstack@keystone.service[80313]: spawned uWSGI master process (pid: 80313) Jun 16 16:02:02.502411 dv-cinder-837355-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 16 16:02:02.510465 dv-cinder-837355-2-smb devstack@keystone.service[80313]: spawned uWSGI worker 1 (pid: 80323, cores: 1) Jun 16 16:02:02.510465 dv-cinder-837355-2-smb devstack@keystone.service[80313]: spawned uWSGI worker 2 (pid: 80324, cores: 1) Jun 16 16:02:02.510465 dv-cinder-837355-2-smb devstack@keystone.service[80313]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 16:02:08.083429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:02:08.083429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: from cryptography.utils import int_from_bytes Jun 16 16:02:08.084238 dv-cinder-837355-2-smb devstack@keystone.service[80324]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:02:08.084238 dv-cinder-837355-2-smb devstack@keystone.service[80324]: from cryptography.utils import int_from_bytes Jun 16 16:02:08.134602 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 16:02:08.134797 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 16:02:08.134966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] command line args: [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 16:02:08.135242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 16:02:08.135420 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ================================================================================ {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 16:02:08.135678 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] admin_token = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.135929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] config_dir = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.136118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.136300 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] config_source = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.136480 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] debug = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.136681 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.137048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.137228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.137482 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.137733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.137965 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] list_limit = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.138144 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] log_config_append = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.138331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.138543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] log_dir = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.138725 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] log_file = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.138969 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.139224 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.139477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.139719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.139895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.140118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.140390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.140663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.140909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.141321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.141603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.141841 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.150009 dv-cinder-837355-2-smb devstack@keystone.service[80323]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:02:08.150009 dv-cinder-837355-2-smb devstack@keystone.service[80323]: from cryptography.utils import int_from_bytes Jun 16 16:02:08.150765 dv-cinder-837355-2-smb devstack@keystone.service[80323]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:02:08.150765 dv-cinder-837355-2-smb devstack@keystone.service[80323]: from cryptography.utils import int_from_bytes Jun 16 16:02:08.215702 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 16:02:08.215993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 16:02:08.216133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] command line args: [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 16:02:08.216340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 16:02:08.216516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ================================================================================ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 16:02:08.216773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] admin_token = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.217022 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] config_dir = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.217210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.217391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] config_source = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.217570 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] debug = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.217788 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.218025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.218273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.218738 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.219085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.219085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.227652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_config_append = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.227652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.227652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_dir = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.227652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.227652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.227652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.227652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.227652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.228614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.228614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.228614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.228614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.228614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.228614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.228614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.228614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.229452 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.229565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.229565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.229565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.229565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.229565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] publish_errors = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.229565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.229565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.229565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.229565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.230550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.230550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] standard_threads = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.230550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.230550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.230550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.230550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] use_journal = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.230550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] use_json = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.230550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] use_stderr = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.230550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] use_syslog = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.231522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.231522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.231522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.231522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.231522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.232083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.232083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.232299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.232419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.232642 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.232895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.233156 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.233398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.233652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.234480 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.234731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.234987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.235229 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.235497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.235760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.236015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.236259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.236521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.236795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.237057 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.237314 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.237554 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.237791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.238029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.238270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.238552 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.238810 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.239047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.239284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.239536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.239790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.240038 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.240289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.240529 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.240773 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.241017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.241254 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.241490 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.241727 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.241964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.242205 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.242505 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.242722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.242962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.243200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.243442 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.244962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.244962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.244962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.244962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.244962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.244962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.245734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.245734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.245734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.246164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.246164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.246556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.246556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.246879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.247060 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.247297 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.247538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.247785 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.248063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.248305 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.248560 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.248811 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.249048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.249285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.250211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.250634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.251034 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.251295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.251549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.251795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.252041 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.252282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.252525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.252763 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.253042 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.253292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.253543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.253787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.254034 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.254276 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.254543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.254787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.255024 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.255259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.255498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.255737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.255971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.256218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.256457 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.256710 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.256951 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.257214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.257483 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.257730 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.257968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] auth.external = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.258204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.258529 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.258769 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.259005 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] auth.password = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.259238 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] auth.token = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.259482 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.259720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.260928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.260928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.260928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.260928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.260928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.261751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] credential.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.261751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.261751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.262069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.262069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.262298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.262550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.262813 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.263275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.263409 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.263556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.263987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.264108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.264631 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.264631 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.264850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.265120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.265384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.265697 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.266246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.266524 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.267089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.267089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.267356 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.267597 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.267860 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.268102 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.268355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.268596 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.268850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.269104 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.269345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.269585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.269844 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.270072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.270315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.270596 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.270853 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.271089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.271325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.271559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.271809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.272061 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.273390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.273390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.273390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.273390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.273390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.273966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.273966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.273966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.275211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.275211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.275211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.275211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.275211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.275771 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.275771 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.276772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.276772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.276772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.276772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.276772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.277323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.277323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.277544 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.277668 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.277925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.278166 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.278408 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.278691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.278946 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.279182 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.279416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.279667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.279920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.280160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.280399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.280654 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.280935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.281192 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.281458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.281691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.282004 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.282293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.282511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.282699 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.282881 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.283128 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.283365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.283606 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.283836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.284076 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.284323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.284573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.284824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.285080 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.285314 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.285571 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.285809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.286049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.286288 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.286639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.286837 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.287022 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.287263 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.287520 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.287754 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.288003 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.288240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.288479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.288718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.288973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.289221 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.289457 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.289665 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.289914 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.290167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.290404 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.290671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.290924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.291180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.291420 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.291670 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.291913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.292161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.292400 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] role.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.292651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] role.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.292885 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.293168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.293395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.293647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.293905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.294151 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.294399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.294677 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.294928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.295161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.295419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.295674 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.295918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.296166 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.297167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.297402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.297655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.297913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.298158 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.298412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.298674 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.298943 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.299187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.299429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.299666 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.299909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.300140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.300395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.300653 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.300904 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.301148 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.301387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.301622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.301860 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.302100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.302356 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.302619 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.302880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.303132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.303370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.303605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.303853 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.304103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.304349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.304590 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.304827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.305074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.305320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.305554 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.305801 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.306110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.306378 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.connection = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.306654 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.306907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.307148 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.307392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.307631 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.307871 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.308110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.308350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.308597 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.308839 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.309089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.309328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.309578 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.309819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.310068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.310302 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.310568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.310807 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.310981 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 16:02:08.314384 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.315004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.315797 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.316093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] publish_errors = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.316366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.316800 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.317146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.317607 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.318061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.318530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] standard_threads = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.318796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.319062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.319252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.319440 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] use_journal = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.319624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] use_json = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.319806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] use_stderr = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.319989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] use_syslog = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.320231 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:02:08.320501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.321011 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.321283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.321532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.321788 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.322033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.322288 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.322551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.322807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.323127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.323385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.323624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.323876 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.324292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.324657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.324839 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.325081 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.325344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.325767 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.326044 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.329578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.329861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.330173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.330680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.331191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.331569 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.331829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.332078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.332329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.332665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.332935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.333182 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.333668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.334098 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.334537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.334800 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.335106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.335559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.335993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.336419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.336814 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.337224 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.337645 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.338057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.338505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.338947 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.339373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.339807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.340227 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.340655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.341071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.341498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.341620 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.341793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.341935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.342063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.342309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.342754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.343740 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.344512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.345043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.345338 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.345755 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.346143 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.346557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.350126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.350126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.350126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.350126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.350126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.350126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.350126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.350126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.350126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.350775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.350775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.351007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.351402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.351809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.351934 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.352205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.352601 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.352970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.353329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.353685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.354049 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.354439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.354817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.355229 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.355605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.355981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.356350 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.356727 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.357094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.357461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.357825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.358198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.358586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.359005 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.359878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.360232 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.360604 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.360976 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.361356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.361724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.362116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.362564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.362994 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.363287 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.external = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.363647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.364114 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.364474 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.364827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.password = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.365181 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] auth.token = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.365547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.365907 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.366285 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.366684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.367805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.367805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.367805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.368342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.368474 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.368855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.369242 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.369605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.369981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.370342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.370776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.371241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.371681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.372157 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.372666 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.373116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.373609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.374050 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.374587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.375022 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.375555 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.375867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.377000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.377000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.377311 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.377584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.378042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.378500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.378971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.379404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.379867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.380296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.380766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.381278 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.381527 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.381853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.382117 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.382362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.382633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.382968 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.383230 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.383381 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.383523 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.383659 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.383792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.383978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.384230 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.384534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.384788 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.385052 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.385307 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.385597 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.385842 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.386083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.386318 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.386581 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.386816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.387053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.387300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.387545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.387799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.388033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.388366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.388819 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.389216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.389669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.390093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.390487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.390828 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.391225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.391660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.391958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.392208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.392423 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.392812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.393074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.394347 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.394641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.394893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.395163 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.395429 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.395682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.395929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.397333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.397672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.398023 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.399286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.399286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.399286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.399286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.399819 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.400012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.400432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.400689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.400941 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.401193 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.401434 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.401690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.401946 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.402202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.402479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.402735 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.402973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.403310 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.403562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.403805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.404084 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.404525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.405009 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.405512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.406551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.406949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.407592 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.407764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.408188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.408505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.408854 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.409330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.409808 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.410354 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.410607 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.411465 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.411465 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.411745 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.411893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.412056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.412315 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.412559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.412814 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.413056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.413302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.413542 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] role.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.413793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] role.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.414028 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.414292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.414565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.414822 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.415074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.415327 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.415674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.415998 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.416475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.416902 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.417364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.417831 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.418150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.418414 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.419843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.420110 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.420384 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.420655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.420923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.421189 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.422020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.422717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.422717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.423511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.423728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.423952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.424453 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.424453 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.424740 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.424878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.425083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.428451 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.428827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.429093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.429353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.429708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.429966 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.430240 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.430594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.430850 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.431106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.431415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.431673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.431958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.432210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.432452 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.432705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.432961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.433198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.433446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.433756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.434024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.434275 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.434551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.434800 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.435048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.435290 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.435532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.435771 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.436013 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.436263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.436502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.436750 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.437534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.437781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.437781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.438536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.438536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.438825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.439200 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:02:08.439525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 16:02:08.447662 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.478621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.478932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.479088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.492743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.498576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.498827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.519619 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.520007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.573229 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.573538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.573693 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.573847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.574063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.574277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.584533 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.598378 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.598716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.598872 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.599063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.599282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.599499 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.599714 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.611708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.624206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.624970 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.625198 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.625421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.625637 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.625793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.625934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.626084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.626226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80324) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.643918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.644140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 16:02:08.644477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.644678 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 16:02:08.644948 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.645206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.645463 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.645719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.656649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.656920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.657187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.657467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.665715 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.668913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.669082 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.669226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.669379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.669519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.669659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.669808 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.669808 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.670075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.670214 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.670354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.670354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.670664 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.670832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.671100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.671895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.672412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.683291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.683528 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.683759 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.683978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.684194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.684404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.684615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.692827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.696143 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.696371 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.696592 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.696819 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.697036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.697248 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.697456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80323) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 16:02:08.700370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.702020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.702302 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.707705 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.707873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.708016 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 16:02:08.708169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.708313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.708451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.708591 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 16:02:08.708731 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.708912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.709309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.709572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.715704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.715985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.720570 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.720788 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.720944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.721092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.721235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.721376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.721523 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.721662 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.721800 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.721948 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.722133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.722397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.729589 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.732909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.733181 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.733454 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.733728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.734567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.734816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.735093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.735363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.735624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.735889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.736148 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.741579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.741858 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.746383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.750629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.751027 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.755978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.759634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.763249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.763399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.763580 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.763858 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.764134 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.764403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.764677 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.764871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.765168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.770539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.770811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.771094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.778590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.778863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.783648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.783928 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.784204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.784477 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.784746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.785025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.785275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.785420 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.785573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.785720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.785858 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.786060 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.793968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.795716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.796034 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.799718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.799993 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.800277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.800565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.800846 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.804904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.805175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.809679 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.814381 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.814692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.814840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.815090 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.815377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.815655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.816029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.816307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.816586 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.819818 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.823660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.827292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.827612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.827965 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.828326 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.828541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.828787 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.835313 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.838546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.841838 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.844222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.845864 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.846142 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.846423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.849176 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.849459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.849721 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.849976 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.853772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.855418 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.857808 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.858652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.859584 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.859976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.860157 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.860302 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.860452 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.863606 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.863882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.864158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.864442 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.864713 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.869389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.869684 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.869964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.878411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80324) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.878643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.878799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.878960 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.879108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.879251 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.879392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.879533 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.879685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.879826 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.879966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.880106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.880257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.880397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.880546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.880688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.880890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.881156 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.881428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.881693 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.881961 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80324) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.898730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.901952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.905250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.907097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.908848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.909122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.909395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.916602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.918211 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.919725 dv-cinder-837355-2-smb devstack@keystone.service[80324]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560037b1f9c0 pid: 80324 (default app) Jun 16 16:02:08.921969 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.922247 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.922630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.922815 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.923809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55293945-34a9-4cb7-a37b-fadada9bffcb None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:08.924121 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55293945-34a9-4cb7-a37b-fadada9bffcb None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:08.924406 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55293945-34a9-4cb7-a37b-fadada9bffcb None None] PATH_INFO: `/v3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:08.928698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Thu Jun 16 16:02:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:08.932416 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.932701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.932981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.946731 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80323) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 16:02:08.947015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.947290 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.947553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.947811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.948126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.948362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.948735 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.949002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.949267 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.949532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.949810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.950070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.950332 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80323) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 16:02:08.988997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560037b1f9c0 pid: 80323 (default app) Jun 16 16:02:16.720162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6824a4-0e30-42da-8fae-1216d875eb0f None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:16.720723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6824a4-0e30-42da-8fae-1216d875eb0f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:16.720723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6824a4-0e30-42da-8fae-1216d875eb0f None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:16.722090 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:02:16.729631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24f806-cdd4-47f1-ba56-613baaacf2e5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:16.730072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24f806-cdd4-47f1-ba56-613baaacf2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:16.730199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24f806-cdd4-47f1-ba56-613baaacf2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:16.800113 dv-cinder-837355-2-smb devstack@keystone.service[80323]: INFO dbcounter [None req-1b24f806-cdd4-47f1-ba56-613baaacf2e5 None None] Registered counter for database keystone Jun 16 16:02:16.821161 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG oslo_db.sqlalchemy.engines [None req-1b24f806-cdd4-47f1-ba56-613baaacf2e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:02:16.827428 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writer thread running {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:02:17.010247 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG passlib.handlers.bcrypt [None req-1b24f806-cdd4-47f1-ba56-613baaacf2e5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80323) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 16:02:17.010601 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG passlib.handlers.bcrypt [None req-1b24f806-cdd4-47f1-ba56-613baaacf2e5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80323) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 16:02:17.066516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1b24f806-cdd4-47f1-ba56-613baaacf2e5 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:17.068134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1b24f806-cdd4-47f1-ba56-613baaacf2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:17.195341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1/3] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 16:02:17.322420 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6824a4-0e30-42da-8fae-1216d875eb0f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:17.394759 dv-cinder-837355-2-smb devstack@keystone.service[80324]: INFO dbcounter [None req-cd6824a4-0e30-42da-8fae-1216d875eb0f None None] Registered counter for database keystone Jun 16 16:02:17.414410 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG oslo_db.sqlalchemy.engines [None req-cd6824a4-0e30-42da-8fae-1216d875eb0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:02:17.420766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writer thread running {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:02:17.539155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6824a4-0e30-42da-8fae-1216d875eb0f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:17.543439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563098a1-8fa2-4259-96c3-f4e57ad74c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:17.544103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563098a1-8fa2-4259-96c3-f4e57ad74c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:17.544392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563098a1-8fa2-4259-96c3-f4e57ad74c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:17.544673 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563098a1-8fa2-4259-96c3-f4e57ad74c87 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:17.553037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563098a1-8fa2-4259-96c3-f4e57ad74c87 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:17.607006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: WARNING keystone.common.rbac_enforcer.enforcer [None req-563098a1-8fa2-4259-96c3-f4e57ad74c87 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 16:02:17.607280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563098a1-8fa2-4259-96c3-f4e57ad74c87 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:17.617536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jun 16 16:02:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 16:02:17.623458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24f806-cdd4-47f1-ba56-613baaacf2e5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:17.638550 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24f806-cdd4-47f1-ba56-613baaacf2e5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:17.644355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef84f23-8ab7-43b3-8bea-33fa794d36b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:17.645483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef84f23-8ab7-43b3-8bea-33fa794d36b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:17.645779 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef84f23-8ab7-43b3-8bea-33fa794d36b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:17.646068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef84f23-8ab7-43b3-8bea-33fa794d36b0 admin admin] PATH_INFO: `/v3/projects/95faccee4f0940e98a9d62a275c0548c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:17.647607 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef84f23-8ab7-43b3-8bea-33fa794d36b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=95faccee4f0940e98a9d62a275c0548c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:17.700111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4ef84f23-8ab7-43b3-8bea-33fa794d36b0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 16:02:17.700456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef84f23-8ab7-43b3-8bea-33fa794d36b0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:17.706192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 2/5] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jun 16 16:02:17 2022] GET /identity/v3/projects/95faccee4f0940e98a9d62a275c0548c => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:19.854773 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332c4b8-6401-44ff-a1aa-287205ef0619 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:19.855315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332c4b8-6401-44ff-a1aa-287205ef0619 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:19.855315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332c4b8-6401-44ff-a1aa-287205ef0619 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:19.859436 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 4/6] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:19.864795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc2c2-afb9-4471-bddc-a004060f2fd4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:19.865235 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc2c2-afb9-4471-bddc-a004060f2fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:19.865368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc2c2-afb9-4471-bddc-a004060f2fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:19.884484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c96cc2c2-afb9-4471-bddc-a004060f2fd4 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:19.886018 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c96cc2c2-afb9-4471-bddc-a004060f2fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:19.894495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 3/7] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 16:02:19.917019 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332c4b8-6401-44ff-a1aa-287205ef0619 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:19.929726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332c4b8-6401-44ff-a1aa-287205ef0619 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:19.933986 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf9257-7009-4853-a5a7-463292fecf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:19.934660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf9257-7009-4853-a5a7-463292fecf08 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:19.934954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf9257-7009-4853-a5a7-463292fecf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:19.935238 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf9257-7009-4853-a5a7-463292fecf08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:19.943706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf9257-7009-4853-a5a7-463292fecf08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:19.945488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf9257-7009-4853-a5a7-463292fecf08 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:19.954539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jun 16 16:02:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 16:02:19.959890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cc2c2-afb9-4471-bddc-a004060f2fd4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:19.969012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cc2c2-afb9-4471-bddc-a004060f2fd4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:19.973394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f91ed-42a9-4418-8ed7-f1a7cdbe6d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:19.974255 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f91ed-42a9-4418-8ed7-f1a7cdbe6d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:19.974584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f91ed-42a9-4418-8ed7-f1a7cdbe6d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:19.974866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f91ed-42a9-4418-8ed7-f1a7cdbe6d49 admin admin] PATH_INFO: `/v3/users/0da3a74593ae46b281650aa7e2026c77` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:19.976256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f91ed-42a9-4418-8ed7-f1a7cdbe6d49 admin admin] RBAC: Authorizing `identity:get_user(user_id=0da3a74593ae46b281650aa7e2026c77)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:19.978091 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f91ed-42a9-4418-8ed7-f1a7cdbe6d49 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:19.979711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 4/9] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jun 16 16:02:19 2022] GET /identity/v3/users/0da3a74593ae46b281650aa7e2026c77 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:22.203997 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e94403-eb08-4ef5-a357-98f1afcf5068 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:22.204559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e94403-eb08-4ef5-a357-98f1afcf5068 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:22.204559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e94403-eb08-4ef5-a357-98f1afcf5068 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:22.205912 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:22.211320 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31c766-a78f-4583-842c-22f2bd98f4d6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:22.211848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31c766-a78f-4583-842c-22f2bd98f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:22.212019 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31c766-a78f-4583-842c-22f2bd98f4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:22.231409 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2c31c766-a78f-4583-842c-22f2bd98f4d6 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:22.232646 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2c31c766-a78f-4583-842c-22f2bd98f4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:22.288994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25919af5-88b7-4d37-95d1-9c9c67e125f5 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:22.289399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25919af5-88b7-4d37-95d1-9c9c67e125f5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:22.289751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25919af5-88b7-4d37-95d1-9c9c67e125f5 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:22.291253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 7/11] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:02:22.296831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b18eb9-6294-469c-9c07-4829055d9970 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:22.297739 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b18eb9-6294-469c-9c07-4829055d9970 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:22.298039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b18eb9-6294-469c-9c07-4829055d9970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:22.320424 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 5/12] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:22.340696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG passlib.handlers.bcrypt [None req-05b18eb9-6294-469c-9c07-4829055d9970 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80324) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 16:02:22.341138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG passlib.handlers.bcrypt [None req-05b18eb9-6294-469c-9c07-4829055d9970 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80324) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 16:02:22.343638 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31c766-a78f-4583-842c-22f2bd98f4d6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:22.368326 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:22.388999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-05b18eb9-6294-469c-9c07-4829055d9970 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:22.391774 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-05b18eb9-6294-469c-9c07-4829055d9970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:22.455927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31c766-a78f-4583-842c-22f2bd98f4d6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:22.491248 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccecf1-fd1d-42a2-9436-717ad97ab87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:22.492053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccecf1-fd1d-42a2-9436-717ad97ab87c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:22.492337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccecf1-fd1d-42a2-9436-717ad97ab87c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:22.492615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccecf1-fd1d-42a2-9436-717ad97ab87c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:22.493793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 8/13] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:02:22.504034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccecf1-fd1d-42a2-9436-717ad97ab87c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f2ccecf1-fd1d-42a2-9436-717ad97ab87c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:22.516324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:22.517467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:22.518305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:22.518305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:22.518305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:22.518305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:22.518305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:22.518305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:22.518305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:22.518305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:22.518305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:22.518305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:22.518305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:22.518305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:02:22.518944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b18eb9-6294-469c-9c07-4829055d9970 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:22.519021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 6/14] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:02:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:02:22.523044 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccecf1-fd1d-42a2-9436-717ad97ab87c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:22.608554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:22.620105 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b18eb9-6294-469c-9c07-4829055d9970 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:22.622438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:22.628709 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccecf1-fd1d-42a2-9436-717ad97ab87c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:22.658618 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1115ff-11d5-4f81-b536-aa0d29010145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:22.659518 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1115ff-11d5-4f81-b536-aa0d29010145 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:22.659807 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1115ff-11d5-4f81-b536-aa0d29010145 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:22.660087 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1115ff-11d5-4f81-b536-aa0d29010145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:22.663727 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5132d1-166d-400e-9c76-6041649e7117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:22.664407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5132d1-166d-400e-9c76-6041649e7117 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:22.664692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5132d1-166d-400e-9c76-6041649e7117 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:22.664973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5132d1-166d-400e-9c76-6041649e7117 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:22.665737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5132d1-166d-400e-9c76-6041649e7117 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:22.666051 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5132d1-166d-400e-9c76-6041649e7117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:22.667504 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5132d1-166d-400e-9c76-6041649e7117 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:22.680123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 7/15] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:22.685560 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5132d1-166d-400e-9c76-6041649e7117 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:22.730899 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1115ff-11d5-4f81-b536-aa0d29010145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:22.732641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1115ff-11d5-4f81-b536-aa0d29010145 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:22.784713 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5132d1-166d-400e-9c76-6041649e7117 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:22.820856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9860c-2570-480b-a776-b746072550b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:22.821987 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9860c-2570-480b-a776-b746072550b0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:22.822270 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9860c-2570-480b-a776-b746072550b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:22.822594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9860c-2570-480b-a776-b746072550b0 None admin] PATH_INFO: `/v3/users/0da3a74593ae46b281650aa7e2026c77` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:22.823803 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9860c-2570-480b-a776-b746072550b0 None admin] RBAC: Authorizing `identity:get_user(user_id=0da3a74593ae46b281650aa7e2026c77)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:22.825258 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9860c-2570-480b-a776-b746072550b0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:22.826910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 8/16] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:22 2022] GET /identity/v3/users/0da3a74593ae46b281650aa7e2026c77 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:22.832950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9860c-2570-480b-a776-b746072550b0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:22.839017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 9/17] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:02:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 16:02:22.840051 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1115ff-11d5-4f81-b536-aa0d29010145 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:22.843258 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:22.847812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:22.933150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9860c-2570-480b-a776-b746072550b0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:22.942285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1115ff-11d5-4f81-b536-aa0d29010145 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:22.966385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790b50d-29fb-4ec3-a4af-f4cbafc67661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:22.967198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790b50d-29fb-4ec3-a4af-f4cbafc67661 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:22.967481 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790b50d-29fb-4ec3-a4af-f4cbafc67661 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:22.967755 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790b50d-29fb-4ec3-a4af-f4cbafc67661 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:22.969485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790b50d-29fb-4ec3-a4af-f4cbafc67661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:22.970958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790b50d-29fb-4ec3-a4af-f4cbafc67661 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:22.972556 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:02:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:22.978136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790b50d-29fb-4ec3-a4af-f4cbafc67661 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:22.979015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef295610-3ab4-4a67-8f1a-cc6c2ba6156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:22.979818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef295610-3ab4-4a67-8f1a-cc6c2ba6156f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:22.980105 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef295610-3ab4-4a67-8f1a-cc6c2ba6156f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:22.980384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef295610-3ab4-4a67-8f1a-cc6c2ba6156f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:22.999563 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef295610-3ab4-4a67-8f1a-cc6c2ba6156f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:23.001742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef295610-3ab4-4a67-8f1a-cc6c2ba6156f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:23.024296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-ef295610-3ab4-4a67-8f1a-cc6c2ba6156f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:02:23.024296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:23.024296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:23.024296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:23.024296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:23.024296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:23.024296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:23.024296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:23.024296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:23.024296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:23.024296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:23.024296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:23.024296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:02:23.024296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:02:23.024296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:23.025180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:23.025994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:02:23.025994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:02:23.025994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:02:23.025994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:02:23.025994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:23.031595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef295610-3ab4-4a67-8f1a-cc6c2ba6156f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:23.059044 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:23.080793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790b50d-29fb-4ec3-a4af-f4cbafc67661 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:23.092585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:23.118022 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ed461-ee75-41b6-b398-033c59ecda9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:23.118736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ed461-ee75-41b6-b398-033c59ecda9c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:23.119022 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ed461-ee75-41b6-b398-033c59ecda9c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:23.119307 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ed461-ee75-41b6-b398-033c59ecda9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:23.120149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ed461-ee75-41b6-b398-033c59ecda9c None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.domain.id=default, user.id=0da3a74593ae46b281650aa7e2026c77) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:23.120461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ed461-ee75-41b6-b398-033c59ecda9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:23.121913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ed461-ee75-41b6-b398-033c59ecda9c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:23.129252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 10/20] 10.222.0.48 () {56 vars in 1322 bytes} [Thu Jun 16 16:02:22 2022] GET /identity/v3/role_assignments?user.id=0da3a74593ae46b281650aa7e2026c77&scope.domain.id=default&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:23.137342 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef295610-3ab4-4a67-8f1a-cc6c2ba6156f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:23.175294 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361217d-5cb8-4744-a8cf-676a288eab4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:23.175984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361217d-5cb8-4744-a8cf-676a288eab4d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:23.176269 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361217d-5cb8-4744-a8cf-676a288eab4d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:23.176549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361217d-5cb8-4744-a8cf-676a288eab4d None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:23.177302 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361217d-5cb8-4744-a8cf-676a288eab4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:23.177612 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361217d-5cb8-4744-a8cf-676a288eab4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:23.179089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361217d-5cb8-4744-a8cf-676a288eab4d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:23.203833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 11/21] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:25.656602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be3489-453a-4efd-8be3-214d219468b5 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:25.656602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be3489-453a-4efd-8be3-214d219468b5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:25.656602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be3489-453a-4efd-8be3-214d219468b5 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:25.656602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 11/22] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:25.662274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db4025-1579-4107-88e8-aa45a3372e4b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:25.662708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db4025-1579-4107-88e8-aa45a3372e4b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:25.664393 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db4025-1579-4107-88e8-aa45a3372e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:25.692419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-37db4025-1579-4107-88e8-aa45a3372e4b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:25.693645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-37db4025-1579-4107-88e8-aa45a3372e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:25.787973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:02:25.836021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be3489-453a-4efd-8be3-214d219468b5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:25.972157 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be3489-453a-4efd-8be3-214d219468b5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:26.017044 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbcc27-c94d-43bf-95f2-473d866d5dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:26.017851 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbcc27-c94d-43bf-95f2-473d866d5dfd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:26.018138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbcc27-c94d-43bf-95f2-473d866d5dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:26.018416 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbcc27-c94d-43bf-95f2-473d866d5dfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:26.035071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbcc27-c94d-43bf-95f2-473d866d5dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-eccbcc27-c94d-43bf-95f2-473d866d5dfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:26.042927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:26.043849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:26.045111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:26.045111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:26.045111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:26.045111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:26.045111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:26.045111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:26.045111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:26.045111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:26.045111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:26.045111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:26.045111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:26.045111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:02:26.045111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 12/24] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:02:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:26.055650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db4025-1579-4107-88e8-aa45a3372e4b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:26.151544 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:26.230290 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db4025-1579-4107-88e8-aa45a3372e4b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:26.267129 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b748-334a-4e68-b8a7-811fcc9cf7ef None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:26.267671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b748-334a-4e68-b8a7-811fcc9cf7ef None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:26.268119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b748-334a-4e68-b8a7-811fcc9cf7ef None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:26.270492 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 13/25] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:26.275892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3392-a793-40bb-8b9e-ea5c73a3d29b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:26.276437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3392-a793-40bb-8b9e-ea5c73a3d29b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:26.276910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc3392-a793-40bb-8b9e-ea5c73a3d29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:26.281597 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34a335-b171-437f-a14f-dd004e60cfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:26.282336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34a335-b171-437f-a14f-dd004e60cfbc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:26.284132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34a335-b171-437f-a14f-dd004e60cfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:26.284132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34a335-b171-437f-a14f-dd004e60cfbc None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:26.284132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34a335-b171-437f-a14f-dd004e60cfbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:26.284132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34a335-b171-437f-a14f-dd004e60cfbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:26.285390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34a335-b171-437f-a14f-dd004e60cfbc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:26.298727 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 13/26] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:26.300206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:26.301146 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67f41f-670f-4457-8021-97ab6c6b2ecc None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:26.301525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67f41f-670f-4457-8021-97ab6c6b2ecc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:26.302096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67f41f-670f-4457-8021-97ab6c6b2ecc None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:26.304173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 14/27] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:26.305275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67f41f-670f-4457-8021-97ab6c6b2ecc None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:26.331079 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-33cc3392-a793-40bb-8b9e-ea5c73a3d29b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:26.332330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-33cc3392-a793-40bb-8b9e-ea5c73a3d29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:26.435949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 14/28] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:02:26.437972 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13ac1c-0ab4-4b25-ae8d-526407d1abc8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:26.438739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13ac1c-0ab4-4b25-ae8d-526407d1abc8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:26.439616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13ac1c-0ab4-4b25-ae8d-526407d1abc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:26.458326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67f41f-670f-4457-8021-97ab6c6b2ecc None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:26.462736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7e13ac1c-0ab4-4b25-ae8d-526407d1abc8 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:26.464312 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7e13ac1c-0ab4-4b25-ae8d-526407d1abc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:26.470021 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:26.500766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356ca01-ca67-48e2-b8f7-243abf52ee75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:26.502070 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356ca01-ca67-48e2-b8f7-243abf52ee75 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:26.502611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356ca01-ca67-48e2-b8f7-243abf52ee75 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:26.503146 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356ca01-ca67-48e2-b8f7-243abf52ee75 None admin] PATH_INFO: `/v3/users/0da3a74593ae46b281650aa7e2026c77` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:26.505081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356ca01-ca67-48e2-b8f7-243abf52ee75 None admin] RBAC: Authorizing `identity:get_user(user_id=0da3a74593ae46b281650aa7e2026c77)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:26.506755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356ca01-ca67-48e2-b8f7-243abf52ee75 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:26.508815 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 15/29] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:26 2022] GET /identity/v3/users/0da3a74593ae46b281650aa7e2026c77 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:26.510463 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15febf40-67d6-405d-94ac-67289a4269f0 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:26.510951 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15febf40-67d6-405d-94ac-67289a4269f0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:26.511421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15febf40-67d6-405d-94ac-67289a4269f0 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:26.517395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:26.518650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15febf40-67d6-405d-94ac-67289a4269f0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:26.557510 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 15/31] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:26.558395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13ac1c-0ab4-4b25-ae8d-526407d1abc8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:26.635608 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15febf40-67d6-405d-94ac-67289a4269f0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:26.649522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:26.678096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10a722-0b8f-4e40-b8fb-b2336cbb1738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:26.678809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10a722-0b8f-4e40-b8fb-b2336cbb1738 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:26.679103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10a722-0b8f-4e40-b8fb-b2336cbb1738 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:26.679392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10a722-0b8f-4e40-b8fb-b2336cbb1738 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:26.680147 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10a722-0b8f-4e40-b8fb-b2336cbb1738 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:26.681793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10a722-0b8f-4e40-b8fb-b2336cbb1738 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:26.702710 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13ac1c-0ab4-4b25-ae8d-526407d1abc8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:26.748563 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573146e5-4473-4207-9135-5ca5a129da7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:26.749430 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573146e5-4473-4207-9135-5ca5a129da7d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:26.750259 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573146e5-4473-4207-9135-5ca5a129da7d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:26.750565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573146e5-4473-4207-9135-5ca5a129da7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:26.751866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573146e5-4473-4207-9135-5ca5a129da7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:26.753361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573146e5-4473-4207-9135-5ca5a129da7d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:26.755183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 16/32] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:02:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:26.756399 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eb987-e7a6-4b9f-afeb-20853f984a05 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:26.756696 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eb987-e7a6-4b9f-afeb-20853f984a05 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:26.757030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eb987-e7a6-4b9f-afeb-20853f984a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:26.774768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a26eb987-e7a6-4b9f-afeb-20853f984a05 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:26.776008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a26eb987-e7a6-4b9f-afeb-20853f984a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:26.824012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 17/33] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jun 16 16:02:26 2022] POST /identity/v3/roles => generated 219 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:02:26.825417 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10a722-0b8f-4e40-b8fb-b2336cbb1738 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:26.869995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 17/34] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:26.871800 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eb987-e7a6-4b9f-afeb-20853f984a05 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:26.894812 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:27.012440 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:27.027352 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10a722-0b8f-4e40-b8fb-b2336cbb1738 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:27.070833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e5725-d19f-4d7b-85fe-415080a8745c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:27.072948 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e5725-d19f-4d7b-85fe-415080a8745c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:27.073449 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e5725-d19f-4d7b-85fe-415080a8745c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:27.073941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e5725-d19f-4d7b-85fe-415080a8745c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:27.081484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eb987-e7a6-4b9f-afeb-20853f984a05 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:27.089523 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e5725-d19f-4d7b-85fe-415080a8745c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:27.091493 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e5725-d19f-4d7b-85fe-415080a8745c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:27.114892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-252e5725-d19f-4d7b-85fe-415080a8745c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:02:27.114892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:27.114892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:27.114892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:27.114892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:27.114892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:27.114892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:27.114892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:27.114892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:27.114892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:27.114892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:27.114892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:27.114892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:02:27.114892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:02:27.114892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:27.115765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:27.116568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:02:27.116568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:02:27.116568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:02:27.116568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:02:27.118567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 18/35] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:27.119613 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e5725-d19f-4d7b-85fe-415080a8745c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:27.128118 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ced165-78bd-4e22-864e-1c7548606537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:27.128439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ced165-78bd-4e22-864e-1c7548606537 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:27.129509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ced165-78bd-4e22-864e-1c7548606537 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:27.129509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ced165-78bd-4e22-864e-1c7548606537 None admin] PATH_INFO: `/v3/domains/default/users/0da3a74593ae46b281650aa7e2026c77/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:27.133015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ced165-78bd-4e22-864e-1c7548606537 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0da3a74593ae46b281650aa7e2026c77, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:27.135748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ced165-78bd-4e22-864e-1c7548606537 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:27.355347 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:27.371658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e5725-d19f-4d7b-85fe-415080a8745c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:27.410466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 18/36] 10.222.0.48 () {58 vars in 1361 bytes} [Thu Jun 16 16:02:26 2022] PUT /identity/v3/domains/default/users/0da3a74593ae46b281650aa7e2026c77/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:02:27.410466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ced165-78bd-4e22-864e-1c7548606537 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:27.417190 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba39c19-b744-423b-9177-d178adcfc8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:27.418023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba39c19-b744-423b-9177-d178adcfc8ab None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:27.418377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba39c19-b744-423b-9177-d178adcfc8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:27.418697 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba39c19-b744-423b-9177-d178adcfc8ab None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:27.419472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba39c19-b744-423b-9177-d178adcfc8ab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:27.421982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba39c19-b744-423b-9177-d178adcfc8ab None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:27.442348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 19/37] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jun 16 16:02:27 2022] POST /identity/v3/roles => generated 225 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:02:27.444350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfd399-0d5b-4df8-99c9-409a315b6425 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:27.444670 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfd399-0d5b-4df8-99c9-409a315b6425 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:27.445385 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfd399-0d5b-4df8-99c9-409a315b6425 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:27.447780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 20/38] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:27.453777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeb66c-801d-4bfa-9030-4dc3873d753b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:27.454444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeb66c-801d-4bfa-9030-4dc3873d753b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:27.455006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeb66c-801d-4bfa-9030-4dc3873d753b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:27.482062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ddeeb66c-801d-4bfa-9030-4dc3873d753b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:27.485151 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ddeeb66c-801d-4bfa-9030-4dc3873d753b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:27.551459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ced165-78bd-4e22-864e-1c7548606537 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:27.569994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 21/39] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:27.583736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:27.596675 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeeb66c-801d-4bfa-9030-4dc3873d753b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:27.602088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e81c11-9707-4074-80ae-4d98d6df4faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:27.603089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81c11-9707-4074-80ae-4d98d6df4faa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:27.603520 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81c11-9707-4074-80ae-4d98d6df4faa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:27.603977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81c11-9707-4074-80ae-4d98d6df4faa None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:27.604898 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e81c11-9707-4074-80ae-4d98d6df4faa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:27.605425 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e81c11-9707-4074-80ae-4d98d6df4faa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:27.608078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e81c11-9707-4074-80ae-4d98d6df4faa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:27.640115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 19/40] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:27.647204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e81c11-9707-4074-80ae-4d98d6df4faa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:27.721585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:27.761402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeeb66c-801d-4bfa-9030-4dc3873d753b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:27.803623 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e81c11-9707-4074-80ae-4d98d6df4faa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:27.804121 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db9512-a034-485b-aca8-1f36e93275ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:27.804594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db9512-a034-485b-aca8-1f36e93275ff None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:27.804879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db9512-a034-485b-aca8-1f36e93275ff None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:27.805166 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db9512-a034-485b-aca8-1f36e93275ff None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:27.805934 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db9512-a034-485b-aca8-1f36e93275ff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:27.807400 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db9512-a034-485b-aca8-1f36e93275ff None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:27.825429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 22/41] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jun 16 16:02:27 2022] POST /identity/v3/roles => generated 223 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:02:27.830509 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a691c8-ee9c-4bd1-b34d-4655618f3e86 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:27.830509 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a691c8-ee9c-4bd1-b34d-4655618f3e86 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:27.830509 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a691c8-ee9c-4bd1-b34d-4655618f3e86 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:27.830509 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 23/42] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:27.836478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5298d-9121-4055-866c-125d98a45be1 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:27.836810 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5298d-9121-4055-866c-125d98a45be1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:27.837052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5298d-9121-4055-866c-125d98a45be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:27.857230 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3bf5298d-9121-4055-866c-125d98a45be1 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:27.858129 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157ccf6-df6d-42d2-85f7-c64b0d168ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:27.858903 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157ccf6-df6d-42d2-85f7-c64b0d168ba9 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:27.859785 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157ccf6-df6d-42d2-85f7-c64b0d168ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:27.860218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157ccf6-df6d-42d2-85f7-c64b0d168ba9 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:27.860617 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3bf5298d-9121-4055-866c-125d98a45be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:27.860977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157ccf6-df6d-42d2-85f7-c64b0d168ba9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:27.862561 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157ccf6-df6d-42d2-85f7-c64b0d168ba9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:27.895526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 20/43] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 16 16:02:27 2022] POST /identity/v3/projects => generated 301 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:02:27.954564 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 24/44] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:27.979516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157ccf6-df6d-42d2-85f7-c64b0d168ba9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:28.027223 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:28.108681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157ccf6-df6d-42d2-85f7-c64b0d168ba9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:28.146369 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a056a0e-27a9-49d5-b79d-9f0f32ee11ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:28.147282 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a056a0e-27a9-49d5-b79d-9f0f32ee11ef None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:28.147568 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a056a0e-27a9-49d5-b79d-9f0f32ee11ef None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:28.147848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a056a0e-27a9-49d5-b79d-9f0f32ee11ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:28.149133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a056a0e-27a9-49d5-b79d-9f0f32ee11ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:28.150728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a056a0e-27a9-49d5-b79d-9f0f32ee11ef None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:28.152539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 21/45] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:02:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:28.158078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5298d-9121-4055-866c-125d98a45be1 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:28.226372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:28.262207 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5298d-9121-4055-866c-125d98a45be1 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:28.296221 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace27c67-1baf-47f2-a78f-6ee5c3d53507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:28.298046 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace27c67-1baf-47f2-a78f-6ee5c3d53507 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:28.298337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace27c67-1baf-47f2-a78f-6ee5c3d53507 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:28.298651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace27c67-1baf-47f2-a78f-6ee5c3d53507 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:28.299387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace27c67-1baf-47f2-a78f-6ee5c3d53507 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:28.300863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace27c67-1baf-47f2-a78f-6ee5c3d53507 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:28.329280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 25/46] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 16 16:02:28 2022] POST /identity/v3/projects => generated 312 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:02:29.746726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6e31-2459-4453-a36e-bd482a453f7e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:29.747240 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6e31-2459-4453-a36e-bd482a453f7e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:29.747324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6e31-2459-4453-a36e-bd482a453f7e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:29.748659 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 22/47] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:29.754400 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d33431-1ffb-484e-b321-5da457379d1b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:29.754808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d33431-1ffb-484e-b321-5da457379d1b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:29.755113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d33431-1ffb-484e-b321-5da457379d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:29.771929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-48d33431-1ffb-484e-b321-5da457379d1b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:29.773121 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-48d33431-1ffb-484e-b321-5da457379d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:29.839873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 26/48] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:29.863314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d6e31-2459-4453-a36e-bd482a453f7e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:29.963241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d6e31-2459-4453-a36e-bd482a453f7e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:29.964781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:29.997621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fb26e-ab23-4701-ab03-0f1984f07194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:29.998337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fb26e-ab23-4701-ab03-0f1984f07194 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:29.998659 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fb26e-ab23-4701-ab03-0f1984f07194 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:29.998932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fb26e-ab23-4701-ab03-0f1984f07194 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:30.009630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fb26e-ab23-4701-ab03-0f1984f07194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4f0fb26e-ab23-4701-ab03-0f1984f07194 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:30.017952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:30.019040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:30.020007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:30.020007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:30.020007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:30.020007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:30.020007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:30.020007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:30.020007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:30.020007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:30.020007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:30.020007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:30.020007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:30.020007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:02:30.020007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 23/49] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:02:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:30.026672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d33431-1ffb-484e-b321-5da457379d1b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:30.079714 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:30.132169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d33431-1ffb-484e-b321-5da457379d1b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:30.168600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f513a2-79a5-4d91-a9a9-d3fa1af0542e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:30.169284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f513a2-79a5-4d91-a9a9-d3fa1af0542e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:30.169572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f513a2-79a5-4d91-a9a9-d3fa1af0542e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:30.169855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f513a2-79a5-4d91-a9a9-d3fa1af0542e None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:30.170640 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f513a2-79a5-4d91-a9a9-d3fa1af0542e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:30.170955 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f513a2-79a5-4d91-a9a9-d3fa1af0542e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:30.173585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f513a2-79a5-4d91-a9a9-d3fa1af0542e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:30.181953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 27/50] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:30.187442 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fb26e-ab23-4701-ab03-0f1984f07194 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:30.287404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fb26e-ab23-4701-ab03-0f1984f07194 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:30.321626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b74e81-d4d6-46a3-82f0-0a6743076d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:30.322523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b74e81-d4d6-46a3-82f0-0a6743076d53 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:30.322811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b74e81-d4d6-46a3-82f0-0a6743076d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:30.323087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b74e81-d4d6-46a3-82f0-0a6743076d53 None admin] PATH_INFO: `/v3/users/0da3a74593ae46b281650aa7e2026c77` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:30.324268 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b74e81-d4d6-46a3-82f0-0a6743076d53 None admin] RBAC: Authorizing `identity:get_user(user_id=0da3a74593ae46b281650aa7e2026c77)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:30.325725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b74e81-d4d6-46a3-82f0-0a6743076d53 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:30.327553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 24/51] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:30 2022] GET /identity/v3/users/0da3a74593ae46b281650aa7e2026c77 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:30.332957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f513a2-79a5-4d91-a9a9-d3fa1af0542e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:30.441585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f513a2-79a5-4d91-a9a9-d3fa1af0542e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:30.456045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:30.477688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368f5c2-1c96-494f-8192-e2f9156225c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:30.478535 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368f5c2-1c96-494f-8192-e2f9156225c1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:30.478829 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368f5c2-1c96-494f-8192-e2f9156225c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:30.479116 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368f5c2-1c96-494f-8192-e2f9156225c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:30.480587 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368f5c2-1c96-494f-8192-e2f9156225c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:30.482299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368f5c2-1c96-494f-8192-e2f9156225c1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:30.483463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482cfe-b87f-46fb-a420-8df368f18751 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:30.483896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482cfe-b87f-46fb-a420-8df368f18751 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:30.484228 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482cfe-b87f-46fb-a420-8df368f18751 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:30.484545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 28/52] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:02:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:30.485785 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 25/53] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:02:30.490809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc482cfe-b87f-46fb-a420-8df368f18751 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:30.491052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2d00c-e654-4879-9b19-832700429461 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:30.491352 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2d00c-e654-4879-9b19-832700429461 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:30.491706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2d00c-e654-4879-9b19-832700429461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:30.509359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-64f2d00c-e654-4879-9b19-832700429461 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:30.510618 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-64f2d00c-e654-4879-9b19-832700429461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:30.521972 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:30.582458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 29/54] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:02:30.600195 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc482cfe-b87f-46fb-a420-8df368f18751 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:30.605419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2d00c-e654-4879-9b19-832700429461 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:30.637535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d5f2d-86dd-4720-8edb-19b20cab6a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:30.638198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d5f2d-86dd-4720-8edb-19b20cab6a7e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:30.638510 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d5f2d-86dd-4720-8edb-19b20cab6a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:30.638793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d5f2d-86dd-4720-8edb-19b20cab6a7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:30.639630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d5f2d-86dd-4720-8edb-19b20cab6a7e None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.domain.id=default, user.id=0da3a74593ae46b281650aa7e2026c77) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:30.639945 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d5f2d-86dd-4720-8edb-19b20cab6a7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:30.642097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d5f2d-86dd-4720-8edb-19b20cab6a7e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:30.648195 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 26/55] 10.222.0.48 () {56 vars in 1322 bytes} [Thu Jun 16 16:02:30 2022] GET /identity/v3/role_assignments?user.id=0da3a74593ae46b281650aa7e2026c77&scope.domain.id=default&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:30.714221 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2d00c-e654-4879-9b19-832700429461 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:30.727994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:30.754234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d4f31-fa29-409d-b14c-5a4845209785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:30.755093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d4f31-fa29-409d-b14c-5a4845209785 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:30.755627 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d4f31-fa29-409d-b14c-5a4845209785 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:30.755627 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d4f31-fa29-409d-b14c-5a4845209785 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:30.756872 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d4f31-fa29-409d-b14c-5a4845209785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:30.758370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d4f31-fa29-409d-b14c-5a4845209785 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:30.760091 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 30/56] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:02:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:30.767172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d5f2d-86dd-4720-8edb-19b20cab6a7e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:30.869304 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:30.879242 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d5f2d-86dd-4720-8edb-19b20cab6a7e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:30.912798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e733ac-93ce-4665-982b-0cd5e41abe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:30.913458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e733ac-93ce-4665-982b-0cd5e41abe30 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:30.913741 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e733ac-93ce-4665-982b-0cd5e41abe30 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:30.914016 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e733ac-93ce-4665-982b-0cd5e41abe30 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:30.914746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e733ac-93ce-4665-982b-0cd5e41abe30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:30.916178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e733ac-93ce-4665-982b-0cd5e41abe30 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:30.940303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 27/57] 10.222.0.48 () {60 vars in 1140 bytes} [Thu Jun 16 16:02:30 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:02:33.089656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeb9eb-eacd-46e8-9cae-1e35f5b3fa16 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:33.090207 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeb9eb-eacd-46e8-9cae-1e35f5b3fa16 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:33.090298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeb9eb-eacd-46e8-9cae-1e35f5b3fa16 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:33.091783 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 31/58] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:33.097090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dd0aa-e41e-4f52-8c6b-9d01f6a865bf None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:33.097517 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dd0aa-e41e-4f52-8c6b-9d01f6a865bf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:33.097660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dd0aa-e41e-4f52-8c6b-9d01f6a865bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:33.115025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bf6dd0aa-e41e-4f52-8c6b-9d01f6a865bf None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:33.116579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bf6dd0aa-e41e-4f52-8c6b-9d01f6a865bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:33.184396 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 28/59] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:33.212502 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeb9eb-eacd-46e8-9cae-1e35f5b3fa16 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:33.311196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeb9eb-eacd-46e8-9cae-1e35f5b3fa16 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:33.345420 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0ea1a-2bdf-4805-9c89-44601fbf652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:33.346161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0ea1a-2bdf-4805-9c89-44601fbf652c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:33.346465 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0ea1a-2bdf-4805-9c89-44601fbf652c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:33.346747 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0ea1a-2bdf-4805-9c89-44601fbf652c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:33.347946 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0ea1a-2bdf-4805-9c89-44601fbf652c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:33.349418 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0ea1a-2bdf-4805-9c89-44601fbf652c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:33.351081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 32/60] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:02:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:33.356487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dd0aa-e41e-4f52-8c6b-9d01f6a865bf None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:33.439536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:33.463598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dd0aa-e41e-4f52-8c6b-9d01f6a865bf None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:33.496537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a561397-80d9-451d-aea4-68e69c02b48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:33.497211 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a561397-80d9-451d-aea4-68e69c02b48b None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:33.497499 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a561397-80d9-451d-aea4-68e69c02b48b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:33.497780 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a561397-80d9-451d-aea4-68e69c02b48b None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:33.498526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a561397-80d9-451d-aea4-68e69c02b48b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:33.500045 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a561397-80d9-451d-aea4-68e69c02b48b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:33.525040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 29/61] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:02:33 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:02:36.681175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b245cdc-e434-4eff-9539-187ceb399de1 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:36.682026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b245cdc-e434-4eff-9539-187ceb399de1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:36.682487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b245cdc-e434-4eff-9539-187ceb399de1 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:36.684299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 33/62] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:36.689801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39ed02-3806-42c7-82fe-7b637b36d254 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:36.690645 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39ed02-3806-42c7-82fe-7b637b36d254 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:36.691078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39ed02-3806-42c7-82fe-7b637b36d254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:36.720521 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3e39ed02-3806-42c7-82fe-7b637b36d254 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:36.721990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3e39ed02-3806-42c7-82fe-7b637b36d254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:36.824995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 30/63] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:36.871951 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b245cdc-e434-4eff-9539-187ceb399de1 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:36.950332 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:36.984365 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8181f-e347-40a7-a4d6-36e9f644139a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:36.985001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8181f-e347-40a7-a4d6-36e9f644139a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:36.985498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8181f-e347-40a7-a4d6-36e9f644139a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:36.987116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 31/64] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:02:36.992308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52033dba-e0b0-42a9-b256-b8bc10a9afc9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:36.992601 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52033dba-e0b0-42a9-b256-b8bc10a9afc9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:36.992887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52033dba-e0b0-42a9-b256-b8bc10a9afc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:37.027156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-52033dba-e0b0-42a9-b256-b8bc10a9afc9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:37.028395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-52033dba-e0b0-42a9-b256-b8bc10a9afc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:37.046347 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b245cdc-e434-4eff-9539-187ceb399de1 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:37.099870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f067b-e800-4ed5-aa77-19fe13abfd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:37.100688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f067b-e800-4ed5-aa77-19fe13abfd0e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:37.102411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f067b-e800-4ed5-aa77-19fe13abfd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:37.102730 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f067b-e800-4ed5-aa77-19fe13abfd0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:37.132472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f067b-e800-4ed5-aa77-19fe13abfd0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-859f067b-e800-4ed5-aa77-19fe13abfd0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:37.144795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:37.145713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:37.146517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:37.146517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:37.146517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:37.146517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:37.146517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:37.146517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:37.146517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:37.146517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:37.146517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:37.146517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:37.146517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:02:37.146517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:02:37.151260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 34/65] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:37.157325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f067b-e800-4ed5-aa77-19fe13abfd0e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:37.160005 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:37.184943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 32/66] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:02:37.225712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52033dba-e0b0-42a9-b256-b8bc10a9afc9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:37.314227 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f067b-e800-4ed5-aa77-19fe13abfd0e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:37.322761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:37.358217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489fd7a-36a5-4606-bedc-510773c4e662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:37.360533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489fd7a-36a5-4606-bedc-510773c4e662 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:37.361021 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489fd7a-36a5-4606-bedc-510773c4e662 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:37.361453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489fd7a-36a5-4606-bedc-510773c4e662 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:37.362401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489fd7a-36a5-4606-bedc-510773c4e662 None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:37.362893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489fd7a-36a5-4606-bedc-510773c4e662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:37.364496 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489fd7a-36a5-4606-bedc-510773c4e662 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:37.376334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 35/67] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:02:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:37.378073 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c296ca2-dd52-4c9b-a668-7b7c38575753 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:37.378605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c296ca2-dd52-4c9b-a668-7b7c38575753 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:37.379204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c296ca2-dd52-4c9b-a668-7b7c38575753 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:37.380824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 36/68] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:37.381869 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c296ca2-dd52-4c9b-a668-7b7c38575753 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:37.383007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52033dba-e0b0-42a9-b256-b8bc10a9afc9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:37.430096 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13787d-64c5-4791-9675-76f1f1fbdc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:37.430975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13787d-64c5-4791-9675-76f1f1fbdc2e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:37.431266 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13787d-64c5-4791-9675-76f1f1fbdc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:37.431554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13787d-64c5-4791-9675-76f1f1fbdc2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:37.449548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13787d-64c5-4791-9675-76f1f1fbdc2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6e13787d-64c5-4791-9675-76f1f1fbdc2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:37.459532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:37.460437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:37.461202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:37.461202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:37.461202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:37.461202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:37.461202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:37.461202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:37.461202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:37.461202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:37.461202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:37.461202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:37.461202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:37.461202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:02:37.461202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 33/69] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:02:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:37.462410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c71f5-c294-4dff-ba26-4e3b7a108bee None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:37.462410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c71f5-c294-4dff-ba26-4e3b7a108bee None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:37.462664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c71f5-c294-4dff-ba26-4e3b7a108bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:37.481295 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-659c71f5-c294-4dff-ba26-4e3b7a108bee None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:37.482462 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-659c71f5-c294-4dff-ba26-4e3b7a108bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:37.508499 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c296ca2-dd52-4c9b-a668-7b7c38575753 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:37.533150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:37.542056 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c55f4-5148-475b-8dd8-55b529a7bd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:37.542983 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c55f4-5148-475b-8dd8-55b529a7bd13 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:37.543271 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c55f4-5148-475b-8dd8-55b529a7bd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:37.543555 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c55f4-5148-475b-8dd8-55b529a7bd13 None admin] PATH_INFO: `/v3/users/39c09083dd8a4c6dadfc555929d428f4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:37.554725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 34/70] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:37.556402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688c72e-2a0b-4d64-88af-d0b219d4e90e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:37.556701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688c72e-2a0b-4d64-88af-d0b219d4e90e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:37.556981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688c72e-2a0b-4d64-88af-d0b219d4e90e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:37.558270 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 35/71] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:37.559006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688c72e-2a0b-4d64-88af-d0b219d4e90e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:37.560845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c55f4-5148-475b-8dd8-55b529a7bd13 None admin] RBAC: Authorizing `identity:get_user(user_id=39c09083dd8a4c6dadfc555929d428f4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:37.563036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c55f4-5148-475b-8dd8-55b529a7bd13 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:37.564761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 37/72] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:37 2022] GET /identity/v3/users/39c09083dd8a4c6dadfc555929d428f4 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:37.566161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab7b3-84a0-4e98-9746-57a881dc1e06 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:37.570481 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab7b3-84a0-4e98-9746-57a881dc1e06 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:37.570965 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab7b3-84a0-4e98-9746-57a881dc1e06 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:37.574789 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 38/73] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:37.574789 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ab7b3-84a0-4e98-9746-57a881dc1e06 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:37.604002 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:37.665541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688c72e-2a0b-4d64-88af-d0b219d4e90e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:37.682444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ab7b3-84a0-4e98-9746-57a881dc1e06 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:37.701751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e218e-5d9a-4338-a2dc-a382789f0368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:37.702442 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e218e-5d9a-4338-a2dc-a382789f0368 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:37.702978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e218e-5d9a-4338-a2dc-a382789f0368 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:37.703470 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e218e-5d9a-4338-a2dc-a382789f0368 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:37.704291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e218e-5d9a-4338-a2dc-a382789f0368 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:37.704607 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e218e-5d9a-4338-a2dc-a382789f0368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:37.706015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e218e-5d9a-4338-a2dc-a382789f0368 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:37.714481 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 36/74] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:37.715691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b937-28c6-47f0-a8c9-fe1f4b32eb14 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:37.715985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b937-28c6-47f0-a8c9-fe1f4b32eb14 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:37.716269 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b937-28c6-47f0-a8c9-fe1f4b32eb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:37.720667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392605e9-22e5-4754-9734-82e1653af00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:37.721331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392605e9-22e5-4754-9734-82e1653af00a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:37.721621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392605e9-22e5-4754-9734-82e1653af00a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:37.721904 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392605e9-22e5-4754-9734-82e1653af00a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:37.735271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fa18b937-28c6-47f0-a8c9-fe1f4b32eb14 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:37.736308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fa18b937-28c6-47f0-a8c9-fe1f4b32eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:37.777364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:37.799571 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392605e9-22e5-4754-9734-82e1653af00a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:37.801084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392605e9-22e5-4754-9734-82e1653af00a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:37.807094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 37/75] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:37.818647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95d141-0c31-4a39-bf25-2e1a97cbc3c0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:37.818647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95d141-0c31-4a39-bf25-2e1a97cbc3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:37.818647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95d141-0c31-4a39-bf25-2e1a97cbc3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:37.825963 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cd95d141-0c31-4a39-bf25-2e1a97cbc3c0 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:37.827303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cd95d141-0c31-4a39-bf25-2e1a97cbc3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:37.829908 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:37.897659 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 38/76] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:37.898548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95d141-0c31-4a39-bf25-2e1a97cbc3c0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:37.904748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 39/77] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:02:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:02:37.905492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392605e9-22e5-4754-9734-82e1653af00a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:38.003579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95d141-0c31-4a39-bf25-2e1a97cbc3c0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:38.007043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:38.011403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392605e9-22e5-4754-9734-82e1653af00a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:38.038816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:38.043725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c542af2-7887-4267-a775-fcdba8ac7a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:38.044506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c542af2-7887-4267-a775-fcdba8ac7a7f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:38.044797 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c542af2-7887-4267-a775-fcdba8ac7a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:38.045076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c542af2-7887-4267-a775-fcdba8ac7a7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:38.047630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c542af2-7887-4267-a775-fcdba8ac7a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:38.049111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c542af2-7887-4267-a775-fcdba8ac7a7f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:38.050325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e9171-368c-4c45-abfe-7e5a118eec22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:38.050833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 39/78] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:02:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:38.051253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e9171-368c-4c45-abfe-7e5a118eec22 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:38.051540 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e9171-368c-4c45-abfe-7e5a118eec22 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:38.051824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e9171-368c-4c45-abfe-7e5a118eec22 None admin] PATH_INFO: `/v3/users/0da3a74593ae46b281650aa7e2026c77` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:38.053043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e9171-368c-4c45-abfe-7e5a118eec22 None admin] RBAC: Authorizing `identity:get_user(user_id=0da3a74593ae46b281650aa7e2026c77)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:38.054576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e9171-368c-4c45-abfe-7e5a118eec22 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:38.055341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c542af2-7887-4267-a775-fcdba8ac7a7f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:38.061113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 40/79] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:37 2022] GET /identity/v3/users/0da3a74593ae46b281650aa7e2026c77 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:38.061113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e9171-368c-4c45-abfe-7e5a118eec22 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:38.162842 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c542af2-7887-4267-a775-fcdba8ac7a7f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:38.163451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e9171-368c-4c45-abfe-7e5a118eec22 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:38.198523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd289-1750-4a41-9f9a-a75d4f43ea81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:38.199348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd289-1750-4a41-9f9a-a75d4f43ea81 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:38.199611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179beddc-84ad-49d2-941c-0a6dfc97c87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:38.199714 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd289-1750-4a41-9f9a-a75d4f43ea81 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:38.199899 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd289-1750-4a41-9f9a-a75d4f43ea81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:38.200698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179beddc-84ad-49d2-941c-0a6dfc97c87e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:38.201052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179beddc-84ad-49d2-941c-0a6dfc97c87e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:38.201423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179beddc-84ad-49d2-941c-0a6dfc97c87e None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:38.202868 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179beddc-84ad-49d2-941c-0a6dfc97c87e None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:38.204334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179beddc-84ad-49d2-941c-0a6dfc97c87e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:38.206063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 41/80] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:38 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:38.206882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179beddc-84ad-49d2-941c-0a6dfc97c87e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:38.214766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dd289-1750-4a41-9f9a-a75d4f43ea81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-269dd289-1750-4a41-9f9a-a75d4f43ea81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:38.223220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:38.224466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:38.225418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:38.225418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:38.225418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:38.225418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:38.225418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:38.225418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:38.225418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:38.225418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:38.225418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:38.225418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:38.225418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:02:38.225418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:02:38.225418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 40/81] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:02:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:38.225418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd289-1750-4a41-9f9a-a75d4f43ea81 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:38.258605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:38.273976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:38.314934 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179beddc-84ad-49d2-941c-0a6dfc97c87e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:38.328315 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd289-1750-4a41-9f9a-a75d4f43ea81 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:38.351756 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1513fce-ea66-47d5-9fe4-1202bf7f1573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:38.352569 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513fce-ea66-47d5-9fe4-1202bf7f1573 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:38.352862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513fce-ea66-47d5-9fe4-1202bf7f1573 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:38.353146 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513fce-ea66-47d5-9fe4-1202bf7f1573 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:38.362133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd84205-f080-45b7-885f-e553efad7c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:38.362927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd84205-f080-45b7-885f-e553efad7c09 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:38.363161 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd84205-f080-45b7-885f-e553efad7c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:38.363439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd84205-f080-45b7-885f-e553efad7c09 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:38.364157 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd84205-f080-45b7-885f-e553efad7c09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:38.365563 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1513fce-ea66-47d5-9fe4-1202bf7f1573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:38.365686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd84205-f080-45b7-885f-e553efad7c09 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-f1513fce-ea66-47d5-9fe4-1202bf7f1573 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:38.373426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:38.374589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:38.376411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:38.376411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:38.376411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:38.376411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:38.376411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:38.376411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:38.376411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:38.376411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:38.376411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:38.376411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:38.376411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:02:38.376411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:02:38.376411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 42/82] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:38.376411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1513fce-ea66-47d5-9fe4-1202bf7f1573 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:38.389107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 41/83] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:02:38 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:02:38.390179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd84205-f080-45b7-885f-e553efad7c09 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:38.508286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:38.510741 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1513fce-ea66-47d5-9fe4-1202bf7f1573 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:38.528656 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd84205-f080-45b7-885f-e553efad7c09 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:38.537321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:38.553384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ef3e2-95be-48b4-8e1b-b78211385b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:38.554062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ef3e2-95be-48b4-8e1b-b78211385b25 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:38.554359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ef3e2-95be-48b4-8e1b-b78211385b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:38.555202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ef3e2-95be-48b4-8e1b-b78211385b25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:38.570846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e8409-15ce-4ec9-9b96-58fd03792e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:38.571795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e8409-15ce-4ec9-9b96-58fd03792e32 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:38.572091 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e8409-15ce-4ec9-9b96-58fd03792e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:38.572378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e8409-15ce-4ec9-9b96-58fd03792e32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:38.573226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e8409-15ce-4ec9-9b96-58fd03792e32 None admin] RBAC: Adding query filter params (role.id=2c5988d189bd4b4482fb3649b9cf1de4, scope.project.id=815bcedbe8ea4401944309ac6a34f4d0, user.id=39c09083dd8a4c6dadfc555929d428f4) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:38.573847 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e8409-15ce-4ec9-9b96-58fd03792e32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:38.575734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e8409-15ce-4ec9-9b96-58fd03792e32 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:38.581826 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 42/84] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:02:38 2022] GET /identity/v3/role_assignments?user.id=39c09083dd8a4c6dadfc555929d428f4&scope.project.id=815bcedbe8ea4401944309ac6a34f4d0&role.id=2c5988d189bd4b4482fb3649b9cf1de4 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:38.582655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e8409-15ce-4ec9-9b96-58fd03792e32 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:38.652588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ef3e2-95be-48b4-8e1b-b78211385b25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:38.654107 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ef3e2-95be-48b4-8e1b-b78211385b25 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:38.728580 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e8409-15ce-4ec9-9b96-58fd03792e32 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:38.782178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b388c42-ea41-41cc-b60a-0bb783aa9e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:38.783123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b388c42-ea41-41cc-b60a-0bb783aa9e94 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:38.783415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b388c42-ea41-41cc-b60a-0bb783aa9e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:38.783750 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b388c42-ea41-41cc-b60a-0bb783aa9e94 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:38.784522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b388c42-ea41-41cc-b60a-0bb783aa9e94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:38.784839 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b388c42-ea41-41cc-b60a-0bb783aa9e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:38.786252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b388c42-ea41-41cc-b60a-0bb783aa9e94 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:38.798522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 43/85] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:02:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:38.798522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b388c42-ea41-41cc-b60a-0bb783aa9e94 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:38.807706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 43/86] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:02:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:02:38.808661 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ef3e2-95be-48b4-8e1b-b78211385b25 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:38.826838 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:38.836180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:38.915285 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b388c42-ea41-41cc-b60a-0bb783aa9e94 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:38.923070 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ef3e2-95be-48b4-8e1b-b78211385b25 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:38.954858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a889715-dd8a-40b5-a048-1ab4dfe47641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:38.955812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a889715-dd8a-40b5-a048-1ab4dfe47641 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:38.956241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a889715-dd8a-40b5-a048-1ab4dfe47641 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:38.956659 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a889715-dd8a-40b5-a048-1ab4dfe47641 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:38.957709 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a889715-dd8a-40b5-a048-1ab4dfe47641 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:38.958160 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a889715-dd8a-40b5-a048-1ab4dfe47641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:38.959862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a889715-dd8a-40b5-a048-1ab4dfe47641 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:38.962830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55529ca1-eebc-4a09-a1c7-5a4e4c22dc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:38.963912 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55529ca1-eebc-4a09-a1c7-5a4e4c22dc21 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:38.964394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55529ca1-eebc-4a09-a1c7-5a4e4c22dc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:38.964818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55529ca1-eebc-4a09-a1c7-5a4e4c22dc21 None admin] PATH_INFO: `/v3/users/39c09083dd8a4c6dadfc555929d428f4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:38.966326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55529ca1-eebc-4a09-a1c7-5a4e4c22dc21 None admin] RBAC: Authorizing `identity:get_user(user_id=39c09083dd8a4c6dadfc555929d428f4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:38.968177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55529ca1-eebc-4a09-a1c7-5a4e4c22dc21 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:38.970193 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 44/87] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:02:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:38.971107 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 44/88] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:38 2022] GET /identity/v3/users/39c09083dd8a4c6dadfc555929d428f4 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:38.971493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a889715-dd8a-40b5-a048-1ab4dfe47641 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:38.976671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55529ca1-eebc-4a09-a1c7-5a4e4c22dc21 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:39.060102 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:39.085594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:39.086981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a889715-dd8a-40b5-a048-1ab4dfe47641 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:39.097648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55529ca1-eebc-4a09-a1c7-5a4e4c22dc21 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:39.124898 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93273f43-4480-42fc-adb3-84a833511911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:39.126363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93273f43-4480-42fc-adb3-84a833511911 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:39.126782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93273f43-4480-42fc-adb3-84a833511911 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:39.127167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93273f43-4480-42fc-adb3-84a833511911 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:39.129117 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93273f43-4480-42fc-adb3-84a833511911 None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:39.131299 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93273f43-4480-42fc-adb3-84a833511911 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:39.133890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 45/89] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:38 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:39.135080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93273f43-4480-42fc-adb3-84a833511911 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:39.143797 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c820a-742c-4856-8140-c4feae58113e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:39.145626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c820a-742c-4856-8140-c4feae58113e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:39.146276 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c820a-742c-4856-8140-c4feae58113e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:39.146808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c820a-742c-4856-8140-c4feae58113e None admin] PATH_INFO: `/v3/users/39c09083dd8a4c6dadfc555929d428f4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:39.148396 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c820a-742c-4856-8140-c4feae58113e None admin] RBAC: Authorizing `identity:get_user(user_id=39c09083dd8a4c6dadfc555929d428f4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:39.150116 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c820a-742c-4856-8140-c4feae58113e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:39.152081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 45/90] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:38 2022] GET /identity/v3/users/39c09083dd8a4c6dadfc555929d428f4 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:39.153046 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c820a-742c-4856-8140-c4feae58113e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:39.350747 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93273f43-4480-42fc-adb3-84a833511911 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:39.359726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c820a-742c-4856-8140-c4feae58113e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:39.406683 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895c2aa-4668-4d18-8d90-918510263f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:39.407921 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895c2aa-4668-4d18-8d90-918510263f0a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:39.408549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895c2aa-4668-4d18-8d90-918510263f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:39.409011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895c2aa-4668-4d18-8d90-918510263f0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:39.410304 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895c2aa-4668-4d18-8d90-918510263f0a None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=815bcedbe8ea4401944309ac6a34f4d0, user.id=0da3a74593ae46b281650aa7e2026c77) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:39.410814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895c2aa-4668-4d18-8d90-918510263f0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:39.412450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895c2aa-4668-4d18-8d90-918510263f0a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:39.433695 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 46/91] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:02:39 2022] GET /identity/v3/role_assignments?user.id=0da3a74593ae46b281650aa7e2026c77&scope.project.id=815bcedbe8ea4401944309ac6a34f4d0&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:39.436174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895c2aa-4668-4d18-8d90-918510263f0a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:39.448530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcff65-cfa8-41b0-8467-b8c132fe13e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:39.449213 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcff65-cfa8-41b0-8467-b8c132fe13e1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:39.449502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcff65-cfa8-41b0-8467-b8c132fe13e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:39.449784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcff65-cfa8-41b0-8467-b8c132fe13e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:39.485479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:39.519548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:39.595661 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcff65-cfa8-41b0-8467-b8c132fe13e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:39.597731 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcff65-cfa8-41b0-8467-b8c132fe13e1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:39.712243 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895c2aa-4668-4d18-8d90-918510263f0a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:39.761989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755fd22-1d07-42c2-a25d-fb04939ea88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:39.762686 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755fd22-1d07-42c2-a25d-fb04939ea88b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:39.762979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755fd22-1d07-42c2-a25d-fb04939ea88b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:39.763265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755fd22-1d07-42c2-a25d-fb04939ea88b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:39.839279 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 46/92] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:02:39.845125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcff65-cfa8-41b0-8467-b8c132fe13e1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:39.880049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755fd22-1d07-42c2-a25d-fb04939ea88b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:39.881545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755fd22-1d07-42c2-a25d-fb04939ea88b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:39.911045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:39.957502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:40.014128 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 47/93] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:02:40.022468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755fd22-1d07-42c2-a25d-fb04939ea88b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:40.104621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcff65-cfa8-41b0-8467-b8c132fe13e1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:40.144080 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755fd22-1d07-42c2-a25d-fb04939ea88b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:40.180594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:40.196056 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e8807-ea9c-45c5-8231-d40990f4edc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:40.196966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e8807-ea9c-45c5-8231-d40990f4edc9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:40.197074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e8807-ea9c-45c5-8231-d40990f4edc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:40.197764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e8807-ea9c-45c5-8231-d40990f4edc9 None admin] PATH_INFO: `/v3/projects/62c8c65a44a5466589117da7cf272ffe` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:40.198676 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e8807-ea9c-45c5-8231-d40990f4edc9 None admin] RBAC: Authorizing `identity:get_project(project_id=62c8c65a44a5466589117da7cf272ffe)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:40.198965 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee841a2c-f6e2-4c10-8edb-212d2ada4412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:40.200002 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e8807-ea9c-45c5-8231-d40990f4edc9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:40.200374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee841a2c-f6e2-4c10-8edb-212d2ada4412 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:40.200866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee841a2c-f6e2-4c10-8edb-212d2ada4412 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:40.201336 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee841a2c-f6e2-4c10-8edb-212d2ada4412 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:40.202029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 48/94] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:40 2022] GET /identity/v3/projects/62c8c65a44a5466589117da7cf272ffe => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:40.204038 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee841a2c-f6e2-4c10-8edb-212d2ada4412 None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:40.205716 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee841a2c-f6e2-4c10-8edb-212d2ada4412 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:40.212704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e8807-ea9c-45c5-8231-d40990f4edc9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:40.212829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 47/95] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:39 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:40.231261 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee841a2c-f6e2-4c10-8edb-212d2ada4412 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:40.383411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e8807-ea9c-45c5-8231-d40990f4edc9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:40.428125 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7e92c-8f8b-44ef-b38c-175c45b389de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:40.428798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e92c-8f8b-44ef-b38c-175c45b389de None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:40.429087 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e92c-8f8b-44ef-b38c-175c45b389de None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:40.429364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e92c-8f8b-44ef-b38c-175c45b389de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:40.430209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7e92c-8f8b-44ef-b38c-175c45b389de None admin] RBAC: Adding query filter params (role.id=2c5988d189bd4b4482fb3649b9cf1de4, scope.project.id=62c8c65a44a5466589117da7cf272ffe, user.id=39c09083dd8a4c6dadfc555929d428f4) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:40.430546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7e92c-8f8b-44ef-b38c-175c45b389de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:40.432019 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7e92c-8f8b-44ef-b38c-175c45b389de None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:40.443967 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 49/96] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:02:40 2022] GET /identity/v3/role_assignments?user.id=39c09083dd8a4c6dadfc555929d428f4&scope.project.id=62c8c65a44a5466589117da7cf272ffe&role.id=2c5988d189bd4b4482fb3649b9cf1de4 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:40.457421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee841a2c-f6e2-4c10-8edb-212d2ada4412 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:40.486645 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:40.522192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c0ca7-a693-4cf8-bce2-a7e00a104bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:40.523344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c0ca7-a693-4cf8-bce2-a7e00a104bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:40.523835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c0ca7-a693-4cf8-bce2-a7e00a104bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:40.524311 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c0ca7-a693-4cf8-bce2-a7e00a104bc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:40.525370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c0ca7-a693-4cf8-bce2-a7e00a104bc6 None admin] RBAC: Adding query filter params (role.id=255c2b4827324109a6d2068c8b0316c3, scope.project.id=815bcedbe8ea4401944309ac6a34f4d0, user.id=39c09083dd8a4c6dadfc555929d428f4) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:40.525907 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c0ca7-a693-4cf8-bce2-a7e00a104bc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:40.527665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c0ca7-a693-4cf8-bce2-a7e00a104bc6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:40.535635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 48/97] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:02:40 2022] GET /identity/v3/role_assignments?user.id=39c09083dd8a4c6dadfc555929d428f4&scope.project.id=815bcedbe8ea4401944309ac6a34f4d0&role.id=255c2b4827324109a6d2068c8b0316c3 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:41.295029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e6aa1-acad-4d3b-93c6-064e7cb42bfd None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:41.295638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e6aa1-acad-4d3b-93c6-064e7cb42bfd None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:41.295638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e6aa1-acad-4d3b-93c6-064e7cb42bfd None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:41.297522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 50/98] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:41.303265 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761aea9-995a-41f8-8ce4-e419d8e19aea None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:41.304146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761aea9-995a-41f8-8ce4-e419d8e19aea None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:41.304637 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761aea9-995a-41f8-8ce4-e419d8e19aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:41.327450 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7761aea9-995a-41f8-8ce4-e419d8e19aea None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:41.329664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7761aea9-995a-41f8-8ce4-e419d8e19aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:41.424835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 49/99] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:41.466284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e6aa1-acad-4d3b-93c6-064e7cb42bfd None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:41.540361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:41.599367 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e6aa1-acad-4d3b-93c6-064e7cb42bfd None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:41.651190 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889794b4-bfbb-44ac-8c17-022acf02cd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:41.652018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889794b4-bfbb-44ac-8c17-022acf02cd16 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:41.652308 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889794b4-bfbb-44ac-8c17-022acf02cd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:41.652587 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889794b4-bfbb-44ac-8c17-022acf02cd16 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:41.670079 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889794b4-bfbb-44ac-8c17-022acf02cd16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-889794b4-bfbb-44ac-8c17-022acf02cd16 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:41.678211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:41.679218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:41.680467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:41.680467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:41.680467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:41.680467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:41.680467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:41.680467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:41.680467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:41.680467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:41.680467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:41.680467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:41.680467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:02:41.680467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:02:41.680467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 51/100] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:41.687730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761aea9-995a-41f8-8ce4-e419d8e19aea None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:41.743754 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2682-2562-4b82-a898-113957f0c1de None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:41.744041 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2682-2562-4b82-a898-113957f0c1de None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:41.744582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2682-2562-4b82-a898-113957f0c1de None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:41.745974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 52/101] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:41.752356 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255236c-4b00-4e9d-85b6-d4a24e060abf None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:41.752606 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255236c-4b00-4e9d-85b6-d4a24e060abf None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:41.752864 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255236c-4b00-4e9d-85b6-d4a24e060abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:41.787698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3255236c-4b00-4e9d-85b6-d4a24e060abf None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:41.788951 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3255236c-4b00-4e9d-85b6-d4a24e060abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:41.890545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761aea9-995a-41f8-8ce4-e419d8e19aea None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:41.904487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 53/102] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:02:41.904487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b884d-4491-4b45-b517-cea993e94d60 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:41.904487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b884d-4491-4b45-b517-cea993e94d60 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:41.904487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b884d-4491-4b45-b517-cea993e94d60 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:41.904487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 54/103] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:41.904910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:41.920146 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2c388-4e86-4f32-b8d7-7f433a844386 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:41.920462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2c388-4e86-4f32-b8d7-7f433a844386 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:41.920704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2c388-4e86-4f32-b8d7-7f433a844386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:41.962207 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-27c2c388-4e86-4f32-b8d7-7f433a844386 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:41.963441 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-27c2c388-4e86-4f32-b8d7-7f433a844386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:41.992882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d8b51-7d61-466e-bf40-fb892e91fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:41.993573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d8b51-7d61-466e-bf40-fb892e91fd89 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:41.993856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d8b51-7d61-466e-bf40-fb892e91fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:41.994135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d8b51-7d61-466e-bf40-fb892e91fd89 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:41.994914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d8b51-7d61-466e-bf40-fb892e91fd89 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:41.995221 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d8b51-7d61-466e-bf40-fb892e91fd89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:41.996628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d8b51-7d61-466e-bf40-fb892e91fd89 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:42.017156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 50/104] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:02:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:42.021314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d8b51-7d61-466e-bf40-fb892e91fd89 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:42.052707 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:42.109690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 55/105] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:02:42.115398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2c388-4e86-4f32-b8d7-7f433a844386 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:42.211386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d8b51-7d61-466e-bf40-fb892e91fd89 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:42.282452 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2c388-4e86-4f32-b8d7-7f433a844386 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:42.287242 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566925b-dad5-4ede-a5e4-90222c77b6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:42.288091 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566925b-dad5-4ede-a5e4-90222c77b6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:42.288381 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566925b-dad5-4ede-a5e4-90222c77b6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:42.288664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566925b-dad5-4ede-a5e4-90222c77b6c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:42.290010 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566925b-dad5-4ede-a5e4-90222c77b6c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:42.291561 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566925b-dad5-4ede-a5e4-90222c77b6c2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:42.293322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 51/106] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:02:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:42.294150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566925b-dad5-4ede-a5e4-90222c77b6c2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:42.324051 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94dc11-a411-4504-bb45-69e05ef679b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:42.324951 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94dc11-a411-4504-bb45-69e05ef679b2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:42.325243 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94dc11-a411-4504-bb45-69e05ef679b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:42.325575 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94dc11-a411-4504-bb45-69e05ef679b2 None admin] PATH_INFO: `/v3/users/256d3144a0c248bba9dbdf2b55f53199` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:42.341050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94dc11-a411-4504-bb45-69e05ef679b2 None admin] RBAC: Authorizing `identity:get_user(user_id=256d3144a0c248bba9dbdf2b55f53199)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:42.345349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94dc11-a411-4504-bb45-69e05ef679b2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:42.345349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 56/107] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:42 2022] GET /identity/v3/users/256d3144a0c248bba9dbdf2b55f53199 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:42.346087 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94dc11-a411-4504-bb45-69e05ef679b2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:42.384003 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:42.419894 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:42.464473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94dc11-a411-4504-bb45-69e05ef679b2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:42.505823 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532758-321a-49c0-a4f5-df936e2737b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:42.506633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532758-321a-49c0-a4f5-df936e2737b4 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:42.507021 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532758-321a-49c0-a4f5-df936e2737b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:42.507304 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532758-321a-49c0-a4f5-df936e2737b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:42.508011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e532758-321a-49c0-a4f5-df936e2737b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:42.509574 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e532758-321a-49c0-a4f5-df936e2737b4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:42.525794 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566925b-dad5-4ede-a5e4-90222c77b6c2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:42.538259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 57/108] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 16 16:02:42 2022] POST /identity/v3/projects => generated 302 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:02:42.542899 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532758-321a-49c0-a4f5-df936e2737b4 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:42.564806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c5f3f-6364-45a6-ba7f-618e5ef74546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:42.565641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c5f3f-6364-45a6-ba7f-618e5ef74546 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:42.565930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c5f3f-6364-45a6-ba7f-618e5ef74546 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:42.566214 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c5f3f-6364-45a6-ba7f-618e5ef74546 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:42.579573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c5f3f-6364-45a6-ba7f-618e5ef74546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-744c5f3f-6364-45a6-ba7f-618e5ef74546 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:42.587437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:42.588298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:42.589511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:42.589511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:42.589511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:42.589511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:42.589511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:42.589511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:42.589511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:42.589511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:42.589511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:42.589511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:42.589511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:02:42.589511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:02:42.589511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 52/109] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:42.590158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44287adb-138a-40b0-9d72-541529d34cb7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:42.590482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44287adb-138a-40b0-9d72-541529d34cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:42.594823 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44287adb-138a-40b0-9d72-541529d34cb7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:42.596682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 53/110] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:42.603272 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44287adb-138a-40b0-9d72-541529d34cb7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:42.739339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:42.762474 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:42.774638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532758-321a-49c0-a4f5-df936e2737b4 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:42.775509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44287adb-138a-40b0-9d72-541529d34cb7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:42.822125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea4b35-39b6-49cb-86de-939e6ebcfd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:42.823101 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea4b35-39b6-49cb-86de-939e6ebcfd28 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:42.823617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea4b35-39b6-49cb-86de-939e6ebcfd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:42.824103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea4b35-39b6-49cb-86de-939e6ebcfd28 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:42.825165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea4b35-39b6-49cb-86de-939e6ebcfd28 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:42.825684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea4b35-39b6-49cb-86de-939e6ebcfd28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:42.828130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea4b35-39b6-49cb-86de-939e6ebcfd28 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:42.832990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ca321-3202-46ea-bebc-02a3f184987d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:42.833974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ca321-3202-46ea-bebc-02a3f184987d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:42.834534 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ca321-3202-46ea-bebc-02a3f184987d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:42.835002 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ca321-3202-46ea-bebc-02a3f184987d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:42.838751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 54/111] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:02:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:42.844173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517ac9b-ab8e-43ff-a294-c353d26d900d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:42.844173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517ac9b-ab8e-43ff-a294-c353d26d900d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:42.844173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517ac9b-ab8e-43ff-a294-c353d26d900d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:42.866895 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1517ac9b-ab8e-43ff-a294-c353d26d900d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:42.868457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1517ac9b-ab8e-43ff-a294-c353d26d900d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:42.929284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ca321-3202-46ea-bebc-02a3f184987d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:42.931244 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ca321-3202-46ea-bebc-02a3f184987d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:42.954082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 55/112] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:42.955425 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517ac9b-ab8e-43ff-a294-c353d26d900d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:43.041118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:43.059614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 58/113] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:02:43.060529 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ca321-3202-46ea-bebc-02a3f184987d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:43.073284 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:43.087970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517ac9b-ab8e-43ff-a294-c353d26d900d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:43.127489 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26de7d-9044-4050-96b5-f95411282638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:43.128751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26de7d-9044-4050-96b5-f95411282638 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:43.129269 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26de7d-9044-4050-96b5-f95411282638 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:43.129748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26de7d-9044-4050-96b5-f95411282638 None admin] PATH_INFO: `/v3/users/39c09083dd8a4c6dadfc555929d428f4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:43.131206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26de7d-9044-4050-96b5-f95411282638 None admin] RBAC: Authorizing `identity:get_user(user_id=39c09083dd8a4c6dadfc555929d428f4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:43.132890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26de7d-9044-4050-96b5-f95411282638 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:43.135115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 56/114] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:42 2022] GET /identity/v3/users/39c09083dd8a4c6dadfc555929d428f4 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:43.136086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26de7d-9044-4050-96b5-f95411282638 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:43.254857 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26de7d-9044-4050-96b5-f95411282638 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:43.264641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ca321-3202-46ea-bebc-02a3f184987d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:43.293694 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a10f0b-c415-48ce-be74-707425462e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:43.294951 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a10f0b-c415-48ce-be74-707425462e35 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:43.295503 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a10f0b-c415-48ce-be74-707425462e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:43.295999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a10f0b-c415-48ce-be74-707425462e35 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:43.298181 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a10f0b-c415-48ce-be74-707425462e35 None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:43.299889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a10f0b-c415-48ce-be74-707425462e35 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:43.302160 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 57/115] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:43 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:43.303235 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a10f0b-c415-48ce-be74-707425462e35 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:43.334602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:43.347258 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a70bb-1175-459f-89e3-b89ccbc1acea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:43.348150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a70bb-1175-459f-89e3-b89ccbc1acea None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:43.348441 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a70bb-1175-459f-89e3-b89ccbc1acea None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:43.348725 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a70bb-1175-459f-89e3-b89ccbc1acea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:43.376551 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a70bb-1175-459f-89e3-b89ccbc1acea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-9c2a70bb-1175-459f-89e3-b89ccbc1acea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:43.393660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:43.394636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:43.395506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:43.395506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:43.395506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:43.395506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:43.395506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:43.395506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:43.395506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:43.395506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:43.395506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:43.395506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:43.395506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:43.395506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:02:43.395506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 59/116] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:02:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:43.396150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a70bb-1175-459f-89e3-b89ccbc1acea None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:43.458173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a10f0b-c415-48ce-be74-707425462e35 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:43.498971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e997b4-e0a5-4966-acad-62b4c2c4d0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:43.500885 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e997b4-e0a5-4966-acad-62b4c2c4d0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:43.501443 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e997b4-e0a5-4966-acad-62b4c2c4d0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:43.501921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e997b4-e0a5-4966-acad-62b4c2c4d0e3 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:43.503415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e997b4-e0a5-4966-acad-62b4c2c4d0e3 None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:43.505088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e997b4-e0a5-4966-acad-62b4c2c4d0e3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:43.506854 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:43.507612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 58/117] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:43 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:43.508593 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e997b4-e0a5-4966-acad-62b4c2c4d0e3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:43.578965 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a70bb-1175-459f-89e3-b89ccbc1acea None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:43.618696 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:43.620634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60b6d2-9bc9-42e1-a0a3-81148921fff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:43.622539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60b6d2-9bc9-42e1-a0a3-81148921fff4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:43.623050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60b6d2-9bc9-42e1-a0a3-81148921fff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:43.623550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60b6d2-9bc9-42e1-a0a3-81148921fff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:43.625149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60b6d2-9bc9-42e1-a0a3-81148921fff4 None admin] RBAC: Adding query filter params (role.id=f7aa69fd565d4a948224949d5ce35c0b, scope.project.id=815bcedbe8ea4401944309ac6a34f4d0, user.id=256d3144a0c248bba9dbdf2b55f53199) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:43.625804 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60b6d2-9bc9-42e1-a0a3-81148921fff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:43.627472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60b6d2-9bc9-42e1-a0a3-81148921fff4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:43.628569 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e997b4-e0a5-4966-acad-62b4c2c4d0e3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:43.634013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 60/118] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:02:43 2022] GET /identity/v3/role_assignments?user.id=256d3144a0c248bba9dbdf2b55f53199&scope.project.id=815bcedbe8ea4401944309ac6a34f4d0&role.id=f7aa69fd565d4a948224949d5ce35c0b => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:43.637433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60b6d2-9bc9-42e1-a0a3-81148921fff4 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:43.677496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82095e51-933e-49e6-ba7e-029084959b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:43.678610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82095e51-933e-49e6-ba7e-029084959b69 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:43.679995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82095e51-933e-49e6-ba7e-029084959b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:43.680362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82095e51-933e-49e6-ba7e-029084959b69 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:43.681323 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82095e51-933e-49e6-ba7e-029084959b69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:43.681705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82095e51-933e-49e6-ba7e-029084959b69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:43.683271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82095e51-933e-49e6-ba7e-029084959b69 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:43.700236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 59/119] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:43.701834 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245e7b5-66d5-47cf-918e-60599c4443ba None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:43.702134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245e7b5-66d5-47cf-918e-60599c4443ba None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:43.702527 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245e7b5-66d5-47cf-918e-60599c4443ba None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:43.705030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 60/120] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:43.706450 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d3f2e-e123-4068-9359-99410c38b87a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:43.706754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d3f2e-e123-4068-9359-99410c38b87a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:43.707041 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d3f2e-e123-4068-9359-99410c38b87a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:43.708764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 61/121] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:43.709570 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d3f2e-e123-4068-9359-99410c38b87a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:43.769010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60b6d2-9bc9-42e1-a0a3-81148921fff4 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:43.779637 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:43.814918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbc45c-4282-4c9a-b6dc-59c947d32a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:43.815842 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbc45c-4282-4c9a-b6dc-59c947d32a9f None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:43.816139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbc45c-4282-4c9a-b6dc-59c947d32a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:43.816428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbc45c-4282-4c9a-b6dc-59c947d32a9f None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0/users/39c09083dd8a4c6dadfc555929d428f4/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:43.818535 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fbc45c-4282-4c9a-b6dc-59c947d32a9f None admin] RBAC: Authorizing `identity:create_grant(project_id=815bcedbe8ea4401944309ac6a34f4d0, user_id=39c09083dd8a4c6dadfc555929d428f4, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:43.820138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fbc45c-4282-4c9a-b6dc-59c947d32a9f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:43.837039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d3f2e-e123-4068-9359-99410c38b87a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:43.837312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 61/122] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:02:43 2022] PUT /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0/users/39c09083dd8a4c6dadfc555929d428f4/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:02:43.842823 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bb337-2918-4b57-b398-4e75ffb9e80c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:43.844191 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bb337-2918-4b57-b398-4e75ffb9e80c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:43.844545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bb337-2918-4b57-b398-4e75ffb9e80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:43.884798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-357bb337-2918-4b57-b398-4e75ffb9e80c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:43.886055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-357bb337-2918-4b57-b398-4e75ffb9e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:43.920123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799f721-b571-4a46-b5ab-2cb89fd0b06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:43.921030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799f721-b571-4a46-b5ab-2cb89fd0b06a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:43.922090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799f721-b571-4a46-b5ab-2cb89fd0b06a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:43.922090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799f721-b571-4a46-b5ab-2cb89fd0b06a None admin] PATH_INFO: `/v3/users/0da3a74593ae46b281650aa7e2026c77` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:43.925663 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799f721-b571-4a46-b5ab-2cb89fd0b06a None admin] RBAC: Authorizing `identity:get_user(user_id=0da3a74593ae46b281650aa7e2026c77)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:43.928583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799f721-b571-4a46-b5ab-2cb89fd0b06a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:43.933443 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 62/123] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:43 2022] GET /identity/v3/users/0da3a74593ae46b281650aa7e2026c77 => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:43.937195 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3f123-e160-46f5-a54b-b6d48a56160c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:43.937724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3f123-e160-46f5-a54b-b6d48a56160c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:43.938008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3f123-e160-46f5-a54b-b6d48a56160c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:43.979391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c8c3f123-e160-46f5-a54b-b6d48a56160c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:43.980685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c8c3f123-e160-46f5-a54b-b6d48a56160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:44.020568 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:44.040964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 62/124] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:44.041755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bb337-2918-4b57-b398-4e75ffb9e80c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:44.100271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 63/125] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:44.100958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3f123-e160-46f5-a54b-b6d48a56160c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:44.181000 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bb337-2918-4b57-b398-4e75ffb9e80c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:44.194811 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:44.227497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bac1c-11f2-4774-bc09-f154db98edb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:44.228392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bac1c-11f2-4774-bc09-f154db98edb3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:44.228688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bac1c-11f2-4774-bc09-f154db98edb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:44.228976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bac1c-11f2-4774-bc09-f154db98edb3 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:44.231742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bac1c-11f2-4774-bc09-f154db98edb3 None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:44.233246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bac1c-11f2-4774-bc09-f154db98edb3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:44.235970 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 63/126] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:44 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:44.240982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bac1c-11f2-4774-bc09-f154db98edb3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:44.246031 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3f123-e160-46f5-a54b-b6d48a56160c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:44.347277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ef29d-4214-4740-8aea-0c10fe9ced02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:44.348121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ef29d-4214-4740-8aea-0c10fe9ced02 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:44.348399 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ef29d-4214-4740-8aea-0c10fe9ced02 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:44.348670 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ef29d-4214-4740-8aea-0c10fe9ced02 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:44.381618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ef29d-4214-4740-8aea-0c10fe9ced02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f39ef29d-4214-4740-8aea-0c10fe9ced02 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:44.396566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:44.397427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:44.398206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:44.398206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:44.398206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:44.398206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:44.398206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:44.398206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:44.398206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:44.398206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:44.398206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:44.398206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:44.398206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:02:44.398206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:02:44.398206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 64/127] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:02:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:44.403561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bac1c-11f2-4774-bc09-f154db98edb3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:44.404882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ef29d-4214-4740-8aea-0c10fe9ced02 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:44.442803 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:44.472633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7e131-f3c8-490a-b560-bd2da063eb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:44.475147 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7e131-f3c8-490a-b560-bd2da063eb5c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:44.475440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7e131-f3c8-490a-b560-bd2da063eb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:44.475723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7e131-f3c8-490a-b560-bd2da063eb5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:44.498184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7e131-f3c8-490a-b560-bd2da063eb5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-e9c7e131-f3c8-490a-b560-bd2da063eb5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:44.507375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:44.508253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:44.509026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:44.509026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:44.509026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:44.509026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:44.509026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:44.509026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:44.509026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:44.509026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:44.509026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:44.509026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:44.509026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:02:44.509026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:02:44.515808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 64/128] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:44.522498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7e131-f3c8-490a-b560-bd2da063eb5c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:44.582814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:44.615159 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ef29d-4214-4740-8aea-0c10fe9ced02 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:44.685917 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44c493-b9b0-4382-a304-ffe172535463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:44.686886 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44c493-b9b0-4382-a304-ffe172535463 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:44.687311 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44c493-b9b0-4382-a304-ffe172535463 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:44.687774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44c493-b9b0-4382-a304-ffe172535463 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0/users/0da3a74593ae46b281650aa7e2026c77/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:44.691616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44c493-b9b0-4382-a304-ffe172535463 None admin] RBAC: Authorizing `identity:create_grant(project_id=815bcedbe8ea4401944309ac6a34f4d0, user_id=0da3a74593ae46b281650aa7e2026c77, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:44.693116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44c493-b9b0-4382-a304-ffe172535463 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:44.716408 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 65/129] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:02:44 2022] PUT /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0/users/0da3a74593ae46b281650aa7e2026c77/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:02:44.720518 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44c493-b9b0-4382-a304-ffe172535463 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:44.726102 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7e131-f3c8-490a-b560-bd2da063eb5c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:44.798656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab71f6e-4c74-4840-8b8e-d43a9bfb9535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:44.799357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab71f6e-4c74-4840-8b8e-d43a9bfb9535 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:44.799650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab71f6e-4c74-4840-8b8e-d43a9bfb9535 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:44.799934 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab71f6e-4c74-4840-8b8e-d43a9bfb9535 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:44.800720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab71f6e-4c74-4840-8b8e-d43a9bfb9535 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:44.801039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab71f6e-4c74-4840-8b8e-d43a9bfb9535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:44.802514 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab71f6e-4c74-4840-8b8e-d43a9bfb9535 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:44.821187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 65/130] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:02:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:44.828565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab71f6e-4c74-4840-8b8e-d43a9bfb9535 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:44.898837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:44.914494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44c493-b9b0-4382-a304-ffe172535463 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:44.937626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:44.967679 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab71f6e-4c74-4840-8b8e-d43a9bfb9535 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:44.991626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c70f6d-1485-498e-977c-344117c4a208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:44.992335 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c70f6d-1485-498e-977c-344117c4a208 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:44.992623 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c70f6d-1485-498e-977c-344117c4a208 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:44.992901 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c70f6d-1485-498e-977c-344117c4a208 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:44.993680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c70f6d-1485-498e-977c-344117c4a208 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:44.993998 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c70f6d-1485-498e-977c-344117c4a208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:44.995451 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c70f6d-1485-498e-977c-344117c4a208 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:45.018719 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 66/131] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:02:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:45.035545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c70f6d-1485-498e-977c-344117c4a208 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:45.064208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f99ce-b4fd-4ceb-a63d-5af5480d0475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:45.065117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f99ce-b4fd-4ceb-a63d-5af5480d0475 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:45.065447 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f99ce-b4fd-4ceb-a63d-5af5480d0475 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:45.065808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f99ce-b4fd-4ceb-a63d-5af5480d0475 None admin] PATH_INFO: `/v3/users/39c09083dd8a4c6dadfc555929d428f4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:45.071504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f99ce-b4fd-4ceb-a63d-5af5480d0475 None admin] RBAC: Authorizing `identity:get_user(user_id=39c09083dd8a4c6dadfc555929d428f4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:45.073008 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f99ce-b4fd-4ceb-a63d-5af5480d0475 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:45.075041 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 66/132] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:44 2022] GET /identity/v3/users/39c09083dd8a4c6dadfc555929d428f4 => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:45.083459 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f99ce-b4fd-4ceb-a63d-5af5480d0475 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:45.157492 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c70f6d-1485-498e-977c-344117c4a208 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:45.192604 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706673b-e6a8-4a33-9f0f-69a9dafb5a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:45.193415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706673b-e6a8-4a33-9f0f-69a9dafb5a55 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:45.193702 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706673b-e6a8-4a33-9f0f-69a9dafb5a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:45.193983 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706673b-e6a8-4a33-9f0f-69a9dafb5a55 None admin] PATH_INFO: `/v3/users/39c09083dd8a4c6dadfc555929d428f4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:45.195228 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706673b-e6a8-4a33-9f0f-69a9dafb5a55 None admin] RBAC: Authorizing `identity:get_user(user_id=39c09083dd8a4c6dadfc555929d428f4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:45.196942 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706673b-e6a8-4a33-9f0f-69a9dafb5a55 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:45.199009 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 67/133] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:45 2022] GET /identity/v3/users/39c09083dd8a4c6dadfc555929d428f4 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:45.205311 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706673b-e6a8-4a33-9f0f-69a9dafb5a55 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:45.210743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:45.318365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f99ce-b4fd-4ceb-a63d-5af5480d0475 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:45.389963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77733ebe-345e-46d0-84ba-39d4d619bb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:45.391578 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77733ebe-345e-46d0-84ba-39d4d619bb0e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:45.391868 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77733ebe-345e-46d0-84ba-39d4d619bb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:45.392149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77733ebe-345e-46d0-84ba-39d4d619bb0e None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:45.393374 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77733ebe-345e-46d0-84ba-39d4d619bb0e None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:45.394875 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77733ebe-345e-46d0-84ba-39d4d619bb0e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:45.397465 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 67/134] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:45 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:45.403402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77733ebe-345e-46d0-84ba-39d4d619bb0e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:45.445033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706673b-e6a8-4a33-9f0f-69a9dafb5a55 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:45.457508 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:45.532204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d0b0c-7938-487b-a221-69deee89e12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:45.533532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d0b0c-7938-487b-a221-69deee89e12e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:45.534049 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d0b0c-7938-487b-a221-69deee89e12e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:45.534566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d0b0c-7938-487b-a221-69deee89e12e None admin] PATH_INFO: `/v3/projects/62c8c65a44a5466589117da7cf272ffe` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:45.536066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d0b0c-7938-487b-a221-69deee89e12e None admin] RBAC: Authorizing `identity:get_project(project_id=62c8c65a44a5466589117da7cf272ffe)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:45.537751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d0b0c-7938-487b-a221-69deee89e12e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:45.539758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 68/135] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:45 2022] GET /identity/v3/projects/62c8c65a44a5466589117da7cf272ffe => generated 312 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:45.547325 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d0b0c-7938-487b-a221-69deee89e12e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:45.582764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77733ebe-345e-46d0-84ba-39d4d619bb0e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:45.655195 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a4cc1-221b-4ef4-b48a-777505d666d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:45.656713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a4cc1-221b-4ef4-b48a-777505d666d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:45.657032 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a4cc1-221b-4ef4-b48a-777505d666d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:45.657383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a4cc1-221b-4ef4-b48a-777505d666d7 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0/users/39c09083dd8a4c6dadfc555929d428f4/roles/255c2b4827324109a6d2068c8b0316c3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:45.659711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:45.663250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a4cc1-221b-4ef4-b48a-777505d666d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=815bcedbe8ea4401944309ac6a34f4d0, user_id=39c09083dd8a4c6dadfc555929d428f4, role_id=255c2b4827324109a6d2068c8b0316c3)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:45.664779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a4cc1-221b-4ef4-b48a-777505d666d7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:45.688329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 68/136] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:02:45 2022] PUT /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0/users/39c09083dd8a4c6dadfc555929d428f4/roles/255c2b4827324109a6d2068c8b0316c3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:02:45.689761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086451c-53f0-4371-8bc6-f6e43391df87 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:45.690067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086451c-53f0-4371-8bc6-f6e43391df87 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:45.690353 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086451c-53f0-4371-8bc6-f6e43391df87 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:45.691958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 69/137] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:45.693280 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d0b0c-7938-487b-a221-69deee89e12e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:45.698626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407478ae-c686-44f1-89d4-6e92ab3fa33c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:45.698897 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407478ae-c686-44f1-89d4-6e92ab3fa33c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:45.699127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407478ae-c686-44f1-89d4-6e92ab3fa33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:45.733156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6ee0a-b069-42d6-9832-abfa18a9f8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:45.734812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6ee0a-b069-42d6-9832-abfa18a9f8a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:45.735110 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6ee0a-b069-42d6-9832-abfa18a9f8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:45.735488 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6ee0a-b069-42d6-9832-abfa18a9f8a2 None admin] PATH_INFO: `/v3/projects/62c8c65a44a5466589117da7cf272ffe/users/39c09083dd8a4c6dadfc555929d428f4/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:45.737527 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6ee0a-b069-42d6-9832-abfa18a9f8a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=62c8c65a44a5466589117da7cf272ffe, user_id=39c09083dd8a4c6dadfc555929d428f4, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:45.739234 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6ee0a-b069-42d6-9832-abfa18a9f8a2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:45.739622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-407478ae-c686-44f1-89d4-6e92ab3fa33c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:45.740888 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-407478ae-c686-44f1-89d4-6e92ab3fa33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:45.755701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 69/138] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:02:45 2022] PUT /identity/v3/projects/62c8c65a44a5466589117da7cf272ffe/users/39c09083dd8a4c6dadfc555929d428f4/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:02:45.881019 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 70/139] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:45.924940 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6ee0a-b069-42d6-9832-abfa18a9f8a2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:46.064431 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6ee0a-b069-42d6-9832-abfa18a9f8a2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:46.096205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:46.103890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b552a00-0bf9-4ccf-a5fb-e0e64fb7d057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:46.104706 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b552a00-0bf9-4ccf-a5fb-e0e64fb7d057 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:46.104990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b552a00-0bf9-4ccf-a5fb-e0e64fb7d057 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:46.105269 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b552a00-0bf9-4ccf-a5fb-e0e64fb7d057 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:46.106466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b552a00-0bf9-4ccf-a5fb-e0e64fb7d057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:46.107974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b552a00-0bf9-4ccf-a5fb-e0e64fb7d057 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:46.110620 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 70/140] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:02:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:46.118176 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407478ae-c686-44f1-89d4-6e92ab3fa33c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:46.143855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:46.279243 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407478ae-c686-44f1-89d4-6e92ab3fa33c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:46.335856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f570f9-023b-4bee-88df-ab6f11d74775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:46.336480 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f570f9-023b-4bee-88df-ab6f11d74775 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:46.336772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f570f9-023b-4bee-88df-ab6f11d74775 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:46.337060 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f570f9-023b-4bee-88df-ab6f11d74775 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:46.337796 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f570f9-023b-4bee-88df-ab6f11d74775 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:46.339287 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f570f9-023b-4bee-88df-ab6f11d74775 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:46.388628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 71/141] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:02:46 2022] POST /identity/v3/users => generated 283 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:02:46.548549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41e4b7-ed2e-4007-9f62-27a49c186f48 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:46.548872 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41e4b7-ed2e-4007-9f62-27a49c186f48 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:46.549131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41e4b7-ed2e-4007-9f62-27a49c186f48 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:46.550658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 71/142] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:46.566354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e694cbf-ded0-4cc7-b2f8-7883c3c04fa1 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:46.566927 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e694cbf-ded0-4cc7-b2f8-7883c3c04fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:46.567003 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e694cbf-ded0-4cc7-b2f8-7883c3c04fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:46.591696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6e694cbf-ded0-4cc7-b2f8-7883c3c04fa1 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:46.592448 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f40b9-3920-4cd5-9600-42de00a70bdd None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:46.592735 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f40b9-3920-4cd5-9600-42de00a70bdd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:46.592845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6e694cbf-ded0-4cc7-b2f8-7883c3c04fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:46.593003 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f40b9-3920-4cd5-9600-42de00a70bdd None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:46.595803 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 72/143] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:02:46.601592 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22729b0-d0f2-4642-9378-7478fb081b26 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:46.601882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22729b0-d0f2-4642-9378-7478fb081b26 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:46.602167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22729b0-d0f2-4642-9378-7478fb081b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:46.626420 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d22729b0-d0f2-4642-9378-7478fb081b26 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:46.627655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d22729b0-d0f2-4642-9378-7478fb081b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:46.713377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:46.726870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 72/144] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:46.755125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 73/145] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:02:46.778301 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e694cbf-ded0-4cc7-b2f8-7883c3c04fa1 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:46.787548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22729b0-d0f2-4642-9378-7478fb081b26 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:46.897795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e694cbf-ded0-4cc7-b2f8-7883c3c04fa1 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:46.942917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3b524-4192-44b9-823c-d8667fc3fcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:46.943737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3b524-4192-44b9-823c-d8667fc3fcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:46.944022 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3b524-4192-44b9-823c-d8667fc3fcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:46.944301 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3b524-4192-44b9-823c-d8667fc3fcf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:46.964463 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3b524-4192-44b9-823c-d8667fc3fcf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-7fa3b524-4192-44b9-823c-d8667fc3fcf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:46.972625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:46.973521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:46.974357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:46.974357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:46.974357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:46.974357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:46.974357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:46.974357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:46.974357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:46.974357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:46.974357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:46.974357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:46.974357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:02:46.974357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:02:46.974357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 73/146] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:46.982132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22729b0-d0f2-4642-9378-7478fb081b26 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:46.985930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3b524-4192-44b9-823c-d8667fc3fcf3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:47.040737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:47.057413 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6f125-61ba-442e-bb78-be1faf02e226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:47.058271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6f125-61ba-442e-bb78-be1faf02e226 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:47.062785 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6f125-61ba-442e-bb78-be1faf02e226 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:47.062785 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6f125-61ba-442e-bb78-be1faf02e226 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:47.081891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6f125-61ba-442e-bb78-be1faf02e226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-02a6f125-61ba-442e-bb78-be1faf02e226 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:47.090545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:47.091426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:47.092654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:47.092654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:47.092654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:47.092654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:47.092654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:47.092654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:47.092654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:47.092654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:47.092654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:47.092654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:47.092654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:02:47.092654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:02:47.092654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 74/147] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:47.099775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6f125-61ba-442e-bb78-be1faf02e226 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:47.126811 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:47.189353 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3b524-4192-44b9-823c-d8667fc3fcf3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:47.240957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759581e-2211-4c76-a073-11684a827087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:47.242017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759581e-2211-4c76-a073-11684a827087 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:47.242945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759581e-2211-4c76-a073-11684a827087 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:47.243446 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759581e-2211-4c76-a073-11684a827087 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:47.248882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759581e-2211-4c76-a073-11684a827087 None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:47.249573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759581e-2211-4c76-a073-11684a827087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:47.251274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759581e-2211-4c76-a073-11684a827087 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:47.266819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 74/148] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:02:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:47.282739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6f125-61ba-442e-bb78-be1faf02e226 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:47.292555 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759581e-2211-4c76-a073-11684a827087 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:47.318313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff2d00-363c-49ae-a76c-6009eef0b546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:47.319039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff2d00-363c-49ae-a76c-6009eef0b546 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:47.319325 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff2d00-363c-49ae-a76c-6009eef0b546 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:47.319603 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff2d00-363c-49ae-a76c-6009eef0b546 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:47.320368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff2d00-363c-49ae-a76c-6009eef0b546 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:47.320675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff2d00-363c-49ae-a76c-6009eef0b546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:47.322463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff2d00-363c-49ae-a76c-6009eef0b546 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:47.333729 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 75/149] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:02:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:47.339115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff2d00-363c-49ae-a76c-6009eef0b546 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:47.401904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:47.454834 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff2d00-363c-49ae-a76c-6009eef0b546 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:47.492325 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f4bc6-b42f-4a85-a219-572ad6c94125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:47.493445 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f4bc6-b42f-4a85-a219-572ad6c94125 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:47.493856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f4bc6-b42f-4a85-a219-572ad6c94125 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:47.494269 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f4bc6-b42f-4a85-a219-572ad6c94125 None admin] PATH_INFO: `/v3/users/256d3144a0c248bba9dbdf2b55f53199` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:47.495673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f4bc6-b42f-4a85-a219-572ad6c94125 None admin] RBAC: Authorizing `identity:get_user(user_id=256d3144a0c248bba9dbdf2b55f53199)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:47.497305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f4bc6-b42f-4a85-a219-572ad6c94125 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:47.499208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 76/150] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:47 2022] GET /identity/v3/users/256d3144a0c248bba9dbdf2b55f53199 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:47.510490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f4bc6-b42f-4a85-a219-572ad6c94125 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:47.537315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759581e-2211-4c76-a073-11684a827087 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:47.600439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:47.630417 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f4bc6-b42f-4a85-a219-572ad6c94125 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:47.643716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0e193-9826-49f3-aa0f-4fb0420cf463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:47.644992 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0e193-9826-49f3-aa0f-4fb0420cf463 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:47.645480 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0e193-9826-49f3-aa0f-4fb0420cf463 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:47.645952 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0e193-9826-49f3-aa0f-4fb0420cf463 None admin] PATH_INFO: `/v3/users/39c09083dd8a4c6dadfc555929d428f4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:47.651217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0e193-9826-49f3-aa0f-4fb0420cf463 None admin] RBAC: Authorizing `identity:get_user(user_id=39c09083dd8a4c6dadfc555929d428f4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:47.652987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0e193-9826-49f3-aa0f-4fb0420cf463 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:47.654516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:47.655220 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 75/151] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:47 2022] GET /identity/v3/users/39c09083dd8a4c6dadfc555929d428f4 => generated 275 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:47.668102 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0e193-9826-49f3-aa0f-4fb0420cf463 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:47.675069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e9bf5-98b6-45e1-852c-d2f4ae44c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:47.676184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e9bf5-98b6-45e1-852c-d2f4ae44c063 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:47.676608 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e9bf5-98b6-45e1-852c-d2f4ae44c063 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:47.677110 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e9bf5-98b6-45e1-852c-d2f4ae44c063 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:47.678765 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e9bf5-98b6-45e1-852c-d2f4ae44c063 None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:47.680502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e9bf5-98b6-45e1-852c-d2f4ae44c063 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:47.682788 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 77/152] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:47 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:47.693798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e9bf5-98b6-45e1-852c-d2f4ae44c063 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:47.838953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e9bf5-98b6-45e1-852c-d2f4ae44c063 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:47.877301 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0e193-9826-49f3-aa0f-4fb0420cf463 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:47.888421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a13d4-d51a-459d-8c18-dcd130f277e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:47.889616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a13d4-d51a-459d-8c18-dcd130f277e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:47.890684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a13d4-d51a-459d-8c18-dcd130f277e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:47.894070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a13d4-d51a-459d-8c18-dcd130f277e5 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0/users/256d3144a0c248bba9dbdf2b55f53199/roles/f7aa69fd565d4a948224949d5ce35c0b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:47.896522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a13d4-d51a-459d-8c18-dcd130f277e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=815bcedbe8ea4401944309ac6a34f4d0, user_id=256d3144a0c248bba9dbdf2b55f53199, role_id=f7aa69fd565d4a948224949d5ce35c0b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:47.898490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a13d4-d51a-459d-8c18-dcd130f277e5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:47.915881 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 78/153] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:02:47 2022] PUT /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0/users/256d3144a0c248bba9dbdf2b55f53199/roles/f7aa69fd565d4a948224949d5ce35c0b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:02:47.920032 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802cb81-055a-4122-a89e-d6aa41c222b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:47.921005 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802cb81-055a-4122-a89e-d6aa41c222b9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:47.921521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802cb81-055a-4122-a89e-d6aa41c222b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:47.922126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802cb81-055a-4122-a89e-d6aa41c222b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:48.004304 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:48.017025 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802cb81-055a-4122-a89e-d6aa41c222b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:48.019201 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802cb81-055a-4122-a89e-d6aa41c222b9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:48.145422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 76/154] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:02:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:02:48.151594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a13d4-d51a-459d-8c18-dcd130f277e5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:48.211689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:48.276680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a13d4-d51a-459d-8c18-dcd130f277e5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:48.312762 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf238810-d5ec-44d4-815c-f3119342faf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:48.313693 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf238810-d5ec-44d4-815c-f3119342faf4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:48.313970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf238810-d5ec-44d4-815c-f3119342faf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:48.314242 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf238810-d5ec-44d4-815c-f3119342faf4 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:48.315514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf238810-d5ec-44d4-815c-f3119342faf4 None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:48.316970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf238810-d5ec-44d4-815c-f3119342faf4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:48.319223 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 79/155] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:48 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:48.325385 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802cb81-055a-4122-a89e-d6aa41c222b9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:48.462402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:48.472744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802cb81-055a-4122-a89e-d6aa41c222b9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:48.518547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977a28a-fb72-4312-8690-a41c4e79e41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:48.519224 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977a28a-fb72-4312-8690-a41c4e79e41e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:48.519511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977a28a-fb72-4312-8690-a41c4e79e41e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:48.519792 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977a28a-fb72-4312-8690-a41c4e79e41e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:48.520624 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977a28a-fb72-4312-8690-a41c4e79e41e None admin] RBAC: Adding query filter params (role.id=2c5988d189bd4b4482fb3649b9cf1de4, scope.project.id=815bcedbe8ea4401944309ac6a34f4d0, user.id=39c09083dd8a4c6dadfc555929d428f4) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:48.520937 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977a28a-fb72-4312-8690-a41c4e79e41e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:48.522397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977a28a-fb72-4312-8690-a41c4e79e41e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:48.531904 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 77/156] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:02:48 2022] GET /identity/v3/role_assignments?user.id=39c09083dd8a4c6dadfc555929d428f4&scope.project.id=815bcedbe8ea4401944309ac6a34f4d0&role.id=2c5988d189bd4b4482fb3649b9cf1de4 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:48.785161 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9916fe-1283-4875-9962-0e0f19ff867b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:48.785507 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9916fe-1283-4875-9962-0e0f19ff867b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:48.785764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9916fe-1283-4875-9962-0e0f19ff867b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:48.787135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 80/157] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:48.793629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e12ae2-a92b-4265-b116-c5b3ebf9f3d7 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:48.794108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e12ae2-a92b-4265-b116-c5b3ebf9f3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:48.794184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e12ae2-a92b-4265-b116-c5b3ebf9f3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:48.837525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-50e12ae2-a92b-4265-b116-c5b3ebf9f3d7 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:48.838782 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-50e12ae2-a92b-4265-b116-c5b3ebf9f3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:48.929575 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 78/158] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 16 16:02:48.965477 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9916fe-1283-4875-9962-0e0f19ff867b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:49.093466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9916fe-1283-4875-9962-0e0f19ff867b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:49.116756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:49.149313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85b5a0-7c9c-42fc-ae12-cccf8fd57969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:49.150131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b5a0-7c9c-42fc-ae12-cccf8fd57969 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:49.150417 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b5a0-7c9c-42fc-ae12-cccf8fd57969 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:49.154896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b5a0-7c9c-42fc-ae12-cccf8fd57969 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:49.167526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85b5a0-7c9c-42fc-ae12-cccf8fd57969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4f85b5a0-7c9c-42fc-ae12-cccf8fd57969 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:49.176692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:49.177600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:49.178390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:49.178390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:49.178390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:49.178390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:49.178390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:49.178390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:49.178390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:49.178390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:49.178390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:49.178390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:49.178390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:49.178390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:02:49.178390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 81/159] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:02:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:49.183919 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e12ae2-a92b-4265-b116-c5b3ebf9f3d7 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:49.284321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:49.302477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e12ae2-a92b-4265-b116-c5b3ebf9f3d7 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:49.341330 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab088d-211f-480d-a118-921f424b0f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:49.342017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab088d-211f-480d-a118-921f424b0f6a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:49.342300 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab088d-211f-480d-a118-921f424b0f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:49.342632 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab088d-211f-480d-a118-921f424b0f6a None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:49.343737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab088d-211f-480d-a118-921f424b0f6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:49.343999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab088d-211f-480d-a118-921f424b0f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:49.345483 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab088d-211f-480d-a118-921f424b0f6a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:49.358134 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 79/160] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:49.364335 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85b5a0-7c9c-42fc-ae12-cccf8fd57969 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:49.497489 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85b5a0-7c9c-42fc-ae12-cccf8fd57969 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:49.541191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13e588-7c7b-460a-9c0a-5e54551483ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:49.542067 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13e588-7c7b-460a-9c0a-5e54551483ad None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:49.542391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13e588-7c7b-460a-9c0a-5e54551483ad None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:49.542696 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13e588-7c7b-460a-9c0a-5e54551483ad None admin] PATH_INFO: `/v3/users/0da3a74593ae46b281650aa7e2026c77` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:49.543884 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13e588-7c7b-460a-9c0a-5e54551483ad None admin] RBAC: Authorizing `identity:get_user(user_id=0da3a74593ae46b281650aa7e2026c77)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:49.545346 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13e588-7c7b-460a-9c0a-5e54551483ad None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:49.547499 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 82/161] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:49 2022] GET /identity/v3/users/0da3a74593ae46b281650aa7e2026c77 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:49.552641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab088d-211f-480d-a118-921f424b0f6a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:49.709274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab088d-211f-480d-a118-921f424b0f6a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:49.724238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1acde5-a6d1-4c2f-8a1c-212c5850658f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:49.724543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1acde5-a6d1-4c2f-8a1c-212c5850658f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:49.724792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1acde5-a6d1-4c2f-8a1c-212c5850658f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:49.726179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 83/162] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:49.740456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82d22e-6cc1-431a-96e8-6318f72da537 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:49.740743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82d22e-6cc1-431a-96e8-6318f72da537 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:49.741020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82d22e-6cc1-431a-96e8-6318f72da537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:49.766786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-db82d22e-6cc1-431a-96e8-6318f72da537 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:49.768857 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-db82d22e-6cc1-431a-96e8-6318f72da537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:49.774758 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968995e-32de-4f57-8cde-5d8af4118b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:49.775480 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968995e-32de-4f57-8cde-5d8af4118b6a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:49.775764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968995e-32de-4f57-8cde-5d8af4118b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:49.776068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968995e-32de-4f57-8cde-5d8af4118b6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:49.807391 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:49.831239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:49.888572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 84/163] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:02:49.933951 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968995e-32de-4f57-8cde-5d8af4118b6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:49.935531 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968995e-32de-4f57-8cde-5d8af4118b6a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:49.943959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82d22e-6cc1-431a-96e8-6318f72da537 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:50.122730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82d22e-6cc1-431a-96e8-6318f72da537 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:50.180960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 80/164] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:02:50.182335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998649b-8c69-4fce-8bbf-502c1121f4a1 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:50.182827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998649b-8c69-4fce-8bbf-502c1121f4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:50.183246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998649b-8c69-4fce-8bbf-502c1121f4a1 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:50.184651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 81/165] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:50.188286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb1729-eeae-4945-a923-75da8feea036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:50.189622 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb1729-eeae-4945-a923-75da8feea036 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:50.189908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb1729-eeae-4945-a923-75da8feea036 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:50.190185 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb1729-eeae-4945-a923-75da8feea036 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:50.190399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998649b-8c69-4fce-8bbf-502c1121f4a1 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:50.207161 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb1729-eeae-4945-a923-75da8feea036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-1bbb1729-eeae-4945-a923-75da8feea036 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:50.228058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:50.229122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:50.230094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:50.230094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:50.230094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:50.230094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:50.230094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:50.230094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:50.230094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:50.230094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:50.230094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:50.230094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:50.230094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:02:50.230094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:02:50.232464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 85/166] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:02:50.234852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5bd94-1977-467b-a3f4-015fcb1d6195 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:50.235619 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5bd94-1977-467b-a3f4-015fcb1d6195 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:50.236056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5bd94-1977-467b-a3f4-015fcb1d6195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:50.269156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a9d5bd94-1977-467b-a3f4-015fcb1d6195 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:50.270628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a9d5bd94-1977-467b-a3f4-015fcb1d6195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:50.296751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:50.330039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:50.412862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 86/167] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:50.413728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5bd94-1977-467b-a3f4-015fcb1d6195 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:50.463118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998649b-8c69-4fce-8bbf-502c1121f4a1 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:50.555141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd74eb-29ed-46d6-a58d-e5409d081fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:50.556028 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd74eb-29ed-46d6-a58d-e5409d081fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:50.556315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd74eb-29ed-46d6-a58d-e5409d081fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:50.556595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd74eb-29ed-46d6-a58d-e5409d081fb2 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:50.557844 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd74eb-29ed-46d6-a58d-e5409d081fb2 None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:50.559412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd74eb-29ed-46d6-a58d-e5409d081fb2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:50.561662 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 82/168] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:50 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:50.563369 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd74eb-29ed-46d6-a58d-e5409d081fb2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:50.588618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5bd94-1977-467b-a3f4-015fcb1d6195 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:50.660009 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e971f-06cc-4bec-92a8-e2d76cd0005f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:50.661079 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e971f-06cc-4bec-92a8-e2d76cd0005f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:50.661583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e971f-06cc-4bec-92a8-e2d76cd0005f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:50.662053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e971f-06cc-4bec-92a8-e2d76cd0005f None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:50.663086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e971f-06cc-4bec-92a8-e2d76cd0005f None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:50.663635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e971f-06cc-4bec-92a8-e2d76cd0005f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:50.665213 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e971f-06cc-4bec-92a8-e2d76cd0005f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:50.688285 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 87/169] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:02:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:50.689450 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e971f-06cc-4bec-92a8-e2d76cd0005f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:50.746759 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd74eb-29ed-46d6-a58d-e5409d081fb2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:50.748722 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:50.774828 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:50.817611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d5838-1030-496d-8d44-70c4676b124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:50.818465 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d5838-1030-496d-8d44-70c4676b124e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:50.818758 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d5838-1030-496d-8d44-70c4676b124e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:50.819037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d5838-1030-496d-8d44-70c4676b124e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:50.839354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d5838-1030-496d-8d44-70c4676b124e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-b84d5838-1030-496d-8d44-70c4676b124e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:50.848163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:50.849089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:50.849953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:50.849953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:50.849953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:50.849953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:50.849953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:50.849953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:50.849953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:50.849953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:50.849953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:50.849953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:50.849953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:02:50.849953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:02:50.849953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 83/170] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:02:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:50.850626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d5838-1030-496d-8d44-70c4676b124e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:50.924757 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e971f-06cc-4bec-92a8-e2d76cd0005f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:50.990462 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81579cb-4361-4811-bcf8-ddbacb558a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:50.991146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81579cb-4361-4811-bcf8-ddbacb558a5f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:50.991441 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81579cb-4361-4811-bcf8-ddbacb558a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:50.991726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81579cb-4361-4811-bcf8-ddbacb558a5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:50.992577 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81579cb-4361-4811-bcf8-ddbacb558a5f None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=815bcedbe8ea4401944309ac6a34f4d0, user.id=0da3a74593ae46b281650aa7e2026c77) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:50.992888 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81579cb-4361-4811-bcf8-ddbacb558a5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:50.994332 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81579cb-4361-4811-bcf8-ddbacb558a5f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:51.000789 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d5838-1030-496d-8d44-70c4676b124e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:51.012535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 88/171] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:02:50 2022] GET /identity/v3/role_assignments?user.id=0da3a74593ae46b281650aa7e2026c77&scope.project.id=815bcedbe8ea4401944309ac6a34f4d0&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:51.013388 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81579cb-4361-4811-bcf8-ddbacb558a5f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:51.056859 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a44a00-d811-4ef4-b4a7-629c421bab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:51.057776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a44a00-d811-4ef4-b4a7-629c421bab04 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:51.058060 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a44a00-d811-4ef4-b4a7-629c421bab04 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:51.058342 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a44a00-d811-4ef4-b4a7-629c421bab04 None admin] PATH_INFO: `/v3/users/39c09083dd8a4c6dadfc555929d428f4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:51.060707 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a44a00-d811-4ef4-b4a7-629c421bab04 None admin] RBAC: Authorizing `identity:get_user(user_id=39c09083dd8a4c6dadfc555929d428f4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:51.062925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a44a00-d811-4ef4-b4a7-629c421bab04 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:51.064656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 84/172] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:50 2022] GET /identity/v3/users/39c09083dd8a4c6dadfc555929d428f4 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:51.065951 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb9a38-f072-426c-92dd-32671accb3ff None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:51.066239 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb9a38-f072-426c-92dd-32671accb3ff None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:51.070718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb9a38-f072-426c-92dd-32671accb3ff None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:51.072563 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 85/173] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:51.075483 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb9a38-f072-426c-92dd-32671accb3ff None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:51.191302 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:51.255164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:51.272388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb9a38-f072-426c-92dd-32671accb3ff None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:51.288145 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81579cb-4361-4811-bcf8-ddbacb558a5f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:51.309518 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aa9f0-6eee-4223-8eb4-4c41402cc3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:51.310183 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aa9f0-6eee-4223-8eb4-4c41402cc3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:51.310492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aa9f0-6eee-4223-8eb4-4c41402cc3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:51.310778 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aa9f0-6eee-4223-8eb4-4c41402cc3f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:51.380885 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3aae65-c036-4787-832b-c211bc7ecfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:51.381551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3aae65-c036-4787-832b-c211bc7ecfec None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:51.381833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3aae65-c036-4787-832b-c211bc7ecfec None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:51.382106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3aae65-c036-4787-832b-c211bc7ecfec None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:51.382910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3aae65-c036-4787-832b-c211bc7ecfec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:51.383215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3aae65-c036-4787-832b-c211bc7ecfec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:51.384616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3aae65-c036-4787-832b-c211bc7ecfec None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:51.385037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982aa9f0-6eee-4223-8eb4-4c41402cc3f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:51.386555 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982aa9f0-6eee-4223-8eb4-4c41402cc3f8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:51.400319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 89/174] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:02:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:51.401641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a08c2-d753-4945-932f-fc01c56b7f8b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:51.401931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a08c2-d753-4945-932f-fc01c56b7f8b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:51.402204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a08c2-d753-4945-932f-fc01c56b7f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:51.439526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-593a08c2-d753-4945-932f-fc01c56b7f8b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:51.440736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-593a08c2-d753-4945-932f-fc01c56b7f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:51.454917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:51.535273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 86/175] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:02:51.537828 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aa9f0-6eee-4223-8eb4-4c41402cc3f8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:51.588006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 90/176] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:51.589188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a08c2-d753-4945-932f-fc01c56b7f8b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:51.688934 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aa9f0-6eee-4223-8eb4-4c41402cc3f8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:51.701599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:51.725018 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a08c2-d753-4945-932f-fc01c56b7f8b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:51.727833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccc11b-2fa1-4d1f-9bc6-0c02f231e17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:51.728209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccc11b-2fa1-4d1f-9bc6-0c02f231e17e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:51.728490 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccc11b-2fa1-4d1f-9bc6-0c02f231e17e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:51.728765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccc11b-2fa1-4d1f-9bc6-0c02f231e17e None admin] PATH_INFO: `/v3/users/39c09083dd8a4c6dadfc555929d428f4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:51.729979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccc11b-2fa1-4d1f-9bc6-0c02f231e17e None admin] RBAC: Authorizing `identity:get_user(user_id=39c09083dd8a4c6dadfc555929d428f4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:51.731453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccc11b-2fa1-4d1f-9bc6-0c02f231e17e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:51.737262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 87/177] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:51 2022] GET /identity/v3/users/39c09083dd8a4c6dadfc555929d428f4 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:51.737262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c04c3-f471-4a70-a59a-84debef08d5d None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:51.737262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c04c3-f471-4a70-a59a-84debef08d5d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:51.737262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c04c3-f471-4a70-a59a-84debef08d5d None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:51.737262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 88/178] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:51.738044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e84c4-0020-4ff9-8de6-570fa0254f28 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:51.738044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e84c4-0020-4ff9-8de6-570fa0254f28 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:51.738323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e84c4-0020-4ff9-8de6-570fa0254f28 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:51.739718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 89/179] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:51.740350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e84c4-0020-4ff9-8de6-570fa0254f28 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:51.752903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:51.764646 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c284a65-d59c-4518-9caf-14844b07f854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:51.766758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c284a65-d59c-4518-9caf-14844b07f854 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:51.767044 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c284a65-d59c-4518-9caf-14844b07f854 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:51.767329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c284a65-d59c-4518-9caf-14844b07f854 None admin] PATH_INFO: `/v3/projects/62c8c65a44a5466589117da7cf272ffe` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:51.768564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c284a65-d59c-4518-9caf-14844b07f854 None admin] RBAC: Authorizing `identity:get_project(project_id=62c8c65a44a5466589117da7cf272ffe)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:51.770028 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c284a65-d59c-4518-9caf-14844b07f854 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:51.771772 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 91/180] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:51 2022] GET /identity/v3/projects/62c8c65a44a5466589117da7cf272ffe => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:51.772947 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7302f30-ac2f-4cf6-8b67-a32374441463 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:51.773243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7302f30-ac2f-4cf6-8b67-a32374441463 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:51.773521 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7302f30-ac2f-4cf6-8b67-a32374441463 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:51.778488 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 92/181] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:51.778488 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7302f30-ac2f-4cf6-8b67-a32374441463 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:51.852461 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e84c4-0020-4ff9-8de6-570fa0254f28 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:51.882646 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7302f30-ac2f-4cf6-8b67-a32374441463 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:51.889572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd05776-7bf0-448a-8018-2fad8ebbdfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:51.891179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd05776-7bf0-448a-8018-2fad8ebbdfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:51.891478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd05776-7bf0-448a-8018-2fad8ebbdfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:51.891758 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd05776-7bf0-448a-8018-2fad8ebbdfc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:51.901978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd05776-7bf0-448a-8018-2fad8ebbdfc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-6bd05776-7bf0-448a-8018-2fad8ebbdfc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:51.909963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:51.910960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:51.916915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:51.916915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:51.916915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:51.916915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:51.916915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:51.916915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:51.916915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:51.916915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:51.916915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:51.916915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:51.916915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:51.916915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:02:51.916915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 90/182] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:02:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:51.916915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb46367-a975-4a7f-abab-881c1d0f0f8a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:51.917630 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb46367-a975-4a7f-abab-881c1d0f0f8a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:51.917630 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb46367-a975-4a7f-abab-881c1d0f0f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:51.925154 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0a1a3-07c9-43a7-afd3-4d48ed0f833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:51.925814 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0a1a3-07c9-43a7-afd3-4d48ed0f833a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:51.926098 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0a1a3-07c9-43a7-afd3-4d48ed0f833a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:51.926377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0a1a3-07c9-43a7-afd3-4d48ed0f833a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:51.929254 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-4eb46367-a975-4a7f-abab-881c1d0f0f8a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:51.930481 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4eb46367-a975-4a7f-abab-881c1d0f0f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:51.945496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:51.993107 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:51.998199 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 91/183] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:52.000116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0a1a3-07c9-43a7-afd3-4d48ed0f833a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:52.000333 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515e39f-a4dc-45bd-b716-7a81df13e131 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:52.000484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515e39f-a4dc-45bd-b716-7a81df13e131 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:52.000712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515e39f-a4dc-45bd-b716-7a81df13e131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:52.002376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0a1a3-07c9-43a7-afd3-4d48ed0f833a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:52.017722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7515e39f-a4dc-45bd-b716-7a81df13e131 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:52.018962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7515e39f-a4dc-45bd-b716-7a81df13e131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:52.087240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 92/184] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:52.088757 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515e39f-a4dc-45bd-b716-7a81df13e131 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:52.107793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 93/185] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:02:52.108968 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa12164-3160-4c52-81ce-88017f6b75ca None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:52.109253 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa12164-3160-4c52-81ce-88017f6b75ca None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:52.109529 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa12164-3160-4c52-81ce-88017f6b75ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:52.126957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8aa12164-3160-4c52-81ce-88017f6b75ca None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:52.128152 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8aa12164-3160-4c52-81ce-88017f6b75ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:52.173325 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:52.197841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 94/186] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:52.198609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa12164-3160-4c52-81ce-88017f6b75ca None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:52.215488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515e39f-a4dc-45bd-b716-7a81df13e131 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:52.247048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:52.254734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6a679-f8ce-495e-a206-50dc60d62ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:52.255409 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6a679-f8ce-495e-a206-50dc60d62ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:52.255697 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6a679-f8ce-495e-a206-50dc60d62ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:52.255979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6a679-f8ce-495e-a206-50dc60d62ff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:52.256888 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6a679-f8ce-495e-a206-50dc60d62ff7 None admin] RBAC: Adding query filter params (role.id=2c5988d189bd4b4482fb3649b9cf1de4, scope.project.id=62c8c65a44a5466589117da7cf272ffe, user.id=39c09083dd8a4c6dadfc555929d428f4) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:52.257203 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6a679-f8ce-495e-a206-50dc60d62ff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:52.258718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6a679-f8ce-495e-a206-50dc60d62ff7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:52.264589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 93/187] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:02:52 2022] GET /identity/v3/role_assignments?user.id=39c09083dd8a4c6dadfc555929d428f4&scope.project.id=62c8c65a44a5466589117da7cf272ffe&role.id=2c5988d189bd4b4482fb3649b9cf1de4 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:52.266017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6a679-f8ce-495e-a206-50dc60d62ff7 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:52.327297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa12164-3160-4c52-81ce-88017f6b75ca None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:52.371282 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2f768-815c-48ce-924b-71368b734da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:52.371995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2f768-815c-48ce-924b-71368b734da9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:52.372280 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2f768-815c-48ce-924b-71368b734da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:52.372961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2f768-815c-48ce-924b-71368b734da9 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:52.373740 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2f768-815c-48ce-924b-71368b734da9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:52.374055 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2f768-815c-48ce-924b-71368b734da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:52.376262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2f768-815c-48ce-924b-71368b734da9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:52.385474 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 95/188] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:52.386158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2f768-815c-48ce-924b-71368b734da9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:52.406671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6a679-f8ce-495e-a206-50dc60d62ff7 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:52.433367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:52.450253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3bbf7-67f3-47a4-9e42-051fda325201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:52.451208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3bbf7-67f3-47a4-9e42-051fda325201 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:52.451397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3bbf7-67f3-47a4-9e42-051fda325201 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:52.451671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3bbf7-67f3-47a4-9e42-051fda325201 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:52.464976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3bbf7-67f3-47a4-9e42-051fda325201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-6bf3bbf7-67f3-47a4-9e42-051fda325201 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:52.473388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:52.474317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:52.475576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:52.475576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:52.475576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:52.475576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:52.475576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:52.475576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:52.475576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:52.475576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:52.475576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:52.475576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:52.475576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:02:52.475576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:02:52.475576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 94/189] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:02:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:52.475576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3bbf7-67f3-47a4-9e42-051fda325201 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:52.521950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2f768-815c-48ce-924b-71368b734da9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:52.543066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:52.555857 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c6aa4-b99c-4741-a0ba-6678036cbf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:52.556725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c6aa4-b99c-4741-a0ba-6678036cbf50 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:52.557010 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c6aa4-b99c-4741-a0ba-6678036cbf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:52.557290 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c6aa4-b99c-4741-a0ba-6678036cbf50 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:52.558504 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c6aa4-b99c-4741-a0ba-6678036cbf50 None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:52.559975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c6aa4-b99c-4741-a0ba-6678036cbf50 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:52.561673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 96/190] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:52 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:52.563258 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c6aa4-b99c-4741-a0ba-6678036cbf50 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:52.591990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3bbf7-67f3-47a4-9e42-051fda325201 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:52.627575 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e19e53-6b86-478d-92bb-0c2edfb1c911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:52.628378 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e19e53-6b86-478d-92bb-0c2edfb1c911 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:52.628658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e19e53-6b86-478d-92bb-0c2edfb1c911 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:52.628932 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e19e53-6b86-478d-92bb-0c2edfb1c911 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:52.630132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e19e53-6b86-478d-92bb-0c2edfb1c911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:52.631620 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e19e53-6b86-478d-92bb-0c2edfb1c911 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:52.633250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 95/191] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:02:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:52.634013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e19e53-6b86-478d-92bb-0c2edfb1c911 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:52.668594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c6aa4-b99c-4741-a0ba-6678036cbf50 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:52.678183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:52.704717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b77fd3-3483-4abd-9df7-afc6d1d8fe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:52.705516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b77fd3-3483-4abd-9df7-afc6d1d8fe0d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:52.705799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b77fd3-3483-4abd-9df7-afc6d1d8fe0d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:52.706072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b77fd3-3483-4abd-9df7-afc6d1d8fe0d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:52.716134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b77fd3-3483-4abd-9df7-afc6d1d8fe0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-03b77fd3-3483-4abd-9df7-afc6d1d8fe0d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:52.724734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:52.725833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:52.726829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:52.726829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:52.726829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:52.726829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:52.726829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:52.726829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:52.726829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:52.726829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:52.726829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:52.726829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:52.726829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:02:52.726829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:02:52.726829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 97/192] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:52.727630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b77fd3-3483-4abd-9df7-afc6d1d8fe0d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:52.738506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e19e53-6b86-478d-92bb-0c2edfb1c911 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:52.763775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:52.779308 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6585f-c79d-4dc1-a942-c70c11d0ff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:52.780102 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6585f-c79d-4dc1-a942-c70c11d0ff22 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:52.780385 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6585f-c79d-4dc1-a942-c70c11d0ff22 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:52.781510 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6585f-c79d-4dc1-a942-c70c11d0ff22 None admin] PATH_INFO: `/v3/users/d5aeccb3fcf8484eb3fb640f8f8425ef` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:52.796824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6585f-c79d-4dc1-a942-c70c11d0ff22 None admin] RBAC: Authorizing `identity:get_user(user_id=d5aeccb3fcf8484eb3fb640f8f8425ef)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:52.798299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6585f-c79d-4dc1-a942-c70c11d0ff22 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:52.800189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 96/193] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:52 2022] GET /identity/v3/users/d5aeccb3fcf8484eb3fb640f8f8425ef => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:52.800782 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6585f-c79d-4dc1-a942-c70c11d0ff22 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:52.844883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b77fd3-3483-4abd-9df7-afc6d1d8fe0d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:52.878689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385e6bc-2f06-488b-83ec-40073b139136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:52.879357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385e6bc-2f06-488b-83ec-40073b139136 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:52.879646 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385e6bc-2f06-488b-83ec-40073b139136 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:52.879931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385e6bc-2f06-488b-83ec-40073b139136 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:52.880679 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385e6bc-2f06-488b-83ec-40073b139136 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:52.880986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385e6bc-2f06-488b-83ec-40073b139136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:52.882382 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385e6bc-2f06-488b-83ec-40073b139136 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:52.890577 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 98/194] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:02:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:52.891349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385e6bc-2f06-488b-83ec-40073b139136 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:52.904253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6585f-c79d-4dc1-a942-c70c11d0ff22 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:52.922226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:52.940295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28787b-d30e-4ae8-b605-8a9f89723409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:52.940963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28787b-d30e-4ae8-b605-8a9f89723409 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:52.941252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28787b-d30e-4ae8-b605-8a9f89723409 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:52.941530 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28787b-d30e-4ae8-b605-8a9f89723409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:52.942370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28787b-d30e-4ae8-b605-8a9f89723409 None admin] RBAC: Adding query filter params (role.id=255c2b4827324109a6d2068c8b0316c3, scope.project.id=815bcedbe8ea4401944309ac6a34f4d0, user.id=39c09083dd8a4c6dadfc555929d428f4) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:52.942716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28787b-d30e-4ae8-b605-8a9f89723409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:52.944181 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28787b-d30e-4ae8-b605-8a9f89723409 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:52.950398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 97/195] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:02:52 2022] GET /identity/v3/role_assignments?user.id=39c09083dd8a4c6dadfc555929d428f4&scope.project.id=815bcedbe8ea4401944309ac6a34f4d0&role.id=255c2b4827324109a6d2068c8b0316c3 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:52.951204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28787b-d30e-4ae8-b605-8a9f89723409 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:52.997551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385e6bc-2f06-488b-83ec-40073b139136 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:53.011500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:53.038148 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba119a1d-94cf-414b-8c6a-849a695a85f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:53.039351 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba119a1d-94cf-414b-8c6a-849a695a85f5 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:53.039964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba119a1d-94cf-414b-8c6a-849a695a85f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:53.040309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba119a1d-94cf-414b-8c6a-849a695a85f5 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:53.041119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba119a1d-94cf-414b-8c6a-849a695a85f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:53.042706 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba119a1d-94cf-414b-8c6a-849a695a85f5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:53.069253 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 99/196] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:02:52 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:02:53.070625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba119a1d-94cf-414b-8c6a-849a695a85f5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:53.094470 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28787b-d30e-4ae8-b605-8a9f89723409 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:53.153565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10af04-1357-4236-8f09-72258533ce70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:53.154642 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10af04-1357-4236-8f09-72258533ce70 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:53.155121 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10af04-1357-4236-8f09-72258533ce70 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:53.155617 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10af04-1357-4236-8f09-72258533ce70 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:53.158776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10af04-1357-4236-8f09-72258533ce70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:53.159719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10af04-1357-4236-8f09-72258533ce70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:53.160897 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10af04-1357-4236-8f09-72258533ce70 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:53.173471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 98/197] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:02:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:53.177694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10af04-1357-4236-8f09-72258533ce70 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:53.219916 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:53.243719 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba119a1d-94cf-414b-8c6a-849a695a85f5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:53.287098 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16910ba-7fe6-4f2d-90d7-3fa2e459b56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:53.289197 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16910ba-7fe6-4f2d-90d7-3fa2e459b56d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:53.289197 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16910ba-7fe6-4f2d-90d7-3fa2e459b56d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:53.289197 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16910ba-7fe6-4f2d-90d7-3fa2e459b56d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:53.313925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10af04-1357-4236-8f09-72258533ce70 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:53.321942 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:53.364535 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e206f-477c-4d2f-bc00-b234f825f102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:53.365513 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e206f-477c-4d2f-bc00-b234f825f102 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:53.365804 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e206f-477c-4d2f-bc00-b234f825f102 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:53.366090 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e206f-477c-4d2f-bc00-b234f825f102 None admin] PATH_INFO: `/v3/users/d5aeccb3fcf8484eb3fb640f8f8425ef` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:53.369494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e206f-477c-4d2f-bc00-b234f825f102 None admin] RBAC: Authorizing `identity:get_user(user_id=d5aeccb3fcf8484eb3fb640f8f8425ef)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:53.371035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e206f-477c-4d2f-bc00-b234f825f102 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:53.373048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 99/198] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:53 2022] GET /identity/v3/users/d5aeccb3fcf8484eb3fb640f8f8425ef => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:53.373853 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e206f-477c-4d2f-bc00-b234f825f102 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:53.380793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16910ba-7fe6-4f2d-90d7-3fa2e459b56d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:53.382338 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16910ba-7fe6-4f2d-90d7-3fa2e459b56d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:53.495493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:53.514537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 100/199] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:02:53.515959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16910ba-7fe6-4f2d-90d7-3fa2e459b56d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:53.526453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e206f-477c-4d2f-bc00-b234f825f102 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:53.583496 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b817f-9eb1-4893-beb9-ed10b13d120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:53.584792 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b817f-9eb1-4893-beb9-ed10b13d120e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:53.585132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b817f-9eb1-4893-beb9-ed10b13d120e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:53.585424 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b817f-9eb1-4893-beb9-ed10b13d120e None admin] PATH_INFO: `/v3/users/256d3144a0c248bba9dbdf2b55f53199` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:53.587320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b817f-9eb1-4893-beb9-ed10b13d120e None admin] RBAC: Authorizing `identity:get_user(user_id=256d3144a0c248bba9dbdf2b55f53199)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:53.589558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b817f-9eb1-4893-beb9-ed10b13d120e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:53.592517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 100/200] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:53 2022] GET /identity/v3/users/256d3144a0c248bba9dbdf2b55f53199 => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:53.593687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b817f-9eb1-4893-beb9-ed10b13d120e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:53.633563 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16910ba-7fe6-4f2d-90d7-3fa2e459b56d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:53.655656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:53.673962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71d6e7-779c-4a3b-a73f-7a1f93b56323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:53.675021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71d6e7-779c-4a3b-a73f-7a1f93b56323 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:53.675521 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71d6e7-779c-4a3b-a73f-7a1f93b56323 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:53.675996 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71d6e7-779c-4a3b-a73f-7a1f93b56323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:53.738573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:53.745858 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b817f-9eb1-4893-beb9-ed10b13d120e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:53.755292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71d6e7-779c-4a3b-a73f-7a1f93b56323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:53.757245 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71d6e7-779c-4a3b-a73f-7a1f93b56323 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:53.794907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00cbb7-85b6-4c09-99a8-3835d32f9764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:53.796668 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00cbb7-85b6-4c09-99a8-3835d32f9764 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:53.798149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00cbb7-85b6-4c09-99a8-3835d32f9764 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:53.798500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00cbb7-85b6-4c09-99a8-3835d32f9764 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:53.799767 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00cbb7-85b6-4c09-99a8-3835d32f9764 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:53.801252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00cbb7-85b6-4c09-99a8-3835d32f9764 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:53.803533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 101/201] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:53 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:53.804323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00cbb7-85b6-4c09-99a8-3835d32f9764 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:53.889802 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 101/202] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:02:53.893134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71d6e7-779c-4a3b-a73f-7a1f93b56323 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:53.933348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00cbb7-85b6-4c09-99a8-3835d32f9764 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:53.944953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:53.972999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3de02b-8886-42c6-83bb-5cf136e0e928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:53.973433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3de02b-8886-42c6-83bb-5cf136e0e928 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:53.973727 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3de02b-8886-42c6-83bb-5cf136e0e928 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:53.974010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3de02b-8886-42c6-83bb-5cf136e0e928 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:53.994073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:54.011719 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71d6e7-779c-4a3b-a73f-7a1f93b56323 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:54.052340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ebd6c-91c3-49c7-a6ce-6ad1118d4a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:54.053251 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ebd6c-91c3-49c7-a6ce-6ad1118d4a15 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:54.053784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ebd6c-91c3-49c7-a6ce-6ad1118d4a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:54.054222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ebd6c-91c3-49c7-a6ce-6ad1118d4a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:54.054473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3de02b-8886-42c6-83bb-5cf136e0e928 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:54.055402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ebd6c-91c3-49c7-a6ce-6ad1118d4a15 None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=e5669c2ec4584aa9afe502b8365fd982, user.id=d5aeccb3fcf8484eb3fb640f8f8425ef) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:54.055863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ebd6c-91c3-49c7-a6ce-6ad1118d4a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:54.055989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3de02b-8886-42c6-83bb-5cf136e0e928 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:54.057572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ebd6c-91c3-49c7-a6ce-6ad1118d4a15 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:54.065257 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 102/203] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:02:53 2022] GET /identity/v3/role_assignments?user.id=d5aeccb3fcf8484eb3fb640f8f8425ef&scope.project.id=e5669c2ec4584aa9afe502b8365fd982&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:54.066439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ebd6c-91c3-49c7-a6ce-6ad1118d4a15 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:54.174410 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 102/204] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:02:54.180350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3de02b-8886-42c6-83bb-5cf136e0e928 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:54.188880 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ebd6c-91c3-49c7-a6ce-6ad1118d4a15 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:54.193936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:54.246915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c538253-d580-471c-9cbb-82c6c66997e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:54.247828 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c538253-d580-471c-9cbb-82c6c66997e2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:54.248114 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c538253-d580-471c-9cbb-82c6c66997e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:54.248395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c538253-d580-471c-9cbb-82c6c66997e2 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:54.251088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c538253-d580-471c-9cbb-82c6c66997e2 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:54.253363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c538253-d580-471c-9cbb-82c6c66997e2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:54.259656 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 103/205] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:54 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:54.261003 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c538253-d580-471c-9cbb-82c6c66997e2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:54.305268 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:54.388504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3de02b-8886-42c6-83bb-5cf136e0e928 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:54.420829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c538253-d580-471c-9cbb-82c6c66997e2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:54.439575 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46883da2-4e96-4ee6-b0dd-64f968eb28e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:54.440378 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46883da2-4e96-4ee6-b0dd-64f968eb28e4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:54.440664 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46883da2-4e96-4ee6-b0dd-64f968eb28e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:54.440946 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46883da2-4e96-4ee6-b0dd-64f968eb28e4 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:54.442336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46883da2-4e96-4ee6-b0dd-64f968eb28e4 None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:54.445528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46883da2-4e96-4ee6-b0dd-64f968eb28e4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:54.449306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 103/206] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:54 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:54.463039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46883da2-4e96-4ee6-b0dd-64f968eb28e4 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:54.504382 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24a450-350f-45b4-9b25-aa98511a68c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:54.505067 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24a450-350f-45b4-9b25-aa98511a68c7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:54.505357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24a450-350f-45b4-9b25-aa98511a68c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:54.505631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24a450-350f-45b4-9b25-aa98511a68c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:54.506505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24a450-350f-45b4-9b25-aa98511a68c7 None admin] RBAC: Adding query filter params (role.id=255c2b4827324109a6d2068c8b0316c3, scope.project.id=e5669c2ec4584aa9afe502b8365fd982, user.id=d5aeccb3fcf8484eb3fb640f8f8425ef) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:54.506827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24a450-350f-45b4-9b25-aa98511a68c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:54.508347 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24a450-350f-45b4-9b25-aa98511a68c7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:54.522848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 104/207] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:02:54 2022] GET /identity/v3/role_assignments?user.id=d5aeccb3fcf8484eb3fb640f8f8425ef&scope.project.id=e5669c2ec4584aa9afe502b8365fd982&role.id=255c2b4827324109a6d2068c8b0316c3 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:54.567833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:54.599425 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46883da2-4e96-4ee6-b0dd-64f968eb28e4 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:54.645812 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e05074-1c63-4941-b341-46824a1eb937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:54.646540 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e05074-1c63-4941-b341-46824a1eb937 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:54.646831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e05074-1c63-4941-b341-46824a1eb937 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:54.647112 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e05074-1c63-4941-b341-46824a1eb937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:54.647975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e05074-1c63-4941-b341-46824a1eb937 None admin] RBAC: Adding query filter params (role.id=f7aa69fd565d4a948224949d5ce35c0b, scope.project.id=815bcedbe8ea4401944309ac6a34f4d0, user.id=256d3144a0c248bba9dbdf2b55f53199) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:54.648291 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e05074-1c63-4941-b341-46824a1eb937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:54.649780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e05074-1c63-4941-b341-46824a1eb937 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:54.656788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 104/208] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:02:54 2022] GET /identity/v3/role_assignments?user.id=256d3144a0c248bba9dbdf2b55f53199&scope.project.id=815bcedbe8ea4401944309ac6a34f4d0&role.id=f7aa69fd565d4a948224949d5ce35c0b => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:55.573240 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa422b90-6276-4567-a9ab-b13a60d9dda0 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:55.573747 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa422b90-6276-4567-a9ab-b13a60d9dda0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:55.573823 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa422b90-6276-4567-a9ab-b13a60d9dda0 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:55.575490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 105/209] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:55.581895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6be5ce-10fe-4d9e-9569-e638a856dd25 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:55.582296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6be5ce-10fe-4d9e-9569-e638a856dd25 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:55.582487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6be5ce-10fe-4d9e-9569-e638a856dd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:55.599858 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9d6be5ce-10fe-4d9e-9569-e638a856dd25 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:55.601056 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9d6be5ce-10fe-4d9e-9569-e638a856dd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:55.690545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 105/210] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:55.694686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669efcaa-cca4-4ddc-8fc7-b1e599535ab4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:55.694978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669efcaa-cca4-4ddc-8fc7-b1e599535ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:55.695254 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669efcaa-cca4-4ddc-8fc7-b1e599535ab4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:55.697121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 106/211] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:55.702006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d52f-f536-46ee-b441-524b2ebcbc22 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:55.702391 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d52f-f536-46ee-b441-524b2ebcbc22 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:55.702722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d52f-f536-46ee-b441-524b2ebcbc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:55.711175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669efcaa-cca4-4ddc-8fc7-b1e599535ab4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:55.721916 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b8f0d52f-f536-46ee-b441-524b2ebcbc22 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:55.723123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b8f0d52f-f536-46ee-b441-524b2ebcbc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:55.803691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:55.815584 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 106/212] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:55.827908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669efcaa-cca4-4ddc-8fc7-b1e599535ab4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:55.839575 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0d52f-f536-46ee-b441-524b2ebcbc22 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:55.841725 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:55.868184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f2947-e478-4afc-9b48-2618ecb7c305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:55.869409 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f2947-e478-4afc-9b48-2618ecb7c305 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:55.869901 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f2947-e478-4afc-9b48-2618ecb7c305 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:55.870417 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f2947-e478-4afc-9b48-2618ecb7c305 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:55.871990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f2947-e478-4afc-9b48-2618ecb7c305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:55.873816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f2947-e478-4afc-9b48-2618ecb7c305 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:55.881186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 107/213] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:02:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:55.882776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f2947-e478-4afc-9b48-2618ecb7c305 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:55.957084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0d52f-f536-46ee-b441-524b2ebcbc22 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:55.992860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f2947-e478-4afc-9b48-2618ecb7c305 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:55.998842 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f89f-b42c-4772-b786-78ea88d5119b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:55.999880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f89f-b42c-4772-b786-78ea88d5119b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:56.000165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f89f-b42c-4772-b786-78ea88d5119b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:56.000444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815f89f-b42c-4772-b786-78ea88d5119b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:56.012557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815f89f-b42c-4772-b786-78ea88d5119b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-a815f89f-b42c-4772-b786-78ea88d5119b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:56.022020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:56.022957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:56.023768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:56.023768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:56.023768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:56.023768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:56.023768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:56.023768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:56.023768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:56.023768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:56.023768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:56.023768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:56.023768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:02:56.023768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:02:56.028336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 107/214] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:56.028928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f89f-b42c-4772-b786-78ea88d5119b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:56.037283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373237e-5627-49cd-b259-a0b1172e9e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:56.038267 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373237e-5627-49cd-b259-a0b1172e9e44 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:56.038774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373237e-5627-49cd-b259-a0b1172e9e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:56.039250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373237e-5627-49cd-b259-a0b1172e9e44 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:56.040188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373237e-5627-49cd-b259-a0b1172e9e44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:56.041851 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373237e-5627-49cd-b259-a0b1172e9e44 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:56.065145 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 108/215] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:02:55 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:02:56.113731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:56.160996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815f89f-b42c-4772-b786-78ea88d5119b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:56.198229 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3a29b-a559-4f61-819d-22e50e042d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:56.199002 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3a29b-a559-4f61-819d-22e50e042d9c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:56.199288 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3a29b-a559-4f61-819d-22e50e042d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:56.199645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3a29b-a559-4f61-819d-22e50e042d9c None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:56.200412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3a29b-a559-4f61-819d-22e50e042d9c None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:56.200726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3a29b-a559-4f61-819d-22e50e042d9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:56.202143 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3a29b-a559-4f61-819d-22e50e042d9c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:56.213015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 108/216] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:02:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:56.219194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373237e-5627-49cd-b259-a0b1172e9e44 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:56.228769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:56.335870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373237e-5627-49cd-b259-a0b1172e9e44 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:56.374273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee127780-bf6a-4b4c-af9d-826c97308bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:56.375225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee127780-bf6a-4b4c-af9d-826c97308bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:56.375512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee127780-bf6a-4b4c-af9d-826c97308bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:56.375790 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee127780-bf6a-4b4c-af9d-826c97308bf5 None admin] PATH_INFO: `/v3/users/b2b8ca3e84ae4ee28633d89a2dd71073` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:56.398580 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee127780-bf6a-4b4c-af9d-826c97308bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=b2b8ca3e84ae4ee28633d89a2dd71073)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:56.400067 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee127780-bf6a-4b4c-af9d-826c97308bf5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:56.402199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 109/217] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:56 2022] GET /identity/v3/users/b2b8ca3e84ae4ee28633d89a2dd71073 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:56.408541 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3a29b-a559-4f61-819d-22e50e042d9c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:56.532891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcaa16-b5e6-4ecf-8750-55e321a70a83 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:56.533191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcaa16-b5e6-4ecf-8750-55e321a70a83 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:56.533368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcaa16-b5e6-4ecf-8750-55e321a70a83 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:56.534813 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 110/218] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:56.540200 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6e628-afed-49cd-a3b6-88019ee87dc7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:56.540483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6e628-afed-49cd-a3b6-88019ee87dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:56.540759 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6e628-afed-49cd-a3b6-88019ee87dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:56.561471 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4ca6e628-afed-49cd-a3b6-88019ee87dc7 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:56.562925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4ca6e628-afed-49cd-a3b6-88019ee87dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:56.613186 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3a29b-a559-4f61-819d-22e50e042d9c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:56.657395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:56.674012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:56.683869 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ace8a-c3fb-4204-b5c6-4aede0352da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:56.684543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ace8a-c3fb-4204-b5c6-4aede0352da9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:56.684828 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ace8a-c3fb-4204-b5c6-4aede0352da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:56.685146 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ace8a-c3fb-4204-b5c6-4aede0352da9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:56.689399 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 111/219] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:56.754072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6e628-afed-49cd-a3b6-88019ee87dc7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:56.778261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ace8a-c3fb-4204-b5c6-4aede0352da9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:56.779758 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ace8a-c3fb-4204-b5c6-4aede0352da9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:56.885049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 109/220] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:02:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:02:56.895878 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ace8a-c3fb-4204-b5c6-4aede0352da9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:56.924081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:56.943675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6e628-afed-49cd-a3b6-88019ee87dc7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:56.984541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa3ec3-f891-4514-b5db-12e98c1afc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:56.985374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa3ec3-f891-4514-b5db-12e98c1afc37 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:56.985657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa3ec3-f891-4514-b5db-12e98c1afc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:56.985932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa3ec3-f891-4514-b5db-12e98c1afc37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:56.996716 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa3ec3-f891-4514-b5db-12e98c1afc37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c9aa3ec3-f891-4514-b5db-12e98c1afc37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:57.004609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:57.005497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:57.006283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:57.006283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:57.006283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:57.006283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:57.006283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:57.006283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:57.006283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:57.006283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:57.006283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:57.006283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:57.006283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:02:57.006283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:02:57.006283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 112/221] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:02:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:02:57.007399 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52769df5-d80c-4f17-b3b4-753f0329c05c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:57.007399 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52769df5-d80c-4f17-b3b4-753f0329c05c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:57.009795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52769df5-d80c-4f17-b3b4-753f0329c05c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:57.009960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ace8a-c3fb-4204-b5c6-4aede0352da9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:57.013960 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 113/222] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:57.015528 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52769df5-d80c-4f17-b3b4-753f0329c05c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:57.063261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb8175-a7c6-43e9-ac5e-03d569d2ad90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:57.064573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb8175-a7c6-43e9-ac5e-03d569d2ad90 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:57.064858 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb8175-a7c6-43e9-ac5e-03d569d2ad90 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:57.065196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb8175-a7c6-43e9-ac5e-03d569d2ad90 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:57.066900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb8175-a7c6-43e9-ac5e-03d569d2ad90 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:57.069000 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb8175-a7c6-43e9-ac5e-03d569d2ad90 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:57.071559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 110/223] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:56 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:57.073021 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8542a1-451a-4661-a58b-1952cafaf0c4 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:57.073311 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8542a1-451a-4661-a58b-1952cafaf0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:57.073596 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8542a1-451a-4661-a58b-1952cafaf0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:57.081442 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:57.098286 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6a8542a1-451a-4661-a58b-1952cafaf0c4 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:57.100017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6a8542a1-451a-4661-a58b-1952cafaf0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:57.142279 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52769df5-d80c-4f17-b3b4-753f0329c05c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:57.178857 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60b225-5887-4f45-877e-301e40bf806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:57.179565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60b225-5887-4f45-877e-301e40bf806e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:57.179837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60b225-5887-4f45-877e-301e40bf806e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:57.180110 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60b225-5887-4f45-877e-301e40bf806e None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:57.180860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60b225-5887-4f45-877e-301e40bf806e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:57.181244 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60b225-5887-4f45-877e-301e40bf806e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:57.182704 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60b225-5887-4f45-877e-301e40bf806e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:57.190779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 111/224] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:57.192078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8542a1-451a-4661-a58b-1952cafaf0c4 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:57.192725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 114/225] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:57.198315 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60b225-5887-4f45-877e-301e40bf806e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:57.240611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:57.303020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60b225-5887-4f45-877e-301e40bf806e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:57.325126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8542a1-451a-4661-a58b-1952cafaf0c4 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:57.337546 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb86a6-8c88-46e8-abe3-896ef6781862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:57.338422 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb86a6-8c88-46e8-abe3-896ef6781862 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:57.338748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb86a6-8c88-46e8-abe3-896ef6781862 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:57.339023 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb86a6-8c88-46e8-abe3-896ef6781862 None admin] PATH_INFO: `/v3/users/d5aeccb3fcf8484eb3fb640f8f8425ef` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:57.340238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb86a6-8c88-46e8-abe3-896ef6781862 None admin] RBAC: Authorizing `identity:get_user(user_id=d5aeccb3fcf8484eb3fb640f8f8425ef)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:57.341670 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb86a6-8c88-46e8-abe3-896ef6781862 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:57.346120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 115/226] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:57 2022] GET /identity/v3/users/d5aeccb3fcf8484eb3fb640f8f8425ef => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:57.346120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb86a6-8c88-46e8-abe3-896ef6781862 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:57.348406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:57.371574 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625891a8-3559-40d1-a93f-5372cb6a7cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:57.372247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625891a8-3559-40d1-a93f-5372cb6a7cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:57.372532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625891a8-3559-40d1-a93f-5372cb6a7cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:57.372810 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625891a8-3559-40d1-a93f-5372cb6a7cc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:57.373649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625891a8-3559-40d1-a93f-5372cb6a7cc2 None admin] RBAC: Adding query filter params (role.id=2c5988d189bd4b4482fb3649b9cf1de4, scope.project.id=e5669c2ec4584aa9afe502b8365fd982, user.id=b2b8ca3e84ae4ee28633d89a2dd71073) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:57.373960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625891a8-3559-40d1-a93f-5372cb6a7cc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:57.375606 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625891a8-3559-40d1-a93f-5372cb6a7cc2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:57.381504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 112/227] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:02:57 2022] GET /identity/v3/role_assignments?user.id=b2b8ca3e84ae4ee28633d89a2dd71073&scope.project.id=e5669c2ec4584aa9afe502b8365fd982&role.id=2c5988d189bd4b4482fb3649b9cf1de4 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:57.382293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625891a8-3559-40d1-a93f-5372cb6a7cc2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:57.538359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:57.543786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb86a6-8c88-46e8-abe3-896ef6781862 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:57.566768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625891a8-3559-40d1-a93f-5372cb6a7cc2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:57.605752 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72862bd7-42a4-4666-9bb7-64e629a1997c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:57.607072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72862bd7-42a4-4666-9bb7-64e629a1997c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:57.607595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72862bd7-42a4-4666-9bb7-64e629a1997c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:57.608040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72862bd7-42a4-4666-9bb7-64e629a1997c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:57.611469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc37f8-596e-4706-b90e-753e3476797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:57.612365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc37f8-596e-4706-b90e-753e3476797b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:57.612650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc37f8-596e-4706-b90e-753e3476797b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:57.612929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc37f8-596e-4706-b90e-753e3476797b None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:57.614364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc37f8-596e-4706-b90e-753e3476797b None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:57.615867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc37f8-596e-4706-b90e-753e3476797b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:57.620487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 113/228] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:57 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:57.625241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc37f8-596e-4706-b90e-753e3476797b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:57.635517 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72862bd7-42a4-4666-9bb7-64e629a1997c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-72862bd7-42a4-4666-9bb7-64e629a1997c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:57.644795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:57.645699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:57.649432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:57.649432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:57.649432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:57.649432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:57.649432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:57.649432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:57.649432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:57.649432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:57.649432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:57.649432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:57.649432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:02:57.649432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:02:57.649432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 116/229] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:02:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:02:57.654171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72862bd7-42a4-4666-9bb7-64e629a1997c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:57.746365 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:57.806982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc37f8-596e-4706-b90e-753e3476797b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:57.836530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72862bd7-42a4-4666-9bb7-64e629a1997c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:57.875407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e73731-5f51-4cf3-be8f-30a19a07af20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:57.876460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e73731-5f51-4cf3-be8f-30a19a07af20 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:57.876986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e73731-5f51-4cf3-be8f-30a19a07af20 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:57.877456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e73731-5f51-4cf3-be8f-30a19a07af20 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:57.878613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e73731-5f51-4cf3-be8f-30a19a07af20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:57.879271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e73731-5f51-4cf3-be8f-30a19a07af20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:57.880841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e73731-5f51-4cf3-be8f-30a19a07af20 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:57.889607 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 117/230] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:02:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:57.897497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd3382-1b7f-4d42-b44d-e0eb2f47cef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:57.897497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd3382-1b7f-4d42-b44d-e0eb2f47cef3 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:57.897497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd3382-1b7f-4d42-b44d-e0eb2f47cef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:57.897497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd3382-1b7f-4d42-b44d-e0eb2f47cef3 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982/users/d5aeccb3fcf8484eb3fb640f8f8425ef/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:57.898921 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd3382-1b7f-4d42-b44d-e0eb2f47cef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5669c2ec4584aa9afe502b8365fd982, user_id=d5aeccb3fcf8484eb3fb640f8f8425ef, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:57.899258 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e73731-5f51-4cf3-be8f-30a19a07af20 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:57.900379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd3382-1b7f-4d42-b44d-e0eb2f47cef3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:57.924783 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 114/231] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:02:57 2022] PUT /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982/users/d5aeccb3fcf8484eb3fb640f8f8425ef/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:02:58.031067 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e73731-5f51-4cf3-be8f-30a19a07af20 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:58.042456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:58.076150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60ff37-564e-4111-b080-c3200e0b9192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:58.076953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60ff37-564e-4111-b080-c3200e0b9192 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:58.077238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60ff37-564e-4111-b080-c3200e0b9192 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:58.078200 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60ff37-564e-4111-b080-c3200e0b9192 None admin] PATH_INFO: `/v3/users/d5aeccb3fcf8484eb3fb640f8f8425ef` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:58.079467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60ff37-564e-4111-b080-c3200e0b9192 None admin] RBAC: Authorizing `identity:get_user(user_id=d5aeccb3fcf8484eb3fb640f8f8425ef)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:58.080932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60ff37-564e-4111-b080-c3200e0b9192 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:58.082925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 118/232] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:57 2022] GET /identity/v3/users/d5aeccb3fcf8484eb3fb640f8f8425ef => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:58.088677 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd3382-1b7f-4d42-b44d-e0eb2f47cef3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:58.106615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:58.206574 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd3382-1b7f-4d42-b44d-e0eb2f47cef3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:58.245814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ced47-0bf8-4ac1-951b-3b8dd433d6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:58.246749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ced47-0bf8-4ac1-951b-3b8dd433d6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:58.247039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ced47-0bf8-4ac1-951b-3b8dd433d6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:58.247327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ced47-0bf8-4ac1-951b-3b8dd433d6d6 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:58.248631 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ced47-0bf8-4ac1-951b-3b8dd433d6d6 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:58.250653 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ced47-0bf8-4ac1-951b-3b8dd433d6d6 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:58.252492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 115/233] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:02:58 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:58.258232 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60ff37-564e-4111-b080-c3200e0b9192 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:58.388140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60ff37-564e-4111-b080-c3200e0b9192 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:58.431992 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e142b2e-6abe-4b76-a6cc-a20352037f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:58.433163 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e142b2e-6abe-4b76-a6cc-a20352037f43 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:58.433594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e142b2e-6abe-4b76-a6cc-a20352037f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:58.434014 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e142b2e-6abe-4b76-a6cc-a20352037f43 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982/users/d5aeccb3fcf8484eb3fb640f8f8425ef/roles/255c2b4827324109a6d2068c8b0316c3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:58.436437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e142b2e-6abe-4b76-a6cc-a20352037f43 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5669c2ec4584aa9afe502b8365fd982, user_id=d5aeccb3fcf8484eb3fb640f8f8425ef, role_id=255c2b4827324109a6d2068c8b0316c3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:58.438934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e142b2e-6abe-4b76-a6cc-a20352037f43 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:58.458040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 119/234] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:02:58 2022] PUT /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982/users/d5aeccb3fcf8484eb3fb640f8f8425ef/roles/255c2b4827324109a6d2068c8b0316c3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:02:58.788924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d91ed-0215-423a-9a1a-cae288e50faf None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:58.789962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d91ed-0215-423a-9a1a-cae288e50faf None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:58.790469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d91ed-0215-423a-9a1a-cae288e50faf None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:58.792476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 116/235] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:58.798694 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc164ac9-26ef-4783-b650-2367187ecd68 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:58.799617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc164ac9-26ef-4783-b650-2367187ecd68 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:58.800086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc164ac9-26ef-4783-b650-2367187ecd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:58.818320 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cc164ac9-26ef-4783-b650-2367187ecd68 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:58.819860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cc164ac9-26ef-4783-b650-2367187ecd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:58.837979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f056fa1-ac4c-4e45-a469-c8d42cac6b3b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:58.838610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f056fa1-ac4c-4e45-a469-c8d42cac6b3b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:58.839086 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f056fa1-ac4c-4e45-a469-c8d42cac6b3b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:58.840967 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 117/236] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:02:58.847780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad3056-8e9c-465a-bb22-be5f8d2f1915 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:58.849054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad3056-8e9c-465a-bb22-be5f8d2f1915 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:58.849586 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad3056-8e9c-465a-bb22-be5f8d2f1915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:58.856667 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:58.877216 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-94ad3056-8e9c-465a-bb22-be5f8d2f1915 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:58.878689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-94ad3056-8e9c-465a-bb22-be5f8d2f1915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:58.917202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 120/237] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:02:58.942755 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc164ac9-26ef-4783-b650-2367187ecd68 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:59.008739 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 118/238] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:02:59.057102 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad3056-8e9c-465a-bb22-be5f8d2f1915 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:59.073996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:59.074622 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc164ac9-26ef-4783-b650-2367187ecd68 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:59.160103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f87d96-2755-4c1c-b536-b23f566e2466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:59.160918 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f87d96-2755-4c1c-b536-b23f566e2466 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:59.161204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f87d96-2755-4c1c-b536-b23f566e2466 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:59.161481 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f87d96-2755-4c1c-b536-b23f566e2466 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:59.167274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f87d96-2755-4c1c-b536-b23f566e2466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:59.168778 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f87d96-2755-4c1c-b536-b23f566e2466 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:59.170699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 121/239] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:02:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:02:59.170814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad3056-8e9c-465a-bb22-be5f8d2f1915 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:59.188072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f87d96-2755-4c1c-b536-b23f566e2466 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:59.213180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d3560-c09f-4bba-9f16-5edd5add4d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:59.214092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d3560-c09f-4bba-9f16-5edd5add4d76 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:59.214457 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d3560-c09f-4bba-9f16-5edd5add4d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:59.214930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d3560-c09f-4bba-9f16-5edd5add4d76 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:59.227235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d3560-c09f-4bba-9f16-5edd5add4d76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-125d3560-c09f-4bba-9f16-5edd5add4d76 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:02:59.236359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:02:59.237469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:02:59.238486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:02:59.238486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:02:59.238486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:02:59.238486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:02:59.238486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:02:59.238486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:02:59.238486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:02:59.238486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:02:59.238486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:02:59.238486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:02:59.238486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:02:59.238486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:02:59.243961 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 119/240] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:02:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:02:59.245197 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d3560-c09f-4bba-9f16-5edd5add4d76 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:59.271676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:59.337402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:59.388523 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d3560-c09f-4bba-9f16-5edd5add4d76 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:59.391035 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f87d96-2755-4c1c-b536-b23f566e2466 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:59.435873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071b0a4-b934-4e37-9114-84e25483db6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:59.437513 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071b0a4-b934-4e37-9114-84e25483db6b None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:59.439651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071b0a4-b934-4e37-9114-84e25483db6b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:59.440771 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071b0a4-b934-4e37-9114-84e25483db6b None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:59.441697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071b0a4-b934-4e37-9114-84e25483db6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:59.444352 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071b0a4-b934-4e37-9114-84e25483db6b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:59.459909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310ef63-b72d-4755-86f0-845aa5e9822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:59.460946 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310ef63-b72d-4755-86f0-845aa5e9822f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:59.461449 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310ef63-b72d-4755-86f0-845aa5e9822f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:59.461921 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310ef63-b72d-4755-86f0-845aa5e9822f None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:59.462916 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310ef63-b72d-4755-86f0-845aa5e9822f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:02:59.464461 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310ef63-b72d-4755-86f0-845aa5e9822f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:59.466092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310ef63-b72d-4755-86f0-845aa5e9822f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:59.490592 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 122/241] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:02:59 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:02:59.493380 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 120/242] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:02:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:59.507834 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071b0a4-b934-4e37-9114-84e25483db6b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:59.635947 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:59.656610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071b0a4-b934-4e37-9114-84e25483db6b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:59.712280 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa775ed3-b748-41dd-9c48-2f15c47e72d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:59.712983 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa775ed3-b748-41dd-9c48-2f15c47e72d0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:59.713264 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa775ed3-b748-41dd-9c48-2f15c47e72d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:59.713540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa775ed3-b748-41dd-9c48-2f15c47e72d0 None admin] PATH_INFO: `/v3/users/c50ec105b3c64e84b316a28c91823882` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:59.731503 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa775ed3-b748-41dd-9c48-2f15c47e72d0 None admin] RBAC: Authorizing `identity:get_user(user_id=c50ec105b3c64e84b316a28c91823882)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:02:59.733069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa775ed3-b748-41dd-9c48-2f15c47e72d0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:02:59.735823 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 123/243] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:02:59 2022] GET /identity/v3/users/c50ec105b3c64e84b316a28c91823882 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:02:59.741934 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310ef63-b72d-4755-86f0-845aa5e9822f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:02:59.865651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33f801-0012-49f3-8bb4-239d148087d8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:59.866150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33f801-0012-49f3-8bb4-239d148087d8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:59.866226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33f801-0012-49f3-8bb4-239d148087d8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:59.867610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 124/244] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:02:59.877844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8156944-6f3c-4f4f-b697-059ebd0acb7b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:59.878147 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8156944-6f3c-4f4f-b697-059ebd0acb7b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:59.878415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8156944-6f3c-4f4f-b697-059ebd0acb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:59.894603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310ef63-b72d-4755-86f0-845aa5e9822f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:02:59.899543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b8156944-6f3c-4f4f-b697-059ebd0acb7b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:02:59.900785 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b8156944-6f3c-4f4f-b697-059ebd0acb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:02:59.935191 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9ee9b-2e91-492c-8907-54c6ec85bde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:02:59.936090 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9ee9b-2e91-492c-8907-54c6ec85bde0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:02:59.936522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9ee9b-2e91-492c-8907-54c6ec85bde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:02:59.937733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9ee9b-2e91-492c-8907-54c6ec85bde0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:02:59.942552 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:02:59.989124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 125/245] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:03:00.019606 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8156944-6f3c-4f4f-b697-059ebd0acb7b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:00.026612 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9ee9b-2e91-492c-8907-54c6ec85bde0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:00.028120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9ee9b-2e91-492c-8907-54c6ec85bde0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:00.126915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:00.152586 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 121/246] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:00.158244 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8156944-6f3c-4f4f-b697-059ebd0acb7b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:00.158777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9ee9b-2e91-492c-8907-54c6ec85bde0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:00.215548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:00.216877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27427316-93f9-40e9-bdca-b5deb60b03de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:00.218720 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27427316-93f9-40e9-bdca-b5deb60b03de None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:00.219172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27427316-93f9-40e9-bdca-b5deb60b03de None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:00.221505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27427316-93f9-40e9-bdca-b5deb60b03de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:00.254625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27427316-93f9-40e9-bdca-b5deb60b03de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-27427316-93f9-40e9-bdca-b5deb60b03de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:00.262375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:00.263536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:00.264494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:00.264494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:00.264494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:00.264494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:00.264494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:00.264494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:00.264494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:00.264494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:00.264494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:00.264494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:00.264494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:00.264494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:00.271806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 126/247] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:00.283502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27427316-93f9-40e9-bdca-b5deb60b03de None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:00.300623 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9ee9b-2e91-492c-8907-54c6ec85bde0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:00.338940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50d9c3-a2e1-4cc0-a977-e94b557c31e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:00.340467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50d9c3-a2e1-4cc0-a977-e94b557c31e1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:00.340958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50d9c3-a2e1-4cc0-a977-e94b557c31e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:00.341487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50d9c3-a2e1-4cc0-a977-e94b557c31e1 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:00.343431 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50d9c3-a2e1-4cc0-a977-e94b557c31e1 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:00.345729 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50d9c3-a2e1-4cc0-a977-e94b557c31e1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:00.348043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 122/248] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:00 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:00.360328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50d9c3-a2e1-4cc0-a977-e94b557c31e1 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:00.567519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27427316-93f9-40e9-bdca-b5deb60b03de None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:00.632370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53957cb0-21b0-47c4-ae64-a87149ae9fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:00.633056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53957cb0-21b0-47c4-ae64-a87149ae9fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:00.633342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53957cb0-21b0-47c4-ae64-a87149ae9fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:00.633619 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53957cb0-21b0-47c4-ae64-a87149ae9fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:00.634377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53957cb0-21b0-47c4-ae64-a87149ae9fc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:00.634714 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53957cb0-21b0-47c4-ae64-a87149ae9fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:00.636120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53957cb0-21b0-47c4-ae64-a87149ae9fc1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:00.640669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50d9c3-a2e1-4cc0-a977-e94b557c31e1 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:00.642418 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:00.645248 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:00.664997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 127/249] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:00.669941 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53957cb0-21b0-47c4-ae64-a87149ae9fc1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:00.712686 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e569ca-cfe2-4390-82e5-5c3302452395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:00.713358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e569ca-cfe2-4390-82e5-5c3302452395 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:00.713646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e569ca-cfe2-4390-82e5-5c3302452395 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:00.713931 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e569ca-cfe2-4390-82e5-5c3302452395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:00.714816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e569ca-cfe2-4390-82e5-5c3302452395 None admin] RBAC: Adding query filter params (role.id=f7aa69fd565d4a948224949d5ce35c0b, scope.project.id=e5669c2ec4584aa9afe502b8365fd982, user.id=c50ec105b3c64e84b316a28c91823882) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:00.715132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e569ca-cfe2-4390-82e5-5c3302452395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:00.716588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e569ca-cfe2-4390-82e5-5c3302452395 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:00.728781 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 123/250] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:00 2022] GET /identity/v3/role_assignments?user.id=c50ec105b3c64e84b316a28c91823882&scope.project.id=e5669c2ec4584aa9afe502b8365fd982&role.id=f7aa69fd565d4a948224949d5ce35c0b => generated 259 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:00.823992 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53957cb0-21b0-47c4-ae64-a87149ae9fc1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:00.878955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c407a-f5fb-40ea-b2e6-451bf88e1953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:00.879915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c407a-f5fb-40ea-b2e6-451bf88e1953 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:00.880207 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c407a-f5fb-40ea-b2e6-451bf88e1953 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:00.880487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c407a-f5fb-40ea-b2e6-451bf88e1953 None admin] PATH_INFO: `/v3/users/b2b8ca3e84ae4ee28633d89a2dd71073` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:00.881777 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c407a-f5fb-40ea-b2e6-451bf88e1953 None admin] RBAC: Authorizing `identity:get_user(user_id=b2b8ca3e84ae4ee28633d89a2dd71073)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:00.883311 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c407a-f5fb-40ea-b2e6-451bf88e1953 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:00.885064 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 128/251] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:03:00 2022] GET /identity/v3/users/b2b8ca3e84ae4ee28633d89a2dd71073 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:00.891048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e569ca-cfe2-4390-82e5-5c3302452395 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:01.032522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e569ca-cfe2-4390-82e5-5c3302452395 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:01.075743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c5f05-207f-45fa-a845-29d435244e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:01.076564 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c5f05-207f-45fa-a845-29d435244e81 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:01.076848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c5f05-207f-45fa-a845-29d435244e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:01.077126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c5f05-207f-45fa-a845-29d435244e81 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:01.079423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c5f05-207f-45fa-a845-29d435244e81 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:01.080974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c5f05-207f-45fa-a845-29d435244e81 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:01.086895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 124/252] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:00 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:01.092806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c407a-f5fb-40ea-b2e6-451bf88e1953 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:01.187421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:01.199553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2ab3-47c9-4db3-b41b-0983562d0c62 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:01.199850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2ab3-47c9-4db3-b41b-0983562d0c62 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:01.200117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2ab3-47c9-4db3-b41b-0983562d0c62 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:01.201604 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 125/253] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:01.209578 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0f66b-0eef-438f-81d2-eb31c6ceade2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:01.209872 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0f66b-0eef-438f-81d2-eb31c6ceade2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:01.210153 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0f66b-0eef-438f-81d2-eb31c6ceade2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:01.235832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a7e0f66b-0eef-438f-81d2-eb31c6ceade2 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:01.237617 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a7e0f66b-0eef-438f-81d2-eb31c6ceade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:01.253120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c407a-f5fb-40ea-b2e6-451bf88e1953 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:01.300365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:01.345810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720a0f0-a62f-482e-8962-da1d51493f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:01.345810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720a0f0-a62f-482e-8962-da1d51493f39 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:01.345810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720a0f0-a62f-482e-8962-da1d51493f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:01.345810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720a0f0-a62f-482e-8962-da1d51493f39 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982/users/b2b8ca3e84ae4ee28633d89a2dd71073/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:01.355275 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720a0f0-a62f-482e-8962-da1d51493f39 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5669c2ec4584aa9afe502b8365fd982, user_id=b2b8ca3e84ae4ee28633d89a2dd71073, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:01.356767 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720a0f0-a62f-482e-8962-da1d51493f39 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:01.373329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 126/254] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:01.385674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 129/255] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:03:01 2022] PUT /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982/users/b2b8ca3e84ae4ee28633d89a2dd71073/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:03:01.407424 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0f66b-0eef-438f-81d2-eb31c6ceade2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:01.573804 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0f66b-0eef-438f-81d2-eb31c6ceade2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:01.626797 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd30744-438a-467c-a612-115623c6be06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:01.627550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd30744-438a-467c-a612-115623c6be06 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:01.627843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd30744-438a-467c-a612-115623c6be06 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:01.628129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd30744-438a-467c-a612-115623c6be06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:01.651768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46ed05-6e0c-47aa-b312-76e6ca72fc71 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:01.652090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46ed05-6e0c-47aa-b312-76e6ca72fc71 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:01.652324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46ed05-6e0c-47aa-b312-76e6ca72fc71 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:01.652734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd30744-438a-467c-a612-115623c6be06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:01.653724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 130/256] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:01.659731 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4b6c4-95d8-43a3-9e07-e09649bcebb9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:01.660195 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4b6c4-95d8-43a3-9e07-e09649bcebb9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:01.660482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4b6c4-95d8-43a3-9e07-e09649bcebb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-9bd30744-438a-467c-a612-115623c6be06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:01.661553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:01.662402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:01.663226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:01.663226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:01.663226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:01.663226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:01.663226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:01.663226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:01.663226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:01.663226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:01.663226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:01.663226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:01.663226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:03:01.663226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:01.671399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 127/257] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:03:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:01.678934 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd30744-438a-467c-a612-115623c6be06 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:01.697471 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-48a4b6c4-95d8-43a3-9e07-e09649bcebb9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:01.698728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-48a4b6c4-95d8-43a3-9e07-e09649bcebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:01.738816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:01.848514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 131/258] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:03:01.879558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd30744-438a-467c-a612-115623c6be06 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:01.908896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4b6c4-95d8-43a3-9e07-e09649bcebb9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:01.947872 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31ade8-cd4c-48b5-9f75-72d5ae4a8f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:01.948556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31ade8-cd4c-48b5-9f75-72d5ae4a8f2f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:01.948845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31ade8-cd4c-48b5-9f75-72d5ae4a8f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:01.949127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31ade8-cd4c-48b5-9f75-72d5ae4a8f2f None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:01.949888 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31ade8-cd4c-48b5-9f75-72d5ae4a8f2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:01.950199 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31ade8-cd4c-48b5-9f75-72d5ae4a8f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:01.956205 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31ade8-cd4c-48b5-9f75-72d5ae4a8f2f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:01.981614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 128/259] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:01.988214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31ade8-cd4c-48b5-9f75-72d5ae4a8f2f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:02.020658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:02.097424 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4b6c4-95d8-43a3-9e07-e09649bcebb9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:02.122824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:02.143216 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31ade8-cd4c-48b5-9f75-72d5ae4a8f2f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:02.161705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e87f49-631e-408d-bff6-d022ef264ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:02.162573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e87f49-631e-408d-bff6-d022ef264ddd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:02.162861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e87f49-631e-408d-bff6-d022ef264ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:02.163146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e87f49-631e-408d-bff6-d022ef264ddd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:02.182236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e87f49-631e-408d-bff6-d022ef264ddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-38e87f49-631e-408d-bff6-d022ef264ddd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:02.194873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:02.195775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:02.196812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:02.196812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:02.196812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:02.196812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:02.196812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:02.196812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:02.196812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:02.196812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:02.196812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:02.196812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:02.196812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:02.196812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:02.196812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 132/260] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:03:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:02.205073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e87f49-631e-408d-bff6-d022ef264ddd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:02.212873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661bbd-3dc2-47e2-bbc5-15b08fa1f175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:02.213768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661bbd-3dc2-47e2-bbc5-15b08fa1f175 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:02.214055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661bbd-3dc2-47e2-bbc5-15b08fa1f175 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:02.214340 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661bbd-3dc2-47e2-bbc5-15b08fa1f175 None admin] PATH_INFO: `/v3/users/d5aeccb3fcf8484eb3fb640f8f8425ef` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:02.217619 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02661bbd-3dc2-47e2-bbc5-15b08fa1f175 None admin] RBAC: Authorizing `identity:get_user(user_id=d5aeccb3fcf8484eb3fb640f8f8425ef)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:02.224044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02661bbd-3dc2-47e2-bbc5-15b08fa1f175 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:02.225982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 129/261] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:03:01 2022] GET /identity/v3/users/d5aeccb3fcf8484eb3fb640f8f8425ef => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:02.231445 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661bbd-3dc2-47e2-bbc5-15b08fa1f175 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:02.334347 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e87f49-631e-408d-bff6-d022ef264ddd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:02.352510 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:02.379985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661bbd-3dc2-47e2-bbc5-15b08fa1f175 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:02.394220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade5918-cecf-43aa-b4d6-efff6181534d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:02.394856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade5918-cecf-43aa-b4d6-efff6181534d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:02.395128 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade5918-cecf-43aa-b4d6-efff6181534d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:02.395398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade5918-cecf-43aa-b4d6-efff6181534d None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:02.396151 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade5918-cecf-43aa-b4d6-efff6181534d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:02.396459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade5918-cecf-43aa-b4d6-efff6181534d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:02.397840 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade5918-cecf-43aa-b4d6-efff6181534d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:02.417379 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 133/262] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:02.421384 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade5918-cecf-43aa-b4d6-efff6181534d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:02.453081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481a1aa-60cc-4bb2-a200-1ff8f7b51416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:02.453890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481a1aa-60cc-4bb2-a200-1ff8f7b51416 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:02.454178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481a1aa-60cc-4bb2-a200-1ff8f7b51416 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:02.454479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481a1aa-60cc-4bb2-a200-1ff8f7b51416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:02.484115 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:02.582166 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481a1aa-60cc-4bb2-a200-1ff8f7b51416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:02.583708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481a1aa-60cc-4bb2-a200-1ff8f7b51416 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:02.679231 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade5918-cecf-43aa-b4d6-efff6181534d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:02.737307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 130/263] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 16:03:02.743313 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481a1aa-60cc-4bb2-a200-1ff8f7b51416 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:02.843829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23c524-1ce3-4e07-8d5d-3dd3a7b01a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:02.845280 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23c524-1ce3-4e07-8d5d-3dd3a7b01a70 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:02.845573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23c524-1ce3-4e07-8d5d-3dd3a7b01a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:02.845855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23c524-1ce3-4e07-8d5d-3dd3a7b01a70 None admin] PATH_INFO: `/v3/users/d5aeccb3fcf8484eb3fb640f8f8425ef` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:02.846766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:02.848701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23c524-1ce3-4e07-8d5d-3dd3a7b01a70 None admin] RBAC: Authorizing `identity:get_user(user_id=d5aeccb3fcf8484eb3fb640f8f8425ef)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:02.850204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23c524-1ce3-4e07-8d5d-3dd3a7b01a70 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:02.852101 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 134/264] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:03:02 2022] GET /identity/v3/users/d5aeccb3fcf8484eb3fb640f8f8425ef => generated 283 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:02.857318 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23c524-1ce3-4e07-8d5d-3dd3a7b01a70 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:02.918972 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481a1aa-60cc-4bb2-a200-1ff8f7b51416 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:02.979814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3f698-6fae-4c0a-8c9f-92ee9e453d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:02.980628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3f698-6fae-4c0a-8c9f-92ee9e453d23 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:02.980911 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3f698-6fae-4c0a-8c9f-92ee9e453d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:02.981180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3f698-6fae-4c0a-8c9f-92ee9e453d23 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:02.984998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3f698-6fae-4c0a-8c9f-92ee9e453d23 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:02.986548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3f698-6fae-4c0a-8c9f-92ee9e453d23 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:02.988808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 131/265] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:02 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:02.994875 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3f698-6fae-4c0a-8c9f-92ee9e453d23 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:03.035095 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:03.117795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23c524-1ce3-4e07-8d5d-3dd3a7b01a70 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:03.158490 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3f698-6fae-4c0a-8c9f-92ee9e453d23 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:03.163913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158a61f-ae58-46ff-a1f6-18f4e6eb6ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:03.164680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158a61f-ae58-46ff-a1f6-18f4e6eb6ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:03.165068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158a61f-ae58-46ff-a1f6-18f4e6eb6ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:03.165436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158a61f-ae58-46ff-a1f6-18f4e6eb6ad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:03.186305 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:03.200049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a6441-e1ec-4ed6-8806-535894552948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:03.201008 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a6441-e1ec-4ed6-8806-535894552948 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:03.201494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a6441-e1ec-4ed6-8806-535894552948 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:03.201993 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a6441-e1ec-4ed6-8806-535894552948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:03.203790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a6441-e1ec-4ed6-8806-535894552948 None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=e5669c2ec4584aa9afe502b8365fd982, user.id=d5aeccb3fcf8484eb3fb640f8f8425ef) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:03.204327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a6441-e1ec-4ed6-8806-535894552948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:03.205987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a6441-e1ec-4ed6-8806-535894552948 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:03.216728 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 132/266] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:02 2022] GET /identity/v3/role_assignments?user.id=d5aeccb3fcf8484eb3fb640f8f8425ef&scope.project.id=e5669c2ec4584aa9afe502b8365fd982&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:03.225008 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba46d70-918a-40cb-81a0-885e15426f0b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:03.225647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba46d70-918a-40cb-81a0-885e15426f0b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:03.226131 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba46d70-918a-40cb-81a0-885e15426f0b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:03.227821 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 133/267] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:03.229295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a40ef-7ce0-44ee-80dd-afec2f1cc2ce None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:03.229796 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a40ef-7ce0-44ee-80dd-afec2f1cc2ce None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:03.230327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a40ef-7ce0-44ee-80dd-afec2f1cc2ce None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:03.231788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 134/268] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:03.236178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902a210-1dcf-4c1a-927a-6659bbf5e534 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:03.236731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902a210-1dcf-4c1a-927a-6659bbf5e534 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:03.237246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902a210-1dcf-4c1a-927a-6659bbf5e534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:03.261247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b902a210-1dcf-4c1a-927a-6659bbf5e534 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:03.262904 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b902a210-1dcf-4c1a-927a-6659bbf5e534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:03.299145 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158a61f-ae58-46ff-a1f6-18f4e6eb6ad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:03.300668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158a61f-ae58-46ff-a1f6-18f4e6eb6ad5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:03.390867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:03.449657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 135/269] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:03.450696 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 135/270] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:03.451320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10081c2f-7254-4973-b216-1793587b5aca None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:03.452138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10081c2f-7254-4973-b216-1793587b5aca None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:03.452138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10081c2f-7254-4973-b216-1793587b5aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:03.457831 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158a61f-ae58-46ff-a1f6-18f4e6eb6ad5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:03.482232 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-10081c2f-7254-4973-b216-1793587b5aca None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:03.484503 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-10081c2f-7254-4973-b216-1793587b5aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:03.578173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 136/271] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:03.579643 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10081c2f-7254-4973-b216-1793587b5aca None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:03.630059 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:03.636549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158a61f-ae58-46ff-a1f6-18f4e6eb6ad5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:03.690021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd33a43-1f82-487b-9945-4aa82f1aa730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:03.691573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd33a43-1f82-487b-9945-4aa82f1aa730 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:03.692083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd33a43-1f82-487b-9945-4aa82f1aa730 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:03.692586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd33a43-1f82-487b-9945-4aa82f1aa730 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:03.694186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd33a43-1f82-487b-9945-4aa82f1aa730 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:03.696020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd33a43-1f82-487b-9945-4aa82f1aa730 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:03.698591 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 136/272] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:03 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:03.699692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd33a43-1f82-487b-9945-4aa82f1aa730 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:03.708345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10081c2f-7254-4973-b216-1793587b5aca None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:03.719297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:03.751425 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eb060-520b-405d-8e38-ad7705f93aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:03.752153 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb060-520b-405d-8e38-ad7705f93aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:03.752436 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb060-520b-405d-8e38-ad7705f93aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:03.752709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb060-520b-405d-8e38-ad7705f93aa5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:03.764061 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eb060-520b-405d-8e38-ad7705f93aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-ba2eb060-520b-405d-8e38-ad7705f93aa5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:03.772614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:03.773557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:03.774339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:03.774339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:03.774339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:03.774339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:03.774339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:03.774339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:03.774339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:03.774339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:03.774339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:03.774339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:03.774339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:03.774339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:03.774339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 137/273] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:03.777724 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eb060-520b-405d-8e38-ad7705f93aa5 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:03.825589 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd33a43-1f82-487b-9945-4aa82f1aa730 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:03.861367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4428b-14c1-4ca5-9be8-d5d623c18a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:03.862220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4428b-14c1-4ca5-9be8-d5d623c18a35 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:03.862529 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4428b-14c1-4ca5-9be8-d5d623c18a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:03.862802 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4428b-14c1-4ca5-9be8-d5d623c18a35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:03.863981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4428b-14c1-4ca5-9be8-d5d623c18a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:03.865429 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4428b-14c1-4ca5-9be8-d5d623c18a35 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:03.871484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 137/274] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:03.871484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a4bf5-13bc-482f-b9be-157390c38f3e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:03.871484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a4bf5-13bc-482f-b9be-157390c38f3e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:03.871484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a4bf5-13bc-482f-b9be-157390c38f3e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:03.871484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 138/275] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:03.871484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a4bf5-13bc-482f-b9be-157390c38f3e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:03.891513 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eb060-520b-405d-8e38-ad7705f93aa5 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:03.899556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:03.932144 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597734e-28dd-45d0-b51e-0ab63debf185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:03.932811 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597734e-28dd-45d0-b51e-0ab63debf185 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:03.933096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597734e-28dd-45d0-b51e-0ab63debf185 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:03.933375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597734e-28dd-45d0-b51e-0ab63debf185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:03.934214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597734e-28dd-45d0-b51e-0ab63debf185 None admin] RBAC: Adding query filter params (role.id=255c2b4827324109a6d2068c8b0316c3, scope.project.id=e5669c2ec4584aa9afe502b8365fd982, user.id=d5aeccb3fcf8484eb3fb640f8f8425ef) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:03.934568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597734e-28dd-45d0-b51e-0ab63debf185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:03.936036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597734e-28dd-45d0-b51e-0ab63debf185 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:03.950463 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 138/276] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:03 2022] GET /identity/v3/role_assignments?user.id=d5aeccb3fcf8484eb3fb640f8f8425ef&scope.project.id=e5669c2ec4584aa9afe502b8365fd982&role.id=255c2b4827324109a6d2068c8b0316c3 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:03.950463 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597734e-28dd-45d0-b51e-0ab63debf185 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:03.980699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:04.008850 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a4bf5-13bc-482f-b9be-157390c38f3e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:04.060344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadab09-d5df-4c8a-a3ce-1c72d2c76109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:04.061329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadab09-d5df-4c8a-a3ce-1c72d2c76109 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:04.062146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadab09-d5df-4c8a-a3ce-1c72d2c76109 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:04.062484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadab09-d5df-4c8a-a3ce-1c72d2c76109 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:04.063543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadab09-d5df-4c8a-a3ce-1c72d2c76109 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:04.063859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadab09-d5df-4c8a-a3ce-1c72d2c76109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:04.066164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadab09-d5df-4c8a-a3ce-1c72d2c76109 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:04.074494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597734e-28dd-45d0-b51e-0ab63debf185 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:04.080509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 139/277] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:04.082223 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1391d3-3c9e-498b-a6d5-1f2a504969b0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:04.082748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1391d3-3c9e-498b-a6d5-1f2a504969b0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:04.083222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1391d3-3c9e-498b-a6d5-1f2a504969b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:04.111149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ca1391d3-3c9e-498b-a6d5-1f2a504969b0 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:04.112394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ca1391d3-3c9e-498b-a6d5-1f2a504969b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:04.125849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51a303-549f-4cd9-94d5-436d07fda4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:04.126694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51a303-549f-4cd9-94d5-436d07fda4ff None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:04.126978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51a303-549f-4cd9-94d5-436d07fda4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:04.127252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51a303-549f-4cd9-94d5-436d07fda4ff None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:04.129370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51a303-549f-4cd9-94d5-436d07fda4ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:04.129562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51a303-549f-4cd9-94d5-436d07fda4ff None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:04.152532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 139/278] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:03:03 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:03:04.153579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51a303-549f-4cd9-94d5-436d07fda4ff None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:04.190677 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:04.209851 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 140/279] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:04.240993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1391d3-3c9e-498b-a6d5-1f2a504969b0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:04.293981 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51a303-549f-4cd9-94d5-436d07fda4ff None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:04.347503 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbff9cb-db12-4763-a3d9-28e990768cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:04.349161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbff9cb-db12-4763-a3d9-28e990768cef None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:04.349161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbff9cb-db12-4763-a3d9-28e990768cef None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:04.349161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbff9cb-db12-4763-a3d9-28e990768cef None admin] PATH_INFO: `/v3/users/73935cc4a8a84689b9beda3cb91cc841` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:04.359115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:04.378011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbff9cb-db12-4763-a3d9-28e990768cef None admin] RBAC: Authorizing `identity:get_user(user_id=73935cc4a8a84689b9beda3cb91cc841)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:04.379553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbff9cb-db12-4763-a3d9-28e990768cef None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:04.382323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 140/280] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:03:04 2022] GET /identity/v3/users/73935cc4a8a84689b9beda3cb91cc841 => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:04.389098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbff9cb-db12-4763-a3d9-28e990768cef None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:04.404975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1391d3-3c9e-498b-a6d5-1f2a504969b0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:04.449143 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966ce46-a188-4d6b-81be-eca7d9aa11b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:04.450087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966ce46-a188-4d6b-81be-eca7d9aa11b7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:04.450374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966ce46-a188-4d6b-81be-eca7d9aa11b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:04.450681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966ce46-a188-4d6b-81be-eca7d9aa11b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:04.464055 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966ce46-a188-4d6b-81be-eca7d9aa11b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-7966ce46-a188-4d6b-81be-eca7d9aa11b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:04.472784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:04.473883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:04.474817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:04.474817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:04.474817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:04.474817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:04.474817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:04.474817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:04.474817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:04.474817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:04.474817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:04.474817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:04.474817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:03:04.474817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:04.474817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 141/281] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:03:04.481477 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966ce46-a188-4d6b-81be-eca7d9aa11b7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:04.504646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:04.530466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbff9cb-db12-4763-a3d9-28e990768cef None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:04.574453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219f84b-f433-4602-9232-321d7c01d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:04.575064 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219f84b-f433-4602-9232-321d7c01d80c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:04.575354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219f84b-f433-4602-9232-321d7c01d80c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:04.575632 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219f84b-f433-4602-9232-321d7c01d80c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:04.576503 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219f84b-f433-4602-9232-321d7c01d80c None admin] RBAC: Adding query filter params (role.id=2c5988d189bd4b4482fb3649b9cf1de4, user.id=73935cc4a8a84689b9beda3cb91cc841, scope.system=all) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:04.576816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219f84b-f433-4602-9232-321d7c01d80c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:04.580732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219f84b-f433-4602-9232-321d7c01d80c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:04.588246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 141/282] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jun 16 16:03:04 2022] GET /identity/v3/role_assignments?user.id=73935cc4a8a84689b9beda3cb91cc841&scope.system=all&role.id=2c5988d189bd4b4482fb3649b9cf1de4 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:04.615047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966ce46-a188-4d6b-81be-eca7d9aa11b7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:04.659291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7b2e0-28d7-4d4c-ade0-601f7f98a86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:04.660031 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7b2e0-28d7-4d4c-ade0-601f7f98a86b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:04.660321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7b2e0-28d7-4d4c-ade0-601f7f98a86b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:04.660598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7b2e0-28d7-4d4c-ade0-601f7f98a86b None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:04.661369 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7b2e0-28d7-4d4c-ade0-601f7f98a86b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:04.661680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7b2e0-28d7-4d4c-ade0-601f7f98a86b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:04.663163 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7b2e0-28d7-4d4c-ade0-601f7f98a86b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:04.665760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:04.667285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976415d-0561-46e2-8495-f05522e9e8f5 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:04.667577 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976415d-0561-46e2-8495-f05522e9e8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:04.667879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976415d-0561-46e2-8495-f05522e9e8f5 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:04.669307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 142/283] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:03:04.676078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e0b0e-b799-4dcc-83f1-7c4280bd3db9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:04.676394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e0b0e-b799-4dcc-83f1-7c4280bd3db9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:04.676643 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e0b0e-b799-4dcc-83f1-7c4280bd3db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:04.677082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 142/284] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:04.682517 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7b2e0-28d7-4d4c-ade0-601f7f98a86b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:04.708549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-569e0b0e-b799-4dcc-83f1-7c4280bd3db9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:04.710218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-569e0b0e-b799-4dcc-83f1-7c4280bd3db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:04.811237 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 143/285] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:03:04.820868 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7b2e0-28d7-4d4c-ade0-601f7f98a86b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:04.838026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e0b0e-b799-4dcc-83f1-7c4280bd3db9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:04.860518 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134b7c3-1c0a-4a39-9de2-f85eb89e0c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:04.861789 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134b7c3-1c0a-4a39-9de2-f85eb89e0c3a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:04.861933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134b7c3-1c0a-4a39-9de2-f85eb89e0c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:04.862156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134b7c3-1c0a-4a39-9de2-f85eb89e0c3a None admin] PATH_INFO: `/v3/users/c50ec105b3c64e84b316a28c91823882` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:04.863519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134b7c3-1c0a-4a39-9de2-f85eb89e0c3a None admin] RBAC: Authorizing `identity:get_user(user_id=c50ec105b3c64e84b316a28c91823882)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:04.865062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134b7c3-1c0a-4a39-9de2-f85eb89e0c3a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:04.867252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 143/286] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:03:04 2022] GET /identity/v3/users/c50ec105b3c64e84b316a28c91823882 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:04.872944 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134b7c3-1c0a-4a39-9de2-f85eb89e0c3a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:04.978219 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:05.002367 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e0b0e-b799-4dcc-83f1-7c4280bd3db9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:05.021487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:05.067305 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3756816-c353-4f52-aa9a-84f24a7ca3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:05.068569 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3756816-c353-4f52-aa9a-84f24a7ca3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:05.071944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3756816-c353-4f52-aa9a-84f24a7ca3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:05.072431 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3756816-c353-4f52-aa9a-84f24a7ca3a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:05.093368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3756816-c353-4f52-aa9a-84f24a7ca3a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:05.096275 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134b7c3-1c0a-4a39-9de2-f85eb89e0c3a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-a3756816-c353-4f52-aa9a-84f24a7ca3a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:05.104363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:05.105261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:05.106055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:05.106055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:05.106055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:05.106055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:05.106055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:05.106055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:05.106055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:05.106055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:05.106055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:05.106055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:05.106055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:05.106055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:05.116117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 144/287] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:03:05.123459 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3756816-c353-4f52-aa9a-84f24a7ca3a9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:05.183130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d75b1-cd0e-45e1-8e55-e0929b1dae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:05.184016 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d75b1-cd0e-45e1-8e55-e0929b1dae71 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:05.184306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d75b1-cd0e-45e1-8e55-e0929b1dae71 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:05.184587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d75b1-cd0e-45e1-8e55-e0929b1dae71 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:05.185920 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d75b1-cd0e-45e1-8e55-e0929b1dae71 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:05.187748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d75b1-cd0e-45e1-8e55-e0929b1dae71 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:05.189775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 144/288] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:04 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:05.197462 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d75b1-cd0e-45e1-8e55-e0929b1dae71 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:05.250592 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3756816-c353-4f52-aa9a-84f24a7ca3a9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:05.312556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d610295-091e-4ac5-9d0f-02a5a9f4d434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:05.314038 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d610295-091e-4ac5-9d0f-02a5a9f4d434 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:05.315187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d610295-091e-4ac5-9d0f-02a5a9f4d434 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:05.317099 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d610295-091e-4ac5-9d0f-02a5a9f4d434 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:05.318109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d610295-091e-4ac5-9d0f-02a5a9f4d434 None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:05.320081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d610295-091e-4ac5-9d0f-02a5a9f4d434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:05.321980 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d610295-091e-4ac5-9d0f-02a5a9f4d434 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:05.336094 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:05.344408 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 145/289] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:05.358585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d610295-091e-4ac5-9d0f-02a5a9f4d434 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:05.422636 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d75b1-cd0e-45e1-8e55-e0929b1dae71 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:05.455136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:05.460412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb99ba2-cb7c-4821-b621-ce078f54b777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:05.461317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb99ba2-cb7c-4821-b621-ce078f54b777 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:05.461603 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb99ba2-cb7c-4821-b621-ce078f54b777 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:05.461884 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb99ba2-cb7c-4821-b621-ce078f54b777 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982/users/c50ec105b3c64e84b316a28c91823882/roles/f7aa69fd565d4a948224949d5ce35c0b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:05.463964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb99ba2-cb7c-4821-b621-ce078f54b777 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5669c2ec4584aa9afe502b8365fd982, user_id=c50ec105b3c64e84b316a28c91823882, role_id=f7aa69fd565d4a948224949d5ce35c0b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:05.465449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb99ba2-cb7c-4821-b621-ce078f54b777 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:05.482370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 145/290] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:03:05 2022] PUT /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982/users/c50ec105b3c64e84b316a28c91823882/roles/f7aa69fd565d4a948224949d5ce35c0b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:03:05.558524 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d610295-091e-4ac5-9d0f-02a5a9f4d434 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:05.597905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad0d33-cc90-44c3-857c-5e5cf819e09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:05.599206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad0d33-cc90-44c3-857c-5e5cf819e09f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:05.599743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad0d33-cc90-44c3-857c-5e5cf819e09f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:05.600219 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad0d33-cc90-44c3-857c-5e5cf819e09f None admin] PATH_INFO: `/v3/users/b2b8ca3e84ae4ee28633d89a2dd71073` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:05.601818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad0d33-cc90-44c3-857c-5e5cf819e09f None admin] RBAC: Authorizing `identity:get_user(user_id=b2b8ca3e84ae4ee28633d89a2dd71073)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:05.603590 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad0d33-cc90-44c3-857c-5e5cf819e09f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:05.605862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 146/291] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:03:05 2022] GET /identity/v3/users/b2b8ca3e84ae4ee28633d89a2dd71073 => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:05.612414 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb99ba2-cb7c-4821-b621-ce078f54b777 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:05.758592 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb99ba2-cb7c-4821-b621-ce078f54b777 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:05.796905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdfcd4-fc1f-41f0-a058-54319c45930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:05.797571 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdfcd4-fc1f-41f0-a058-54319c45930d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:05.797854 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdfcd4-fc1f-41f0-a058-54319c45930d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:05.798130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdfcd4-fc1f-41f0-a058-54319c45930d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:05.872676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:05.886661 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdfcd4-fc1f-41f0-a058-54319c45930d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:05.888218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdfcd4-fc1f-41f0-a058-54319c45930d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:06.023477 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 146/292] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:06.029504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad0d33-cc90-44c3-857c-5e5cf819e09f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:06.117072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:06.166950 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad0d33-cc90-44c3-857c-5e5cf819e09f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:06.219247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68dcbe-ec2b-41ae-b802-8a06e49d9302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:06.220500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68dcbe-ec2b-41ae-b802-8a06e49d9302 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:06.220986 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68dcbe-ec2b-41ae-b802-8a06e49d9302 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:06.221489 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68dcbe-ec2b-41ae-b802-8a06e49d9302 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:06.222908 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68dcbe-ec2b-41ae-b802-8a06e49d9302 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:06.224578 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68dcbe-ec2b-41ae-b802-8a06e49d9302 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:06.226539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 147/293] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:06 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:06.232513 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdfcd4-fc1f-41f0-a058-54319c45930d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:06.358490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:06.373225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdfcd4-fc1f-41f0-a058-54319c45930d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:06.428168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf19fc-e2f5-4057-ba64-18bf09cad5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:06.428843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf19fc-e2f5-4057-ba64-18bf09cad5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:06.429127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf19fc-e2f5-4057-ba64-18bf09cad5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:06.429404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf19fc-e2f5-4057-ba64-18bf09cad5a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:06.430244 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf19fc-e2f5-4057-ba64-18bf09cad5a4 None admin] RBAC: Adding query filter params (role.id=2c5988d189bd4b4482fb3649b9cf1de4, scope.project.id=e5669c2ec4584aa9afe502b8365fd982, user.id=b2b8ca3e84ae4ee28633d89a2dd71073) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:06.430586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf19fc-e2f5-4057-ba64-18bf09cad5a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:06.432030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf19fc-e2f5-4057-ba64-18bf09cad5a4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:06.443226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 147/294] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:06 2022] GET /identity/v3/role_assignments?user.id=b2b8ca3e84ae4ee28633d89a2dd71073&scope.project.id=e5669c2ec4584aa9afe502b8365fd982&role.id=2c5988d189bd4b4482fb3649b9cf1de4 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:07.036073 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a64c4-bfea-481a-8bdb-9df72b356311 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:07.036576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a64c4-bfea-481a-8bdb-9df72b356311 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:07.036836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a64c4-bfea-481a-8bdb-9df72b356311 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:07.039223 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 148/295] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:07.044971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edb065-d48e-423f-b79c-bac43bed9a23 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:07.045621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edb065-d48e-423f-b79c-bac43bed9a23 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:07.046825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edb065-d48e-423f-b79c-bac43bed9a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:07.067803 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f6edb065-d48e-423f-b79c-bac43bed9a23 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:07.069000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f6edb065-d48e-423f-b79c-bac43bed9a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:07.145970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 148/296] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:07.170210 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a64c4-bfea-481a-8bdb-9df72b356311 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:07.177536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95337d2-97c7-4c02-adaf-9b1ac495bf32 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:07.178107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95337d2-97c7-4c02-adaf-9b1ac495bf32 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:07.178653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95337d2-97c7-4c02-adaf-9b1ac495bf32 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:07.180561 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 149/297] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:03:07.185841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5132e-3610-4a1d-9aad-bbb02084e5e3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:07.186365 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5132e-3610-4a1d-9aad-bbb02084e5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:07.186958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5132e-3610-4a1d-9aad-bbb02084e5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:07.205273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-39a5132e-3610-4a1d-9aad-bbb02084e5e3 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:07.207179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-39a5132e-3610-4a1d-9aad-bbb02084e5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:07.306544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 150/298] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:03:07.307775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a64c4-bfea-481a-8bdb-9df72b356311 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:07.330224 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5132e-3610-4a1d-9aad-bbb02084e5e3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:07.347854 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8417a0-0dd3-4969-9855-03e54b3cbbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:07.348927 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8417a0-0dd3-4969-9855-03e54b3cbbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:07.349372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8417a0-0dd3-4969-9855-03e54b3cbbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:07.349501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:07.349648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8417a0-0dd3-4969-9855-03e54b3cbbd2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:07.353334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:07.366699 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8417a0-0dd3-4969-9855-03e54b3cbbd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-2e8417a0-0dd3-4969-9855-03e54b3cbbd2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:07.376819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:07.377694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:07.383790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:07.383790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:07.383790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:07.383790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:07.383790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:07.383790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:07.383790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:07.383790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:07.383790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:07.383790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:07.383790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:03:07.383790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:07.383790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 149/299] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:07.383790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee18dd3-6c12-4a16-8f73-34a37b3325b2 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:07.384485 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee18dd3-6c12-4a16-8f73-34a37b3325b2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:07.384485 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee18dd3-6c12-4a16-8f73-34a37b3325b2 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:07.384485 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 150/300] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:07.386258 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee18dd3-6c12-4a16-8f73-34a37b3325b2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:07.447346 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5132e-3610-4a1d-9aad-bbb02084e5e3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:07.484674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536c547-270e-484f-804f-3723cd0f7df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:07.485478 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536c547-270e-484f-804f-3723cd0f7df2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:07.485760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536c547-270e-484f-804f-3723cd0f7df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:07.486037 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536c547-270e-484f-804f-3723cd0f7df2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:07.487481 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536c547-270e-484f-804f-3723cd0f7df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:07.488953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536c547-270e-484f-804f-3723cd0f7df2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:07.490838 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 151/301] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:07.494614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d8b9c-e61d-4225-befc-29cd84c4846c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:07.494614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d8b9c-e61d-4225-befc-29cd84c4846c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:07.494614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d8b9c-e61d-4225-befc-29cd84c4846c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:07.500553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee18dd3-6c12-4a16-8f73-34a37b3325b2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:07.511157 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f57d8b9c-e61d-4225-befc-29cd84c4846c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:07.512341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f57d8b9c-e61d-4225-befc-29cd84c4846c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:07.538902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be808e2a-c95f-4acc-b71d-0e9218992f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:07.539577 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be808e2a-c95f-4acc-b71d-0e9218992f4c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:07.540027 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be808e2a-c95f-4acc-b71d-0e9218992f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:07.540467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be808e2a-c95f-4acc-b71d-0e9218992f4c None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:07.541357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be808e2a-c95f-4acc-b71d-0e9218992f4c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:07.541807 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be808e2a-c95f-4acc-b71d-0e9218992f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:07.543375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be808e2a-c95f-4acc-b71d-0e9218992f4c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:07.553777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 151/302] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:07.554798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be808e2a-c95f-4acc-b71d-0e9218992f4c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:07.586511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 152/303] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:07.591365 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d8b9c-e61d-4225-befc-29cd84c4846c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:07.614687 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:07.629287 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:07.678812 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be808e2a-c95f-4acc-b71d-0e9218992f4c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:07.709453 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d8b9c-e61d-4225-befc-29cd84c4846c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:07.720633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727978b-5e3c-44c9-976a-f9373f47901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:07.721320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727978b-5e3c-44c9-976a-f9373f47901b None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:07.721610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727978b-5e3c-44c9-976a-f9373f47901b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:07.721895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727978b-5e3c-44c9-976a-f9373f47901b None admin] PATH_INFO: `/v3/groups` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:07.722640 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727978b-5e3c-44c9-976a-f9373f47901b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:07.724237 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727978b-5e3c-44c9-976a-f9373f47901b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:07.750481 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 152/304] 10.222.0.48 () {60 vars in 1134 bytes} [Thu Jun 16 16:03:07 2022] POST /identity/v3/groups => generated 229 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:03:07.750481 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727978b-5e3c-44c9-976a-f9373f47901b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:07.755973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf22a19-0d3f-4444-aeb0-053360bc7c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:07.757616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf22a19-0d3f-4444-aeb0-053360bc7c27 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:07.757949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf22a19-0d3f-4444-aeb0-053360bc7c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:07.758233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf22a19-0d3f-4444-aeb0-053360bc7c27 None admin] PATH_INFO: `/v3/users/64db51493456412ea327f9eab6520453` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:07.777396 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf22a19-0d3f-4444-aeb0-053360bc7c27 None admin] RBAC: Authorizing `identity:get_user(user_id=64db51493456412ea327f9eab6520453)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:07.779663 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf22a19-0d3f-4444-aeb0-053360bc7c27 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:07.782221 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 153/305] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:03:07 2022] GET /identity/v3/users/64db51493456412ea327f9eab6520453 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:07.789630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf22a19-0d3f-4444-aeb0-053360bc7c27 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:07.870076 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727978b-5e3c-44c9-976a-f9373f47901b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:07.890047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:07.914743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d95023-b4ab-44eb-92c6-d816d48de2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:07.915608 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d95023-b4ab-44eb-92c6-d816d48de2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:07.915960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d95023-b4ab-44eb-92c6-d816d48de2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:07.916235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d95023-b4ab-44eb-92c6-d816d48de2d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:07.916558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:07.930879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d95023-b4ab-44eb-92c6-d816d48de2d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-27d95023-b4ab-44eb-92c6-d816d48de2d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:07.941536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:07.942495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:07.943307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:07.943307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:07.943307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:07.943307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:07.943307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:07.943307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:07.943307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:07.943307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:07.943307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:07.943307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:07.943307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:07.943307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:07.943307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 153/306] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:07.950236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d95023-b4ab-44eb-92c6-d816d48de2d9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:07.959701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf22a19-0d3f-4444-aeb0-053360bc7c27 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:08.025811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e19d3b-cebb-4417-b851-27463f85a0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:08.026521 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e19d3b-cebb-4417-b851-27463f85a0cd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:08.026810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e19d3b-cebb-4417-b851-27463f85a0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:08.027085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e19d3b-cebb-4417-b851-27463f85a0cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:08.027934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e19d3b-cebb-4417-b851-27463f85a0cd None admin] RBAC: Adding query filter params (role.id=f7aa69fd565d4a948224949d5ce35c0b, user.id=64db51493456412ea327f9eab6520453, scope.system=all) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:08.028242 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e19d3b-cebb-4417-b851-27463f85a0cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:08.030246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e19d3b-cebb-4417-b851-27463f85a0cd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:08.038902 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 154/307] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jun 16 16:03:07 2022] GET /identity/v3/role_assignments?user.id=64db51493456412ea327f9eab6520453&scope.system=all&role.id=f7aa69fd565d4a948224949d5ce35c0b => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:08.139409 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d95023-b4ab-44eb-92c6-d816d48de2d9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:08.201156 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfcac3-3935-45d8-8d00-4fad90c80175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:08.201854 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfcac3-3935-45d8-8d00-4fad90c80175 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:08.202140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfcac3-3935-45d8-8d00-4fad90c80175 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:08.202569 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfcac3-3935-45d8-8d00-4fad90c80175 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:08.203820 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfcac3-3935-45d8-8d00-4fad90c80175 None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:08.204353 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfcac3-3935-45d8-8d00-4fad90c80175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:08.206527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfcac3-3935-45d8-8d00-4fad90c80175 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:08.206963 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4ee7-4479-48d6-b970-db857136e563 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:08.207451 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4ee7-4479-48d6-b970-db857136e563 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:08.207931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4ee7-4479-48d6-b970-db857136e563 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:08.209835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 155/308] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:03:08.215983 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4fb86-ae08-4070-b36c-42c81ae1cbd1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:08.216608 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4fb86-ae08-4070-b36c-42c81ae1cbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:08.217089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4fb86-ae08-4070-b36c-42c81ae1cbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:08.230480 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 154/309] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:08.236170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfcac3-3935-45d8-8d00-4fad90c80175 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:08.246296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-aff4fb86-ae08-4070-b36c-42c81ae1cbd1 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:08.248047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aff4fb86-ae08-4070-b36c-42c81ae1cbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:08.308892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:08.361131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 156/310] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:03:08.387628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4fb86-ae08-4070-b36c-42c81ae1cbd1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:08.400856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfcac3-3935-45d8-8d00-4fad90c80175 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:08.447187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0862600-d288-42a7-a8bd-b95d68562e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:08.448559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0862600-d288-42a7-a8bd-b95d68562e1b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:08.449149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0862600-d288-42a7-a8bd-b95d68562e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:08.449629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0862600-d288-42a7-a8bd-b95d68562e1b None admin] PATH_INFO: `/v3/users/73935cc4a8a84689b9beda3cb91cc841` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:08.451257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0862600-d288-42a7-a8bd-b95d68562e1b None admin] RBAC: Authorizing `identity:get_user(user_id=73935cc4a8a84689b9beda3cb91cc841)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:08.454257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0862600-d288-42a7-a8bd-b95d68562e1b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:08.456803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 155/311] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:03:08 2022] GET /identity/v3/users/73935cc4a8a84689b9beda3cb91cc841 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:08.463409 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0862600-d288-42a7-a8bd-b95d68562e1b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:08.464022 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:08.509470 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4fb86-ae08-4070-b36c-42c81ae1cbd1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:08.554536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80d252-2d8f-4d64-afc1-f93442ac4262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:08.554536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80d252-2d8f-4d64-afc1-f93442ac4262 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:08.554536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80d252-2d8f-4d64-afc1-f93442ac4262 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:08.554536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80d252-2d8f-4d64-afc1-f93442ac4262 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:08.568142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80d252-2d8f-4d64-afc1-f93442ac4262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8e80d252-2d8f-4d64-afc1-f93442ac4262 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:08.577825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:08.580635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:08.581538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:08.581538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:08.581538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:08.581538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:08.581538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:08.581538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:08.581538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:08.581538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:08.581538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:08.581538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:08.581538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:03:08.581538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:08.585530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 157/312] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:08.586739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80d252-2d8f-4d64-afc1-f93442ac4262 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:08.638872 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0862600-d288-42a7-a8bd-b95d68562e1b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:08.654708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:08.690409 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d40d7-47d6-4a94-bd75-b5a2605392f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:08.691847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d40d7-47d6-4a94-bd75-b5a2605392f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:08.692257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d40d7-47d6-4a94-bd75-b5a2605392f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:08.692638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d40d7-47d6-4a94-bd75-b5a2605392f7 None admin] PATH_INFO: `/v3/system/users/73935cc4a8a84689b9beda3cb91cc841/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:08.694472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d40d7-47d6-4a94-bd75-b5a2605392f7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=73935cc4a8a84689b9beda3cb91cc841, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:08.696082 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d40d7-47d6-4a94-bd75-b5a2605392f7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:08.713418 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 156/313] 10.222.0.48 () {58 vars in 1334 bytes} [Thu Jun 16 16:03:08 2022] PUT /identity/v3/system/users/73935cc4a8a84689b9beda3cb91cc841/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:03:08.724911 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80d252-2d8f-4d64-afc1-f93442ac4262 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:08.756772 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:08.768295 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad964519-bb78-4693-8356-56be2596e8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:08.768985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad964519-bb78-4693-8356-56be2596e8db None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:08.769266 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad964519-bb78-4693-8356-56be2596e8db None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:08.769542 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad964519-bb78-4693-8356-56be2596e8db None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:08.770300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad964519-bb78-4693-8356-56be2596e8db None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:08.770639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad964519-bb78-4693-8356-56be2596e8db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:08.772080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad964519-bb78-4693-8356-56be2596e8db None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:08.783545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 158/314] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:08.789517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d40d7-47d6-4a94-bd75-b5a2605392f7 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:08.920121 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d40d7-47d6-4a94-bd75-b5a2605392f7 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:08.964949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0499f-e01a-42bd-a10d-a4e54a608b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:08.965837 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0499f-e01a-42bd-a10d-a4e54a608b2e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:08.966120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0499f-e01a-42bd-a10d-a4e54a608b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:08.966396 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0499f-e01a-42bd-a10d-a4e54a608b2e None admin] PATH_INFO: `/v3/users/c50ec105b3c64e84b316a28c91823882` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:08.967633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0499f-e01a-42bd-a10d-a4e54a608b2e None admin] RBAC: Authorizing `identity:get_user(user_id=c50ec105b3c64e84b316a28c91823882)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:08.969122 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0499f-e01a-42bd-a10d-a4e54a608b2e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:08.971207 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 157/315] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:03:08 2022] GET /identity/v3/users/c50ec105b3c64e84b316a28c91823882 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:08.976705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad964519-bb78-4693-8356-56be2596e8db None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:09.093402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad964519-bb78-4693-8356-56be2596e8db None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:09.129306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10728d9c-b6b5-446b-b47d-98569c864db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:09.129974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10728d9c-b6b5-446b-b47d-98569c864db4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:09.130256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10728d9c-b6b5-446b-b47d-98569c864db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:09.130559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10728d9c-b6b5-446b-b47d-98569c864db4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:09.190268 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:09.208705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10728d9c-b6b5-446b-b47d-98569c864db4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:09.210534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10728d9c-b6b5-446b-b47d-98569c864db4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:09.339996 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 159/316] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:09.346182 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0499f-e01a-42bd-a10d-a4e54a608b2e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:09.395954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:09.461554 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0499f-e01a-42bd-a10d-a4e54a608b2e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:09.497454 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b0ba5-4c7c-4139-b0aa-39bb6aa376b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:09.498329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b0ba5-4c7c-4139-b0aa-39bb6aa376b8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:09.498639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b0ba5-4c7c-4139-b0aa-39bb6aa376b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:09.498915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b0ba5-4c7c-4139-b0aa-39bb6aa376b8 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:09.500753 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b0ba5-4c7c-4139-b0aa-39bb6aa376b8 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:09.502222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b0ba5-4c7c-4139-b0aa-39bb6aa376b8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:09.504310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 158/317] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:09 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:09.510292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10728d9c-b6b5-446b-b47d-98569c864db4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:09.618537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:09.635569 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10728d9c-b6b5-446b-b47d-98569c864db4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:09.685448 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70b0df-34e3-43f0-9cf4-079e3ab2c242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:09.686112 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70b0df-34e3-43f0-9cf4-079e3ab2c242 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:09.686393 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70b0df-34e3-43f0-9cf4-079e3ab2c242 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:09.686725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70b0df-34e3-43f0-9cf4-079e3ab2c242 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:09.687564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70b0df-34e3-43f0-9cf4-079e3ab2c242 None admin] RBAC: Adding query filter params (role.id=f7aa69fd565d4a948224949d5ce35c0b, scope.project.id=e5669c2ec4584aa9afe502b8365fd982, user.id=c50ec105b3c64e84b316a28c91823882) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:09.687878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70b0df-34e3-43f0-9cf4-079e3ab2c242 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:09.689304 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70b0df-34e3-43f0-9cf4-079e3ab2c242 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:09.695557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 160/318] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:09 2022] GET /identity/v3/role_assignments?user.id=c50ec105b3c64e84b316a28c91823882&scope.project.id=e5669c2ec4584aa9afe502b8365fd982&role.id=f7aa69fd565d4a948224949d5ce35c0b => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:10.129272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64c21f-126a-4536-a041-b9a94d5754a3 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:10.129677 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64c21f-126a-4536-a041-b9a94d5754a3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:10.129877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64c21f-126a-4536-a041-b9a94d5754a3 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:10.131393 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 159/319] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:10.136405 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86f106-c258-4619-a3c1-fb8399623069 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:10.136749 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86f106-c258-4619-a3c1-fb8399623069 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:10.137031 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86f106-c258-4619-a3c1-fb8399623069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:10.154822 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5b86f106-c258-4619-a3c1-fb8399623069 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:10.156694 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5b86f106-c258-4619-a3c1-fb8399623069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:10.229266 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 161/320] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:10.252088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64c21f-126a-4536-a041-b9a94d5754a3 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:10.379204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64c21f-126a-4536-a041-b9a94d5754a3 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:10.390776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:10.421006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911f45a-0831-4370-8b6c-9903c47b4d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:10.422179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911f45a-0831-4370-8b6c-9903c47b4d02 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:10.422702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911f45a-0831-4370-8b6c-9903c47b4d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:10.423158 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911f45a-0831-4370-8b6c-9903c47b4d02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:10.424879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911f45a-0831-4370-8b6c-9903c47b4d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:10.426538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911f45a-0831-4370-8b6c-9903c47b4d02 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:10.428645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 160/321] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:10.433912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86f106-c258-4619-a3c1-fb8399623069 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:10.444861 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313adcc-f120-4196-95cd-ee32953b7519 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:10.445170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313adcc-f120-4196-95cd-ee32953b7519 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:10.445432 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313adcc-f120-4196-95cd-ee32953b7519 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:10.447240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 161/322] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:10.452110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c1d37-ce65-43bb-ac7e-61eeaba00351 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:10.453129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c1d37-ce65-43bb-ac7e-61eeaba00351 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:10.453458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c1d37-ce65-43bb-ac7e-61eeaba00351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:10.474258 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3f3c1d37-ce65-43bb-ac7e-61eeaba00351 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:10.475939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3f3c1d37-ce65-43bb-ac7e-61eeaba00351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:10.526165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:10.549860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86f106-c258-4619-a3c1-fb8399623069 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:10.550737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 162/323] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:03:10.573007 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c1d37-ce65-43bb-ac7e-61eeaba00351 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:10.588661 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3343ef-ea97-446e-8a07-175377a04270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:10.589363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3343ef-ea97-446e-8a07-175377a04270 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:10.589651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3343ef-ea97-446e-8a07-175377a04270 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:10.589929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3343ef-ea97-446e-8a07-175377a04270 None admin] PATH_INFO: `/v3/groups` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:10.590957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3343ef-ea97-446e-8a07-175377a04270 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:10.592413 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3343ef-ea97-446e-8a07-175377a04270 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:10.610417 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 162/324] 10.222.0.48 () {60 vars in 1134 bytes} [Thu Jun 16 16:03:10 2022] POST /identity/v3/groups => generated 226 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:03:10.695857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c1d37-ce65-43bb-ac7e-61eeaba00351 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:10.705627 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:10.737937 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d5b38-b47b-43f9-b97e-f2d47efd7221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:10.738801 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d5b38-b47b-43f9-b97e-f2d47efd7221 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:10.739089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d5b38-b47b-43f9-b97e-f2d47efd7221 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:10.739370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d5b38-b47b-43f9-b97e-f2d47efd7221 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:10.752853 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d5b38-b47b-43f9-b97e-f2d47efd7221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-417d5b38-b47b-43f9-b97e-f2d47efd7221 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:10.760350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:10.761331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:10.762138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:10.762138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:10.762138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:10.762138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:10.762138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:10.762138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:10.762138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:10.762138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:10.762138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:10.762138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:10.762138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:03:10.762138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:10.762138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 163/325] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:03:10.769301 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3343ef-ea97-446e-8a07-175377a04270 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:10.884851 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3343ef-ea97-446e-8a07-175377a04270 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:10.919422 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295017c7-ee7c-4eac-9570-e4bb7e4171bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:10.920097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295017c7-ee7c-4eac-9570-e4bb7e4171bb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:10.920378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295017c7-ee7c-4eac-9570-e4bb7e4171bb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:10.920651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295017c7-ee7c-4eac-9570-e4bb7e4171bb None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:10.922191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295017c7-ee7c-4eac-9570-e4bb7e4171bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:10.922559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295017c7-ee7c-4eac-9570-e4bb7e4171bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:10.923920 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295017c7-ee7c-4eac-9570-e4bb7e4171bb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:10.932624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 163/326] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:10.938092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d5b38-b47b-43f9-b97e-f2d47efd7221 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:11.051322 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d5b38-b47b-43f9-b97e-f2d47efd7221 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:11.088564 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07638a35-8942-4335-94e9-8c627305f49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:11.089745 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07638a35-8942-4335-94e9-8c627305f49d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:11.090202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07638a35-8942-4335-94e9-8c627305f49d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:11.090677 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07638a35-8942-4335-94e9-8c627305f49d None admin] PATH_INFO: `/v3/users/64db51493456412ea327f9eab6520453` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:11.092128 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07638a35-8942-4335-94e9-8c627305f49d None admin] RBAC: Authorizing `identity:get_user(user_id=64db51493456412ea327f9eab6520453)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:11.094902 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e4c4e-1297-4a68-bec8-ddc76991274a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:11.095393 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e4c4e-1297-4a68-bec8-ddc76991274a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:11.095845 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e4c4e-1297-4a68-bec8-ddc76991274a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:11.096872 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07638a35-8942-4335-94e9-8c627305f49d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:11.097594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 164/327] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:03:11.098870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 164/328] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:03:10 2022] GET /identity/v3/users/64db51493456412ea327f9eab6520453 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:11.104693 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216b7c0-bb79-4ede-9d33-f2d990950444 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:11.104979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216b7c0-bb79-4ede-9d33-f2d990950444 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:11.105256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216b7c0-bb79-4ede-9d33-f2d990950444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:11.110601 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07638a35-8942-4335-94e9-8c627305f49d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:11.115055 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:11.126991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9216b7c0-bb79-4ede-9d33-f2d990950444 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:11.133140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9216b7c0-bb79-4ede-9d33-f2d990950444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:11.154904 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:11.235944 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 165/329] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:11.269848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216b7c0-bb79-4ede-9d33-f2d990950444 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:11.270311 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07638a35-8942-4335-94e9-8c627305f49d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:11.329145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eaf8a-203c-42c8-b9dd-db3ec819da80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:11.330231 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eaf8a-203c-42c8-b9dd-db3ec819da80 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:11.330544 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eaf8a-203c-42c8-b9dd-db3ec819da80 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:11.330829 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eaf8a-203c-42c8-b9dd-db3ec819da80 None admin] PATH_INFO: `/v3/system/users/64db51493456412ea327f9eab6520453/roles/f7aa69fd565d4a948224949d5ce35c0b` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:11.332613 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24eaf8a-203c-42c8-b9dd-db3ec819da80 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=64db51493456412ea327f9eab6520453, role_id=f7aa69fd565d4a948224949d5ce35c0b)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:11.334491 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24eaf8a-203c-42c8-b9dd-db3ec819da80 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:11.346778 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 165/330] 10.222.0.48 () {58 vars in 1334 bytes} [Thu Jun 16 16:03:11 2022] PUT /identity/v3/system/users/64db51493456412ea327f9eab6520453/roles/f7aa69fd565d4a948224949d5ce35c0b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:03:11.409796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216b7c0-bb79-4ede-9d33-f2d990950444 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:11.451513 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b40a58-89d5-447b-9970-d0441fdfd304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:11.453179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b40a58-89d5-447b-9970-d0441fdfd304 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:11.453809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b40a58-89d5-447b-9970-d0441fdfd304 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:11.454284 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b40a58-89d5-447b-9970-d0441fdfd304 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:11.457143 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:11.469155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b40a58-89d5-447b-9970-d0441fdfd304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f1b40a58-89d5-447b-9970-d0441fdfd304 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:11.479595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:11.480549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:11.481339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:11.481339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:11.481339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:11.481339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:11.481339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:11.481339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:11.481339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:11.481339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:11.481339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:11.481339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:11.481339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:11.481339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:11.481339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 166/331] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:11.487426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eaf8a-203c-42c8-b9dd-db3ec819da80 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:11.619728 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:11.625387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eaf8a-203c-42c8-b9dd-db3ec819da80 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:11.666116 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c0f57-43c9-48df-a993-c3bf83fa5a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:11.666833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c0f57-43c9-48df-a993-c3bf83fa5a21 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:11.667114 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c0f57-43c9-48df-a993-c3bf83fa5a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:11.667392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c0f57-43c9-48df-a993-c3bf83fa5a21 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:11.668154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c0f57-43c9-48df-a993-c3bf83fa5a21 None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:11.668459 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c0f57-43c9-48df-a993-c3bf83fa5a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:11.669968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c0f57-43c9-48df-a993-c3bf83fa5a21 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:11.679793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 166/332] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:11.685498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b40a58-89d5-447b-9970-d0441fdfd304 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:11.799488 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b40a58-89d5-447b-9970-d0441fdfd304 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:11.836416 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8adbd-ae6e-471b-a9f7-0d4d09244c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:11.837294 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8adbd-ae6e-471b-a9f7-0d4d09244c73 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:11.837573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8adbd-ae6e-471b-a9f7-0d4d09244c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:11.837846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8adbd-ae6e-471b-a9f7-0d4d09244c73 None admin] PATH_INFO: `/v3/users/73935cc4a8a84689b9beda3cb91cc841` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:11.839107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8adbd-ae6e-471b-a9f7-0d4d09244c73 None admin] RBAC: Authorizing `identity:get_user(user_id=73935cc4a8a84689b9beda3cb91cc841)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:11.840624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8adbd-ae6e-471b-a9f7-0d4d09244c73 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:11.842586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 167/333] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:03:11 2022] GET /identity/v3/users/73935cc4a8a84689b9beda3cb91cc841 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:11.848502 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c0f57-43c9-48df-a993-c3bf83fa5a21 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:11.976762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c0f57-43c9-48df-a993-c3bf83fa5a21 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:12.016929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379ddd5-edbb-45ef-8e86-cffe2b5a0589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:12.017956 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379ddd5-edbb-45ef-8e86-cffe2b5a0589 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:12.018303 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379ddd5-edbb-45ef-8e86-cffe2b5a0589 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:12.018648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379ddd5-edbb-45ef-8e86-cffe2b5a0589 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:12.019729 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379ddd5-edbb-45ef-8e86-cffe2b5a0589 None admin] RBAC: Adding query filter params (role.id=2c5988d189bd4b4482fb3649b9cf1de4, user.id=73935cc4a8a84689b9beda3cb91cc841, scope.system=all) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:12.020175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379ddd5-edbb-45ef-8e86-cffe2b5a0589 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:12.021954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379ddd5-edbb-45ef-8e86-cffe2b5a0589 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:12.038557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 167/334] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jun 16 16:03:11 2022] GET /identity/v3/role_assignments?user.id=73935cc4a8a84689b9beda3cb91cc841&scope.system=all&role.id=2c5988d189bd4b4482fb3649b9cf1de4 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:13.562828 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f90d0c-2480-4634-8072-c5c7e9917973 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:13.563843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f90d0c-2480-4634-8072-c5c7e9917973 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:13.564335 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f90d0c-2480-4634-8072-c5c7e9917973 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:13.566194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 168/335] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:13.571581 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc17c5-5c64-4f32-af9c-9998d37d915a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:13.572426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc17c5-5c64-4f32-af9c-9998d37d915a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:13.572909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc17c5-5c64-4f32-af9c-9998d37d915a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:13.593475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e2dc17c5-5c64-4f32-af9c-9998d37d915a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:13.595149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e2dc17c5-5c64-4f32-af9c-9998d37d915a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:13.615730 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:13.686063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 168/336] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:13.728426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f90d0c-2480-4634-8072-c5c7e9917973 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:13.796480 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c5e4e-90cb-4ef0-b326-2e64c7edea59 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:13.797185 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c5e4e-90cb-4ef0-b326-2e64c7edea59 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:13.797661 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c5e4e-90cb-4ef0-b326-2e64c7edea59 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:13.800401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 169/337] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:03:13.811164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612838a-4c6a-42e0-9797-e090023dc9bb None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:13.812215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:13.812705 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612838a-4c6a-42e0-9797-e090023dc9bb None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:13.814101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612838a-4c6a-42e0-9797-e090023dc9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:13.843765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e612838a-4c6a-42e0-9797-e090023dc9bb None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:13.847456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e612838a-4c6a-42e0-9797-e090023dc9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:13.900093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f90d0c-2480-4634-8072-c5c7e9917973 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:13.966408 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 170/338] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:03:13.983165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e238146-da95-4545-94eb-d267f511b202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:13.984135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e238146-da95-4545-94eb-d267f511b202 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:13.984425 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e238146-da95-4545-94eb-d267f511b202 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:13.984707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e238146-da95-4545-94eb-d267f511b202 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:14.000896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e238146-da95-4545-94eb-d267f511b202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8e238146-da95-4545-94eb-d267f511b202 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:14.009125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:14.010074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:14.010952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:14.010952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:14.010952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:14.010952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:14.010952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:14.010952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:14.010952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:14.010952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:14.010952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:14.010952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:14.010952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:14.010952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:14.010952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 169/339] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:03:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:14.016954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612838a-4c6a-42e0-9797-e090023dc9bb None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:14.017217 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e238146-da95-4545-94eb-d267f511b202 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:14.135954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e238146-da95-4545-94eb-d267f511b202 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:14.162885 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:14.165354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:14.195096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612838a-4c6a-42e0-9797-e090023dc9bb None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:14.195324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd391339-4e65-4749-a1b6-7f993f7ba0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:14.195864 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd391339-4e65-4749-a1b6-7f993f7ba0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:14.196155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd391339-4e65-4749-a1b6-7f993f7ba0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:14.196696 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd391339-4e65-4749-a1b6-7f993f7ba0e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:14.197467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd391339-4e65-4749-a1b6-7f993f7ba0e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:14.197784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd391339-4e65-4749-a1b6-7f993f7ba0e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:14.199231 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd391339-4e65-4749-a1b6-7f993f7ba0e3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:14.208749 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 170/340] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:14.214205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd391339-4e65-4749-a1b6-7f993f7ba0e3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:14.255259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bfbce-6789-4db7-a737-eee1d6333640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:14.256418 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bfbce-6789-4db7-a737-eee1d6333640 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:14.256900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bfbce-6789-4db7-a737-eee1d6333640 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:14.257367 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bfbce-6789-4db7-a737-eee1d6333640 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:14.276762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bfbce-6789-4db7-a737-eee1d6333640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-9b1bfbce-6789-4db7-a737-eee1d6333640 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:14.295155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:14.296708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:14.297501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:14.297501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:14.297501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:14.297501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:14.297501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:14.297501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:14.297501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:14.297501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:14.297501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:14.297501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:14.297501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:14.297501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:14.301764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 171/341] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:14.307422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bfbce-6789-4db7-a737-eee1d6333640 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:14.386439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd391339-4e65-4749-a1b6-7f993f7ba0e3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:14.425224 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c06ed5-9db6-4b82-b3bf-69f5a7f83d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:14.425898 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c06ed5-9db6-4b82-b3bf-69f5a7f83d06 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:14.426179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c06ed5-9db6-4b82-b3bf-69f5a7f83d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:14.426557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c06ed5-9db6-4b82-b3bf-69f5a7f83d06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:14.468547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bfbce-6789-4db7-a737-eee1d6333640 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:14.492414 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:14.508049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275311a-ff6b-42c2-9586-00cd93386826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:14.508657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275311a-ff6b-42c2-9586-00cd93386826 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:14.508945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275311a-ff6b-42c2-9586-00cd93386826 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:14.509226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275311a-ff6b-42c2-9586-00cd93386826 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:14.509982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275311a-ff6b-42c2-9586-00cd93386826 None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:14.510290 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275311a-ff6b-42c2-9586-00cd93386826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:14.511713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275311a-ff6b-42c2-9586-00cd93386826 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:14.517617 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:14.523264 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 172/342] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:14.523860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c06ed5-9db6-4b82-b3bf-69f5a7f83d06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:14.527043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c06ed5-9db6-4b82-b3bf-69f5a7f83d06 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:14.533515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275311a-ff6b-42c2-9586-00cd93386826 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:14.701176 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 171/343] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 16:03:14.708028 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c06ed5-9db6-4b82-b3bf-69f5a7f83d06 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:14.771973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275311a-ff6b-42c2-9586-00cd93386826 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:14.824987 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:14.845074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c06ed5-9db6-4b82-b3bf-69f5a7f83d06 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:14.867194 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6025d0-d069-4c4f-8691-34e8846bee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:14.867879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6025d0-d069-4c4f-8691-34e8846bee68 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:14.868166 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6025d0-d069-4c4f-8691-34e8846bee68 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:14.868447 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6025d0-d069-4c4f-8691-34e8846bee68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:14.900471 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a4af8-3174-4e19-9687-a66f44b8347d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:14.901805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a4af8-3174-4e19-9687-a66f44b8347d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:14.906955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a4af8-3174-4e19-9687-a66f44b8347d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:14.907305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a4af8-3174-4e19-9687-a66f44b8347d None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:14.908665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a4af8-3174-4e19-9687-a66f44b8347d None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:14.910232 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a4af8-3174-4e19-9687-a66f44b8347d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:14.912118 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 172/344] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:14 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:14.913455 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a569f8-01ee-4e37-aff0-8583d50cb596 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:14.913735 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a569f8-01ee-4e37-aff0-8583d50cb596 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:14.914008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a569f8-01ee-4e37-aff0-8583d50cb596 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:14.915514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 173/345] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:14.920353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a569f8-01ee-4e37-aff0-8583d50cb596 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:14.968004 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:14.971842 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6025d0-d069-4c4f-8691-34e8846bee68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:14.973642 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6025d0-d069-4c4f-8691-34e8846bee68 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:15.081607 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a569f8-01ee-4e37-aff0-8583d50cb596 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:15.088484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 173/346] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 16:03:15.090009 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3073c-43a6-4a67-a6e5-d6f6ce41c2e7 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:15.090578 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3073c-43a6-4a67-a6e5-d6f6ce41c2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:15.091075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3073c-43a6-4a67-a6e5-d6f6ce41c2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:15.109480 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0bb3073c-43a6-4a67-a6e5-d6f6ce41c2e7 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:15.111045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0bb3073c-43a6-4a67-a6e5-d6f6ce41c2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:15.125112 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8e79d-6587-4490-ab6a-a7d900ff57b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:15.126017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8e79d-6587-4490-ab6a-a7d900ff57b3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:15.126311 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8e79d-6587-4490-ab6a-a7d900ff57b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:15.126618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8e79d-6587-4490-ab6a-a7d900ff57b3 None admin] PATH_INFO: `/v3/groups/8603b9badd944a858765bb119fa39bfe` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:15.139149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8e79d-6587-4490-ab6a-a7d900ff57b3 None admin] RBAC: Authorizing `identity:get_group(group_id=8603b9badd944a858765bb119fa39bfe)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:15.140882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8e79d-6587-4490-ab6a-a7d900ff57b3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:15.146540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 174/347] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 16 16:03:14 2022] GET /identity/v3/groups/8603b9badd944a858765bb119fa39bfe => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:15.147894 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e239b4c-06e4-4943-a150-71901eca15b7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:15.148181 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e239b4c-06e4-4943-a150-71901eca15b7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:15.148461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e239b4c-06e4-4943-a150-71901eca15b7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:15.149979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 175/348] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:15.151554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e239b4c-06e4-4943-a150-71901eca15b7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:15.175085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:15.228863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 174/349] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:15.230256 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb499a92-8f1a-4463-8599-ddea5e8f235b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:15.230726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb499a92-8f1a-4463-8599-ddea5e8f235b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:15.231015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb499a92-8f1a-4463-8599-ddea5e8f235b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:15.251157 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-bb499a92-8f1a-4463-8599-ddea5e8f235b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:15.252891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bb499a92-8f1a-4463-8599-ddea5e8f235b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:15.285640 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:15.315017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e239b4c-06e4-4943-a150-71901eca15b7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:15.348362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 175/350] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:15.349626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb499a92-8f1a-4463-8599-ddea5e8f235b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:15.362774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc806f-8362-4097-b4f7-5e2a869489a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:15.364075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc806f-8362-4097-b4f7-5e2a869489a4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:15.364561 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc806f-8362-4097-b4f7-5e2a869489a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:15.365042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc806f-8362-4097-b4f7-5e2a869489a4 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:15.366575 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc806f-8362-4097-b4f7-5e2a869489a4 None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:15.368637 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc806f-8362-4097-b4f7-5e2a869489a4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:15.371058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 176/351] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:15 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:15.372029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc806f-8362-4097-b4f7-5e2a869489a4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:15.488590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:15.504750 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb499a92-8f1a-4463-8599-ddea5e8f235b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:15.508649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc806f-8362-4097-b4f7-5e2a869489a4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:15.553398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef8dbd-4cc0-4e35-96bc-d4c4faeb1d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:15.554463 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef8dbd-4cc0-4e35-96bc-d4c4faeb1d32 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:15.554829 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef8dbd-4cc0-4e35-96bc-d4c4faeb1d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:15.555117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef8dbd-4cc0-4e35-96bc-d4c4faeb1d32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:15.555962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef8dbd-4cc0-4e35-96bc-d4c4faeb1d32 None admin] RBAC: Adding query filter params (group.id=8603b9badd944a858765bb119fa39bfe, role.id=255c2b4827324109a6d2068c8b0316c3, scope.project.id=815bcedbe8ea4401944309ac6a34f4d0) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:15.556273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef8dbd-4cc0-4e35-96bc-d4c4faeb1d32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:15.557717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef8dbd-4cc0-4e35-96bc-d4c4faeb1d32 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:15.559648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5cfe9-bab1-4c81-8fd2-d720858087c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:15.559648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5cfe9-bab1-4c81-8fd2-d720858087c5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:15.559854 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5cfe9-bab1-4c81-8fd2-d720858087c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:15.560030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5cfe9-bab1-4c81-8fd2-d720858087c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:15.566641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 176/352] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 16 16:03:15 2022] GET /identity/v3/role_assignments?group.id=8603b9badd944a858765bb119fa39bfe&scope.project.id=815bcedbe8ea4401944309ac6a34f4d0&role.id=255c2b4827324109a6d2068c8b0316c3 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:15.567371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef8dbd-4cc0-4e35-96bc-d4c4faeb1d32 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:15.580164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5cfe9-bab1-4c81-8fd2-d720858087c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ffa5cfe9-bab1-4c81-8fd2-d720858087c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:15.593598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:15.594648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:15.595514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:15.595514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:15.595514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:15.595514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:15.595514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:15.595514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:15.595514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:15.595514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:15.595514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:15.595514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:15.595514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 16:03:15.595514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:15.598859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 177/353] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:15.599999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5cfe9-bab1-4c81-8fd2-d720858087c5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:15.611634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:15.707050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef8dbd-4cc0-4e35-96bc-d4c4faeb1d32 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:15.738300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5cfe9-bab1-4c81-8fd2-d720858087c5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:15.750345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a3194-13ee-4043-b30a-d3810fee4bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:15.751418 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a3194-13ee-4043-b30a-d3810fee4bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:15.751810 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a3194-13ee-4043-b30a-d3810fee4bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:15.752194 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a3194-13ee-4043-b30a-d3810fee4bd4 None admin] PATH_INFO: `/v3/groups/8603b9badd944a858765bb119fa39bfe` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:15.753891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a3194-13ee-4043-b30a-d3810fee4bd4 None admin] RBAC: Authorizing `identity:get_group(group_id=8603b9badd944a858765bb119fa39bfe)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:15.755530 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a3194-13ee-4043-b30a-d3810fee4bd4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:15.757736 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 177/354] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 16 16:03:15 2022] GET /identity/v3/groups/8603b9badd944a858765bb119fa39bfe => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:15.763394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ee47d-fd0a-41d6-946f-09496786ae7b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:15.763792 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ee47d-fd0a-41d6-946f-09496786ae7b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:15.764087 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ee47d-fd0a-41d6-946f-09496786ae7b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:15.765905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 178/355] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:15.766946 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ee47d-fd0a-41d6-946f-09496786ae7b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:15.777188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c71e5-219c-4b39-9124-518cadbc868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:15.777998 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c71e5-219c-4b39-9124-518cadbc868a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:15.778287 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c71e5-219c-4b39-9124-518cadbc868a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:15.778598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c71e5-219c-4b39-9124-518cadbc868a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:15.790728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c71e5-219c-4b39-9124-518cadbc868a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-513c71e5-219c-4b39-9124-518cadbc868a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:15.799676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:15.800578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:15.801809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:15.801809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:15.801809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:15.801809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:15.801809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:15.801809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:15.801809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:15.801809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:15.801809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:15.801809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:15.801809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:15.801809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:15.801809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 178/356] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:15.802519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c71e5-219c-4b39-9124-518cadbc868a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:15.806344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:15.889259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ee47d-fd0a-41d6-946f-09496786ae7b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:15.894690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:15.918702 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c71e5-219c-4b39-9124-518cadbc868a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:15.933726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673831f9-57b9-491e-8513-4dc41b74b27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:15.934621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673831f9-57b9-491e-8513-4dc41b74b27e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:15.934980 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673831f9-57b9-491e-8513-4dc41b74b27e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:15.935420 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673831f9-57b9-491e-8513-4dc41b74b27e None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:15.936253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673831f9-57b9-491e-8513-4dc41b74b27e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:15.936660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673831f9-57b9-491e-8513-4dc41b74b27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:15.938172 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673831f9-57b9-491e-8513-4dc41b74b27e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:15.949315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 179/357] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:15.952538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bf255-915a-4d97-adec-35940a99fe9f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:15.952979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bf255-915a-4d97-adec-35940a99fe9f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:15.953353 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bf255-915a-4d97-adec-35940a99fe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:15.961008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d00f0-d1a9-4629-a1d1-b71ecaea307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:15.961699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d00f0-d1a9-4629-a1d1-b71ecaea307a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:15.961986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d00f0-d1a9-4629-a1d1-b71ecaea307a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:15.962270 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d00f0-d1a9-4629-a1d1-b71ecaea307a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:15.963187 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d00f0-d1a9-4629-a1d1-b71ecaea307a None admin] RBAC: Adding query filter params (group.id=8603b9badd944a858765bb119fa39bfe, role.id=2c5988d189bd4b4482fb3649b9cf1de4, scope.project.id=815bcedbe8ea4401944309ac6a34f4d0) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:15.963508 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d00f0-d1a9-4629-a1d1-b71ecaea307a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:15.965058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d00f0-d1a9-4629-a1d1-b71ecaea307a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:15.972999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 179/358] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 16 16:03:15 2022] GET /identity/v3/role_assignments?group.id=8603b9badd944a858765bb119fa39bfe&scope.project.id=815bcedbe8ea4401944309ac6a34f4d0&role.id=2c5988d189bd4b4482fb3649b9cf1de4 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:15.973725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d00f0-d1a9-4629-a1d1-b71ecaea307a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:15.979217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-780bf255-915a-4d97-adec-35940a99fe9f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:15.980537 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-780bf255-915a-4d97-adec-35940a99fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:16.055683 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:16.100445 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 180/359] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:16.101165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d00f0-d1a9-4629-a1d1-b71ecaea307a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:16.101346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bf255-915a-4d97-adec-35940a99fe9f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:16.143479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6877b4-ff2e-4060-8497-af06322eb373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:16.144099 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6877b4-ff2e-4060-8497-af06322eb373 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:16.145325 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6877b4-ff2e-4060-8497-af06322eb373 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:16.145616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6877b4-ff2e-4060-8497-af06322eb373 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:16.146403 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6877b4-ff2e-4060-8497-af06322eb373 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:16.146769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6877b4-ff2e-4060-8497-af06322eb373 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:16.148217 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6877b4-ff2e-4060-8497-af06322eb373 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:16.159145 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 180/360] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:16.160550 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39f252-89f7-4d43-803c-3eb228171944 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:16.160846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39f252-89f7-4d43-803c-3eb228171944 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:16.161131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39f252-89f7-4d43-803c-3eb228171944 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:16.165084 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 181/361] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:16.165507 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39f252-89f7-4d43-803c-3eb228171944 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:16.226416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:16.247951 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bf255-915a-4d97-adec-35940a99fe9f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:16.301077 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75deebc-33fd-4595-9ac7-0ea3abcde226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:16.303440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75deebc-33fd-4595-9ac7-0ea3abcde226 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:16.303733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75deebc-33fd-4595-9ac7-0ea3abcde226 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:16.304017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75deebc-33fd-4595-9ac7-0ea3abcde226 None admin] PATH_INFO: `/v3/users/64db51493456412ea327f9eab6520453` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:16.305326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75deebc-33fd-4595-9ac7-0ea3abcde226 None admin] RBAC: Authorizing `identity:get_user(user_id=64db51493456412ea327f9eab6520453)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:16.306836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75deebc-33fd-4595-9ac7-0ea3abcde226 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:16.314113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 181/362] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:03:16 2022] GET /identity/v3/users/64db51493456412ea327f9eab6520453 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:16.315128 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75deebc-33fd-4595-9ac7-0ea3abcde226 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:16.326680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39f252-89f7-4d43-803c-3eb228171944 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:16.366677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:16.376104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8f6cc-85e0-44f4-8a29-f7ca6b4b4bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:16.379169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8f6cc-85e0-44f4-8a29-f7ca6b4b4bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:16.379169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8f6cc-85e0-44f4-8a29-f7ca6b4b4bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:16.379169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8f6cc-85e0-44f4-8a29-f7ca6b4b4bf4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:16.393875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8f6cc-85e0-44f4-8a29-f7ca6b4b4bf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-43e8f6cc-85e0-44f4-8a29-f7ca6b4b4bf4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:16.405734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:16.407297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:16.408319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:16.408319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:16.408319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:16.408319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:16.408319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:16.408319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:16.408319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:16.408319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:16.408319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:16.408319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:16.408319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:16.408319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:16.408319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 182/363] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:03:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:16.408994 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bf691-d857-42f3-bf33-75bc001f7bfb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:16.408994 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bf691-d857-42f3-bf33-75bc001f7bfb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:16.409299 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bf691-d857-42f3-bf33-75bc001f7bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:16.438910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-591bf691-d857-42f3-bf33-75bc001f7bfb None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:16.440507 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-591bf691-d857-42f3-bf33-75bc001f7bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:16.476509 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75deebc-33fd-4595-9ac7-0ea3abcde226 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:16.519624 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bbf2f-a130-420f-9d22-8079c0c4056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:16.520563 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bbf2f-a130-420f-9d22-8079c0c4056f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:16.521024 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bbf2f-a130-420f-9d22-8079c0c4056f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:16.521482 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bbf2f-a130-420f-9d22-8079c0c4056f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:16.527676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 183/364] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:16.528447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bf691-d857-42f3-bf33-75bc001f7bfb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:16.558811 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:16.645329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bf691-d857-42f3-bf33-75bc001f7bfb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:16.645768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bbf2f-a130-420f-9d22-8079c0c4056f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:16.647690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bbf2f-a130-420f-9d22-8079c0c4056f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:16.684088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:16.704969 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a090838-4ede-4324-9f4d-c0c4da70bcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:16.705654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a090838-4ede-4324-9f4d-c0c4da70bcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:16.705948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a090838-4ede-4324-9f4d-c0c4da70bcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:16.706228 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a090838-4ede-4324-9f4d-c0c4da70bcb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:16.707195 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a090838-4ede-4324-9f4d-c0c4da70bcb5 None admin] RBAC: Adding query filter params (role.id=f7aa69fd565d4a948224949d5ce35c0b, user.id=64db51493456412ea327f9eab6520453, scope.system=all) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:16.707510 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a090838-4ede-4324-9f4d-c0c4da70bcb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:16.709026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a090838-4ede-4324-9f4d-c0c4da70bcb5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:16.725445 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 184/365] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jun 16 16:03:16 2022] GET /identity/v3/role_assignments?user.id=64db51493456412ea327f9eab6520453&scope.system=all&role.id=f7aa69fd565d4a948224949d5ce35c0b => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:16.726299 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a090838-4ede-4324-9f4d-c0c4da70bcb5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:16.791023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 182/366] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:16.791889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bbf2f-a130-420f-9d22-8079c0c4056f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:16.855180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:16.900861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a090838-4ede-4324-9f4d-c0c4da70bcb5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:16.915271 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bbf2f-a130-420f-9d22-8079c0c4056f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:16.959333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6336b-004a-4a1b-98b8-76b1d1804591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:16.960033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6336b-004a-4a1b-98b8-76b1d1804591 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:16.960321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6336b-004a-4a1b-98b8-76b1d1804591 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:16.960599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6336b-004a-4a1b-98b8-76b1d1804591 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:16.961586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6336b-004a-4a1b-98b8-76b1d1804591 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:16.961899 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6336b-004a-4a1b-98b8-76b1d1804591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:16.962553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb147e2c-bb38-47f5-9c55-664b3acf524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:16.963311 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6336b-004a-4a1b-98b8-76b1d1804591 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:16.963696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb147e2c-bb38-47f5-9c55-664b3acf524c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:16.964129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb147e2c-bb38-47f5-9c55-664b3acf524c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:16.964554 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb147e2c-bb38-47f5-9c55-664b3acf524c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:16.976760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 185/367] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:16.977639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6336b-004a-4a1b-98b8-76b1d1804591 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:16.978769 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb147e2c-bb38-47f5-9c55-664b3acf524c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-cb147e2c-bb38-47f5-9c55-664b3acf524c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:16.988492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:16.989628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:16.990639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:16.990639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:16.990639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:16.990639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:16.990639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:16.990639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:16.990639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:16.990639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:16.990639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:16.990639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:16.990639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:03:16.990639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:16.993047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 183/368] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:03:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:16.994012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb147e2c-bb38-47f5-9c55-664b3acf524c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:17.052834 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:17.122539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb147e2c-bb38-47f5-9c55-664b3acf524c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:17.138788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:17.164358 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6336b-004a-4a1b-98b8-76b1d1804591 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:17.166253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1db6d3-d569-49da-9a62-c352fee476aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:17.167146 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1db6d3-d569-49da-9a62-c352fee476aa None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:17.167649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1db6d3-d569-49da-9a62-c352fee476aa None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:17.168187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1db6d3-d569-49da-9a62-c352fee476aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:17.203634 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cffc31-d95f-42f0-b6c7-a60bf7998265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:17.204552 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cffc31-d95f-42f0-b6c7-a60bf7998265 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:17.204841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cffc31-d95f-42f0-b6c7-a60bf7998265 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:17.205122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cffc31-d95f-42f0-b6c7-a60bf7998265 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:17.206352 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cffc31-d95f-42f0-b6c7-a60bf7998265 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:17.207908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cffc31-d95f-42f0-b6c7-a60bf7998265 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:17.214090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 186/369] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:16 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:17.215194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cffc31-d95f-42f0-b6c7-a60bf7998265 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:17.259383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1db6d3-d569-49da-9a62-c352fee476aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:17.261988 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1db6d3-d569-49da-9a62-c352fee476aa None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:17.344498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cffc31-d95f-42f0-b6c7-a60bf7998265 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:17.353905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:17.387467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518c1b2-eb64-47f5-a017-e60c2de2fa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:17.388149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518c1b2-eb64-47f5-a017-e60c2de2fa50 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:17.388441 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518c1b2-eb64-47f5-a017-e60c2de2fa50 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:17.388715 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518c1b2-eb64-47f5-a017-e60c2de2fa50 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:17.389543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518c1b2-eb64-47f5-a017-e60c2de2fa50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:17.390594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518c1b2-eb64-47f5-a017-e60c2de2fa50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:17.392005 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518c1b2-eb64-47f5-a017-e60c2de2fa50 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:17.401470 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 187/370] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:17.402070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518c1b2-eb64-47f5-a017-e60c2de2fa50 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:17.417453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 184/371] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:17.418850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1db6d3-d569-49da-9a62-c352fee476aa None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:17.435419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:17.520087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518c1b2-eb64-47f5-a017-e60c2de2fa50 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:17.537869 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1db6d3-d569-49da-9a62-c352fee476aa None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:17.560613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208535fd-c889-470b-ba16-9de313d2cb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:17.562574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208535fd-c889-470b-ba16-9de313d2cb02 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:17.562870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208535fd-c889-470b-ba16-9de313d2cb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:17.563155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208535fd-c889-470b-ba16-9de313d2cb02 None admin] PATH_INFO: `/v3/groups/8603b9badd944a858765bb119fa39bfe` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:17.564428 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208535fd-c889-470b-ba16-9de313d2cb02 None admin] RBAC: Authorizing `identity:get_group(group_id=8603b9badd944a858765bb119fa39bfe)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:17.565915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208535fd-c889-470b-ba16-9de313d2cb02 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:17.571778 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 188/372] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 16 16:03:17 2022] GET /identity/v3/groups/8603b9badd944a858765bb119fa39bfe => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:17.571778 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208535fd-c889-470b-ba16-9de313d2cb02 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:17.587231 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e244c-d8df-4b1b-9afc-ba14b839e66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:17.588337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e244c-d8df-4b1b-9afc-ba14b839e66d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:17.588842 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e244c-d8df-4b1b-9afc-ba14b839e66d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:17.589416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e244c-d8df-4b1b-9afc-ba14b839e66d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:17.619491 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:17.671382 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e244c-d8df-4b1b-9afc-ba14b839e66d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:17.673465 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e244c-d8df-4b1b-9afc-ba14b839e66d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:17.688740 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208535fd-c889-470b-ba16-9de313d2cb02 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:17.690686 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:17.725564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed5e1e-517a-4b6a-acd4-c90e74dd0f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:17.726447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed5e1e-517a-4b6a-acd4-c90e74dd0f9b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:17.726808 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed5e1e-517a-4b6a-acd4-c90e74dd0f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:17.727018 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed5e1e-517a-4b6a-acd4-c90e74dd0f9b None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:17.728232 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed5e1e-517a-4b6a-acd4-c90e74dd0f9b None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:17.729697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed5e1e-517a-4b6a-acd4-c90e74dd0f9b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:17.731759 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 189/373] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:17 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:17.732554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed5e1e-517a-4b6a-acd4-c90e74dd0f9b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:17.798009 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 185/374] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:17.799508 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e244c-d8df-4b1b-9afc-ba14b839e66d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:17.846647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed5e1e-517a-4b6a-acd4-c90e74dd0f9b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:17.853746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:17.884987 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc4f62-361f-4044-adab-db5bb637d209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:17.885660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc4f62-361f-4044-adab-db5bb637d209 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:17.885999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc4f62-361f-4044-adab-db5bb637d209 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:17.886288 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc4f62-361f-4044-adab-db5bb637d209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:17.887214 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc4f62-361f-4044-adab-db5bb637d209 None admin] RBAC: Adding query filter params (group.id=8603b9badd944a858765bb119fa39bfe, role.id=2c5988d189bd4b4482fb3649b9cf1de4, scope.project.id=e5669c2ec4584aa9afe502b8365fd982) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:17.887541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc4f62-361f-4044-adab-db5bb637d209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:17.889119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc4f62-361f-4044-adab-db5bb637d209 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:17.902461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 190/375] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 16 16:03:17 2022] GET /identity/v3/role_assignments?group.id=8603b9badd944a858765bb119fa39bfe&scope.project.id=e5669c2ec4584aa9afe502b8365fd982&role.id=2c5988d189bd4b4482fb3649b9cf1de4 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:17.902461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc4f62-361f-4044-adab-db5bb637d209 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:17.929267 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e244c-d8df-4b1b-9afc-ba14b839e66d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:17.954464 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:17.992750 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc77e8e-0a71-4012-a6df-ea7357ff39ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:17.994007 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc77e8e-0a71-4012-a6df-ea7357ff39ea None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:17.994561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc77e8e-0a71-4012-a6df-ea7357ff39ea None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:17.995045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc77e8e-0a71-4012-a6df-ea7357ff39ea None admin] PATH_INFO: `/v3/groups/8603b9badd944a858765bb119fa39bfe` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:17.999497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc77e8e-0a71-4012-a6df-ea7357ff39ea None admin] RBAC: Authorizing `identity:get_group(group_id=8603b9badd944a858765bb119fa39bfe)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:18.001588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc77e8e-0a71-4012-a6df-ea7357ff39ea None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:18.003701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 186/376] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 16 16:03:17 2022] GET /identity/v3/groups/8603b9badd944a858765bb119fa39bfe => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:18.010530 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc77e8e-0a71-4012-a6df-ea7357ff39ea None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:18.026026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc4f62-361f-4044-adab-db5bb637d209 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:18.071599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aabb2-14a9-4494-a892-97bafb9f2394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:18.072483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aabb2-14a9-4494-a892-97bafb9f2394 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:18.072843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aabb2-14a9-4494-a892-97bafb9f2394 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:18.073134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aabb2-14a9-4494-a892-97bafb9f2394 None admin] PATH_INFO: `/v3/projects/95faccee4f0940e98a9d62a275c0548c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:18.074364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53aabb2-14a9-4494-a892-97bafb9f2394 None admin] RBAC: Authorizing `identity:get_project(project_id=95faccee4f0940e98a9d62a275c0548c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:18.075923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53aabb2-14a9-4494-a892-97bafb9f2394 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:18.083034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 191/377] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:17 2022] GET /identity/v3/projects/95faccee4f0940e98a9d62a275c0548c => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:18.085523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aabb2-14a9-4494-a892-97bafb9f2394 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:18.162879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:18.238134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aabb2-14a9-4494-a892-97bafb9f2394 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:18.252271 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc77e8e-0a71-4012-a6df-ea7357ff39ea None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:18.283491 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f0f50-fee0-4b02-a8f3-bfe529ab2929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:18.284377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f0f50-fee0-4b02-a8f3-bfe529ab2929 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:18.284824 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f0f50-fee0-4b02-a8f3-bfe529ab2929 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:18.285110 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f0f50-fee0-4b02-a8f3-bfe529ab2929 None admin] PATH_INFO: `/v3/groups/c913b61014fc4785b92b169d39ae4329` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:18.292460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f0f50-fee0-4b02-a8f3-bfe529ab2929 None admin] RBAC: Authorizing `identity:get_group(group_id=c913b61014fc4785b92b169d39ae4329)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:18.294333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f0f50-fee0-4b02-a8f3-bfe529ab2929 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:18.296861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 192/378] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 16 16:03:18 2022] GET /identity/v3/groups/c913b61014fc4785b92b169d39ae4329 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:18.298402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d7fe3-7b3c-471f-b5ec-cb3d2d7cd4ad None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:18.298547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485c898-4ad0-49e1-b64b-83510edcb10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:18.298736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d7fe3-7b3c-471f-b5ec-cb3d2d7cd4ad None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:18.298996 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d7fe3-7b3c-471f-b5ec-cb3d2d7cd4ad None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:18.299179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485c898-4ad0-49e1-b64b-83510edcb10f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:18.299468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485c898-4ad0-49e1-b64b-83510edcb10f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:18.299748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485c898-4ad0-49e1-b64b-83510edcb10f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:18.300590 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485c898-4ad0-49e1-b64b-83510edcb10f None admin] RBAC: Adding query filter params (group.id=8603b9badd944a858765bb119fa39bfe, role.id=255c2b4827324109a6d2068c8b0316c3, scope.project.id=e5669c2ec4584aa9afe502b8365fd982) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:18.300901 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485c898-4ad0-49e1-b64b-83510edcb10f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:18.301246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 193/379] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:18.303398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d7fe3-7b3c-471f-b5ec-cb3d2d7cd4ad None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:18.308822 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485c898-4ad0-49e1-b64b-83510edcb10f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:18.316165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 187/380] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 16 16:03:18 2022] GET /identity/v3/role_assignments?group.id=8603b9badd944a858765bb119fa39bfe&scope.project.id=e5669c2ec4584aa9afe502b8365fd982&role.id=255c2b4827324109a6d2068c8b0316c3 => generated 260 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:18.319889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada003e-e8a8-4b9d-930b-5f799edd97bd None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:18.320253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada003e-e8a8-4b9d-930b-5f799edd97bd None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:18.320540 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada003e-e8a8-4b9d-930b-5f799edd97bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:18.356368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-aada003e-e8a8-4b9d-930b-5f799edd97bd None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:18.357719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-aada003e-e8a8-4b9d-930b-5f799edd97bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:18.442835 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:18.487479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 188/381] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:18.507299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada003e-e8a8-4b9d-930b-5f799edd97bd None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:18.509595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d7fe3-7b3c-471f-b5ec-cb3d2d7cd4ad None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:18.511435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:18.583184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc74d6-ec2d-427d-a53e-1cf113a51cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:18.584241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc74d6-ec2d-427d-a53e-1cf113a51cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:18.584776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc74d6-ec2d-427d-a53e-1cf113a51cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:18.585276 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc74d6-ec2d-427d-a53e-1cf113a51cf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:18.586533 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc74d6-ec2d-427d-a53e-1cf113a51cf7 None admin] RBAC: Adding query filter params (group.id=c913b61014fc4785b92b169d39ae4329, role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=95faccee4f0940e98a9d62a275c0548c) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:18.587067 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc74d6-ec2d-427d-a53e-1cf113a51cf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:18.588730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc74d6-ec2d-427d-a53e-1cf113a51cf7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:18.597104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 194/382] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 16 16:03:18 2022] GET /identity/v3/role_assignments?group.id=c913b61014fc4785b92b169d39ae4329&scope.project.id=95faccee4f0940e98a9d62a275c0548c&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 260 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:18.665754 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada003e-e8a8-4b9d-930b-5f799edd97bd None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:18.715274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3999dc4-ece9-4900-aba9-229d9debff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:18.716577 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3999dc4-ece9-4900-aba9-229d9debff1e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:18.717095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3999dc4-ece9-4900-aba9-229d9debff1e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:18.717666 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3999dc4-ece9-4900-aba9-229d9debff1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:18.735318 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3999dc4-ece9-4900-aba9-229d9debff1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-f3999dc4-ece9-4900-aba9-229d9debff1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:18.743770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:18.744735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:18.745525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:18.745525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:18.745525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:18.745525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:18.745525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:18.745525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:18.745525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:18.745525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:18.745525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:18.745525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:18.745525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:18.745525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:18.747231 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 189/383] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:03:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:03:18.751911 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc74d6-ec2d-427d-a53e-1cf113a51cf7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:18.820424 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ae541-10ee-4638-b03f-7ff3e4cb50a5 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:18.820718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ae541-10ee-4638-b03f-7ff3e4cb50a5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:18.820948 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ae541-10ee-4638-b03f-7ff3e4cb50a5 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:18.822941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 190/384] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:18.829178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64298baf-f402-459f-853e-1e227aa36e45 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:18.829473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64298baf-f402-459f-853e-1e227aa36e45 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:18.829761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64298baf-f402-459f-853e-1e227aa36e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:18.852668 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-64298baf-f402-459f-853e-1e227aa36e45 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:18.853865 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-64298baf-f402-459f-853e-1e227aa36e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:18.889471 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc74d6-ec2d-427d-a53e-1cf113a51cf7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:18.892938 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:18.932056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e84e4-17a5-427e-8a42-2570cd0284ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:18.933359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e84e4-17a5-427e-8a42-2570cd0284ca None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:18.933823 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e84e4-17a5-427e-8a42-2570cd0284ca None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:18.934321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e84e4-17a5-427e-8a42-2570cd0284ca None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:18.935340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e84e4-17a5-427e-8a42-2570cd0284ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:18.935944 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e84e4-17a5-427e-8a42-2570cd0284ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:18.938269 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e84e4-17a5-427e-8a42-2570cd0284ca None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:18.949337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 195/385] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:18.953487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 191/386] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:18.956888 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e84e4-17a5-427e-8a42-2570cd0284ca None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:19.002565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64298baf-f402-459f-853e-1e227aa36e45 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:19.006995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:19.154014 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e84e4-17a5-427e-8a42-2570cd0284ca None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:19.205451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64298baf-f402-459f-853e-1e227aa36e45 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:19.232550 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f93de8-2dac-4918-a22b-a6b42f70eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:19.234168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f93de8-2dac-4918-a22b-a6b42f70eb00 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:19.234498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f93de8-2dac-4918-a22b-a6b42f70eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:19.234791 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f93de8-2dac-4918-a22b-a6b42f70eb00 None admin] PATH_INFO: `/v3/groups/8603b9badd944a858765bb119fa39bfe` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:19.239174 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f93de8-2dac-4918-a22b-a6b42f70eb00 None admin] RBAC: Authorizing `identity:get_group(group_id=8603b9badd944a858765bb119fa39bfe)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:19.240691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f93de8-2dac-4918-a22b-a6b42f70eb00 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:19.246807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 196/387] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 16 16:03:18 2022] GET /identity/v3/groups/8603b9badd944a858765bb119fa39bfe => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:19.255728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f93de8-2dac-4918-a22b-a6b42f70eb00 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:19.279670 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd2997-8565-4f11-bb3b-19db2e3703bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:19.281558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd2997-8565-4f11-bb3b-19db2e3703bb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:19.281997 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd2997-8565-4f11-bb3b-19db2e3703bb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:19.282446 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd2997-8565-4f11-bb3b-19db2e3703bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:19.306391 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd2997-8565-4f11-bb3b-19db2e3703bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-dfdd2997-8565-4f11-bb3b-19db2e3703bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:19.315250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:19.316169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:19.317403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:19.317403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:19.317403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:19.317403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:19.317403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:19.317403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:19.317403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:19.317403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:19.317403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:19.317403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:19.317403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:19.317403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:19.317403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 192/388] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:19.331870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd2997-8565-4f11-bb3b-19db2e3703bb None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:19.399610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:19.503516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:19.517997 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd2997-8565-4f11-bb3b-19db2e3703bb None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:19.521773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f93de8-2dac-4918-a22b-a6b42f70eb00 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:19.566314 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67c5ca-4488-4103-91df-678c1edaad33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:19.567066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67c5ca-4488-4103-91df-678c1edaad33 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:19.567355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67c5ca-4488-4103-91df-678c1edaad33 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:19.567634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67c5ca-4488-4103-91df-678c1edaad33 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:19.568413 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67c5ca-4488-4103-91df-678c1edaad33 None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:19.568725 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67c5ca-4488-4103-91df-678c1edaad33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:19.570165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67c5ca-4488-4103-91df-678c1edaad33 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:19.596760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 193/389] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:19.603155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41298762-6edb-4745-9155-98faa5b7eb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:19.603628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67c5ca-4488-4103-91df-678c1edaad33 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:19.604049 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41298762-6edb-4745-9155-98faa5b7eb6e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:19.604331 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41298762-6edb-4745-9155-98faa5b7eb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:19.604718 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41298762-6edb-4745-9155-98faa5b7eb6e None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:19.605981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41298762-6edb-4745-9155-98faa5b7eb6e None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:19.607769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41298762-6edb-4745-9155-98faa5b7eb6e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:19.615607 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 197/390] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:19 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:19.617144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41298762-6edb-4745-9155-98faa5b7eb6e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:19.741403 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41298762-6edb-4745-9155-98faa5b7eb6e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:19.793946 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be9f32-8607-44b6-9516-756f0d3c2469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:19.794796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be9f32-8607-44b6-9516-756f0d3c2469 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:19.795086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be9f32-8607-44b6-9516-756f0d3c2469 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:19.795364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be9f32-8607-44b6-9516-756f0d3c2469 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0/groups/8603b9badd944a858765bb119fa39bfe/roles/255c2b4827324109a6d2068c8b0316c3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:19.800627 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be9f32-8607-44b6-9516-756f0d3c2469 None admin] RBAC: Authorizing `identity:create_grant(project_id=815bcedbe8ea4401944309ac6a34f4d0, group_id=8603b9badd944a858765bb119fa39bfe, role_id=255c2b4827324109a6d2068c8b0316c3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:19.802093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be9f32-8607-44b6-9516-756f0d3c2469 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:19.823300 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:19.826832 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 198/391] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jun 16 16:03:19 2022] PUT /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0/groups/8603b9badd944a858765bb119fa39bfe/roles/255c2b4827324109a6d2068c8b0316c3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:03:19.845801 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67c5ca-4488-4103-91df-678c1edaad33 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:19.885702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d5acd-4483-4264-8812-b224b4541a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:19.886625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d5acd-4483-4264-8812-b224b4541a86 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:19.886915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d5acd-4483-4264-8812-b224b4541a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:19.887194 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d5acd-4483-4264-8812-b224b4541a86 None admin] PATH_INFO: `/v3/groups/8603b9badd944a858765bb119fa39bfe` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:19.889096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d5acd-4483-4264-8812-b224b4541a86 None admin] RBAC: Authorizing `identity:get_group(group_id=8603b9badd944a858765bb119fa39bfe)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:19.890887 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d5acd-4483-4264-8812-b224b4541a86 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:19.899269 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be9f32-8607-44b6-9516-756f0d3c2469 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:19.899684 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 194/392] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 16 16:03:19 2022] GET /identity/v3/groups/8603b9badd944a858765bb119fa39bfe => generated 226 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:19.929872 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:20.045695 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be9f32-8607-44b6-9516-756f0d3c2469 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:20.093238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fefc6-664d-4343-81ce-5f52c6a7c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:20.094122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fefc6-664d-4343-81ce-5f52c6a7c722 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:20.094407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fefc6-664d-4343-81ce-5f52c6a7c722 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:20.094723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fefc6-664d-4343-81ce-5f52c6a7c722 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:20.097180 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fefc6-664d-4343-81ce-5f52c6a7c722 None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:20.098784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fefc6-664d-4343-81ce-5f52c6a7c722 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:20.100508 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 199/393] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:19 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:20.106084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d5acd-4483-4264-8812-b224b4541a86 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:20.218987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d5acd-4483-4264-8812-b224b4541a86 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:20.254795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bb48e-364a-455d-9ddb-106e15feedc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:20.255693 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bb48e-364a-455d-9ddb-106e15feedc1 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:20.255978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bb48e-364a-455d-9ddb-106e15feedc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:20.256257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bb48e-364a-455d-9ddb-106e15feedc1 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0/groups/8603b9badd944a858765bb119fa39bfe/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:20.258240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bb48e-364a-455d-9ddb-106e15feedc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=815bcedbe8ea4401944309ac6a34f4d0, group_id=8603b9badd944a858765bb119fa39bfe, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:20.259707 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bb48e-364a-455d-9ddb-106e15feedc1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:20.275513 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 195/394] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jun 16 16:03:20 2022] PUT /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0/groups/8603b9badd944a858765bb119fa39bfe/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:03:21.025650 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd915d83-715d-4d80-826c-d87b6ec40761 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:21.025930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd915d83-715d-4d80-826c-d87b6ec40761 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:21.026406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd915d83-715d-4d80-826c-d87b6ec40761 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:21.028296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 200/395] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:21.034018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb169b-3499-4e92-8bbe-a9167af1cf0c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:21.034624 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb169b-3499-4e92-8bbe-a9167af1cf0c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:21.035110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb169b-3499-4e92-8bbe-a9167af1cf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:21.052688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-74fb169b-3499-4e92-8bbe-a9167af1cf0c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:21.054198 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-74fb169b-3499-4e92-8bbe-a9167af1cf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:21.067622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:21.141253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 196/396] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:21.150120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da196b-514e-4bad-85ae-340f0697fa3e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:21.150646 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da196b-514e-4bad-85ae-340f0697fa3e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:21.150860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da196b-514e-4bad-85ae-340f0697fa3e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:21.152264 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 201/397] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:21.161143 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8492c-ec26-49fc-b62a-f15ef91b2ed7 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:21.161724 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8492c-ec26-49fc-b62a-f15ef91b2ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:21.162196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8492c-ec26-49fc-b62a-f15ef91b2ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:21.170475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da196b-514e-4bad-85ae-340f0697fa3e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:21.182375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-51a8492c-ec26-49fc-b62a-f15ef91b2ed7 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:21.185417 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-51a8492c-ec26-49fc-b62a-f15ef91b2ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:21.304132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 197/398] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:21.332755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3fcbb-95e7-4962-a780-114a52b75d41 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:21.333415 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3fcbb-95e7-4962-a780-114a52b75d41 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:21.333887 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3fcbb-95e7-4962-a780-114a52b75d41 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:21.335740 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 198/399] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:21.339473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3fcbb-95e7-4962-a780-114a52b75d41 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:21.347249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:21.359280 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da196b-514e-4bad-85ae-340f0697fa3e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:21.414072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973b6c0-62e4-4786-a5e1-102d9b78cfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:21.414958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973b6c0-62e4-4786-a5e1-102d9b78cfae None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:21.415244 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973b6c0-62e4-4786-a5e1-102d9b78cfae None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:21.415526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973b6c0-62e4-4786-a5e1-102d9b78cfae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:21.434564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973b6c0-62e4-4786-a5e1-102d9b78cfae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-1973b6c0-62e4-4786-a5e1-102d9b78cfae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:21.445184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:21.446130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:21.447225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:21.447225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:21.447225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:21.447225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:21.447225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:21.447225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:21.447225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:21.447225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:21.447225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:21.447225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:21.447225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:21.447225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:21.450531 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 202/400] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:21.452654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f31e2-f3a4-4c7d-86ba-21911b0740eb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:21.453168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f31e2-f3a4-4c7d-86ba-21911b0740eb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:21.454570 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f31e2-f3a4-4c7d-86ba-21911b0740eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:21.468407 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:21.477787 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-459f31e2-f3a4-4c7d-86ba-21911b0740eb None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:21.479338 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-459f31e2-f3a4-4c7d-86ba-21911b0740eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:21.511194 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3fcbb-95e7-4962-a780-114a52b75d41 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:21.565845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce69e5-1d1b-4461-b664-8920d04b59e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:21.567193 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce69e5-1d1b-4461-b664-8920d04b59e5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:21.568002 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce69e5-1d1b-4461-b664-8920d04b59e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:21.568628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce69e5-1d1b-4461-b664-8920d04b59e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:21.581554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 203/401] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:21.582535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f31e2-f3a4-4c7d-86ba-21911b0740eb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:21.583963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce69e5-1d1b-4461-b664-8920d04b59e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-bcce69e5-1d1b-4461-b664-8920d04b59e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:21.593137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:21.594188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:21.595043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:21.595043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:21.595043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:21.595043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:21.595043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:21.595043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:21.595043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:21.595043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:21.595043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:21.595043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:21.595043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:03:21.595043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:21.597870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 199/402] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:03:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:03:21.604220 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce69e5-1d1b-4461-b664-8920d04b59e5 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:21.704504 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:21.725228 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f31e2-f3a4-4c7d-86ba-21911b0740eb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:21.744451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce69e5-1d1b-4461-b664-8920d04b59e5 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:21.762324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa652e-1860-48a6-ab52-15d4abe8bd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:21.763025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa652e-1860-48a6-ab52-15d4abe8bd93 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:21.763362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa652e-1860-48a6-ab52-15d4abe8bd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:21.763673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa652e-1860-48a6-ab52-15d4abe8bd93 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:21.764472 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa652e-1860-48a6-ab52-15d4abe8bd93 None admin] RBAC: Adding query filter params (name=member) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:21.764998 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa652e-1860-48a6-ab52-15d4abe8bd93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:21.766591 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa652e-1860-48a6-ab52-15d4abe8bd93 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:21.779805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 204/403] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:21.781217 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa652e-1860-48a6-ab52-15d4abe8bd93 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:21.785574 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a07c4a-55fd-449f-87d0-858aab5cffb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:21.786649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a07c4a-55fd-449f-87d0-858aab5cffb0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:21.787127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a07c4a-55fd-449f-87d0-858aab5cffb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:21.787615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a07c4a-55fd-449f-87d0-858aab5cffb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:21.789835 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:21.802914 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a07c4a-55fd-449f-87d0-858aab5cffb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-39a07c4a-55fd-449f-87d0-858aab5cffb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:21.812170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:21.813067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:21.813856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:21.813856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:21.813856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:21.813856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:21.813856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:21.813856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:21.813856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:21.813856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:21.813856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:21.813856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:21.813856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:21.813856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:21.816775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 200/404] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:03:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:21.818660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a07c4a-55fd-449f-87d0-858aab5cffb0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:21.892449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa652e-1860-48a6-ab52-15d4abe8bd93 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:21.930269 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c729935-c6f1-4bcf-9308-58e7122be8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:21.931088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c729935-c6f1-4bcf-9308-58e7122be8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:21.931374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c729935-c6f1-4bcf-9308-58e7122be8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:21.931650 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c729935-c6f1-4bcf-9308-58e7122be8a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:21.932405 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c729935-c6f1-4bcf-9308-58e7122be8a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:21.932725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c729935-c6f1-4bcf-9308-58e7122be8a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:21.934097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c729935-c6f1-4bcf-9308-58e7122be8a0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:21.934998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a07c4a-55fd-449f-87d0-858aab5cffb0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:21.947770 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 205/405] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:21.947770 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c729935-c6f1-4bcf-9308-58e7122be8a0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:21.954265 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:21.990524 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749aceba-73e3-4a3f-81ef-e644c4df0417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:21.991406 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749aceba-73e3-4a3f-81ef-e644c4df0417 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:21.992139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749aceba-73e3-4a3f-81ef-e644c4df0417 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:21.992452 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749aceba-73e3-4a3f-81ef-e644c4df0417 None admin] PATH_INFO: `/v3/groups/8603b9badd944a858765bb119fa39bfe` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:21.994115 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749aceba-73e3-4a3f-81ef-e644c4df0417 None admin] RBAC: Authorizing `identity:get_group(group_id=8603b9badd944a858765bb119fa39bfe)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:21.995945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749aceba-73e3-4a3f-81ef-e644c4df0417 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:22.003234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 201/406] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 16 16:03:21 2022] GET /identity/v3/groups/8603b9badd944a858765bb119fa39bfe => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:22.004298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749aceba-73e3-4a3f-81ef-e644c4df0417 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:22.063291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c729935-c6f1-4bcf-9308-58e7122be8a0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:22.086928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:22.103236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4aa62-c834-4067-aada-42963cd1548a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:22.104168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4aa62-c834-4067-aada-42963cd1548a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:22.104457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4aa62-c834-4067-aada-42963cd1548a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:22.105279 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4aa62-c834-4067-aada-42963cd1548a None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:22.106048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4aa62-c834-4067-aada-42963cd1548a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:22.106363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4aa62-c834-4067-aada-42963cd1548a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:22.108424 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4aa62-c834-4067-aada-42963cd1548a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:22.119861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 206/407] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:22.120847 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4aa62-c834-4067-aada-42963cd1548a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:22.125527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749aceba-73e3-4a3f-81ef-e644c4df0417 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:22.165672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32462c50-9a1d-4d53-a446-23ab9d1df457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:22.166856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32462c50-9a1d-4d53-a446-23ab9d1df457 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:22.167144 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32462c50-9a1d-4d53-a446-23ab9d1df457 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:22.167428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32462c50-9a1d-4d53-a446-23ab9d1df457 None admin] PATH_INFO: `/v3/groups/c913b61014fc4785b92b169d39ae4329` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:22.168900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32462c50-9a1d-4d53-a446-23ab9d1df457 None admin] RBAC: Authorizing `identity:get_group(group_id=c913b61014fc4785b92b169d39ae4329)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:22.171779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32462c50-9a1d-4d53-a446-23ab9d1df457 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:22.173459 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 202/408] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 16 16:03:22 2022] GET /identity/v3/groups/c913b61014fc4785b92b169d39ae4329 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:22.174327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32462c50-9a1d-4d53-a446-23ab9d1df457 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:22.207755 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:22.248700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4aa62-c834-4067-aada-42963cd1548a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:22.288090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de420a52-cc45-44f7-a261-9431585c2435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:22.289052 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de420a52-cc45-44f7-a261-9431585c2435 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:22.289402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de420a52-cc45-44f7-a261-9431585c2435 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:22.289742 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de420a52-cc45-44f7-a261-9431585c2435 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:22.291119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de420a52-cc45-44f7-a261-9431585c2435 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:22.292623 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de420a52-cc45-44f7-a261-9431585c2435 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:22.298784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 207/409] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:22 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:22.299715 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de420a52-cc45-44f7-a261-9431585c2435 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:22.313533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32462c50-9a1d-4d53-a446-23ab9d1df457 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:22.353891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:22.362760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0aee6-06aa-40ca-bb51-0815b74a3df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:22.365873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0aee6-06aa-40ca-bb51-0815b74a3df8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:22.365873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0aee6-06aa-40ca-bb51-0815b74a3df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:22.365873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0aee6-06aa-40ca-bb51-0815b74a3df8 None admin] PATH_INFO: `/v3/groups/8603b9badd944a858765bb119fa39bfe` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:22.370472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0aee6-06aa-40ca-bb51-0815b74a3df8 None admin] RBAC: Authorizing `identity:get_group(group_id=8603b9badd944a858765bb119fa39bfe)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:22.370472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0aee6-06aa-40ca-bb51-0815b74a3df8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:22.370472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 203/410] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 16 16:03:22 2022] GET /identity/v3/groups/8603b9badd944a858765bb119fa39bfe => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:22.371766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0aee6-06aa-40ca-bb51-0815b74a3df8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:22.419823 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de420a52-cc45-44f7-a261-9431585c2435 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:22.457015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f2132-7892-457d-974b-55a2531d4564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:22.458062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f2132-7892-457d-974b-55a2531d4564 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:22.458453 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f2132-7892-457d-974b-55a2531d4564 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:22.458851 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f2132-7892-457d-974b-55a2531d4564 None admin] PATH_INFO: `/v3/projects/95faccee4f0940e98a9d62a275c0548c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:22.460159 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f2132-7892-457d-974b-55a2531d4564 None admin] RBAC: Authorizing `identity:get_project(project_id=95faccee4f0940e98a9d62a275c0548c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:22.461701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f2132-7892-457d-974b-55a2531d4564 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:22.463542 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 208/411] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:22 2022] GET /identity/v3/projects/95faccee4f0940e98a9d62a275c0548c => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:22.464385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f2132-7892-457d-974b-55a2531d4564 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:22.470249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:22.515505 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0aee6-06aa-40ca-bb51-0815b74a3df8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:22.553347 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128460f-fc58-4f66-9d7c-93b04653d228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:22.554446 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128460f-fc58-4f66-9d7c-93b04653d228 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:22.554831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128460f-fc58-4f66-9d7c-93b04653d228 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:22.555261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128460f-fc58-4f66-9d7c-93b04653d228 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982/groups/8603b9badd944a858765bb119fa39bfe/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:22.557383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128460f-fc58-4f66-9d7c-93b04653d228 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5669c2ec4584aa9afe502b8365fd982, group_id=8603b9badd944a858765bb119fa39bfe, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:22.558974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128460f-fc58-4f66-9d7c-93b04653d228 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:22.582839 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 204/412] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jun 16 16:03:22 2022] PUT /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982/groups/8603b9badd944a858765bb119fa39bfe/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:03:22.584187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128460f-fc58-4f66-9d7c-93b04653d228 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:22.598731 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f2132-7892-457d-974b-55a2531d4564 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:22.641263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cc56f-0eb8-4ba4-bf4c-46cd112d19e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:22.642091 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cc56f-0eb8-4ba4-bf4c-46cd112d19e9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:22.642377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cc56f-0eb8-4ba4-bf4c-46cd112d19e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:22.642703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cc56f-0eb8-4ba4-bf4c-46cd112d19e9 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:22.644060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cc56f-0eb8-4ba4-bf4c-46cd112d19e9 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:22.645549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cc56f-0eb8-4ba4-bf4c-46cd112d19e9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:22.647395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 209/413] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:22 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:22.653636 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8939cf2-83be-43bf-ba76-66c0b242d7c7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:22.653934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8939cf2-83be-43bf-ba76-66c0b242d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:22.654197 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8939cf2-83be-43bf-ba76-66c0b242d7c7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:22.656475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 210/414] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:22.657016 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8939cf2-83be-43bf-ba76-66c0b242d7c7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:22.678170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:22.738059 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128460f-fc58-4f66-9d7c-93b04653d228 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:22.781789 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:22.786006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c20a9d-b543-4789-9377-7f51766aba19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:22.786962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c20a9d-b543-4789-9377-7f51766aba19 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:22.787971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c20a9d-b543-4789-9377-7f51766aba19 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:22.787971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c20a9d-b543-4789-9377-7f51766aba19 None admin] PATH_INFO: `/v3/projects/95faccee4f0940e98a9d62a275c0548c/groups/c913b61014fc4785b92b169d39ae4329/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:22.791444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c20a9d-b543-4789-9377-7f51766aba19 None admin] RBAC: Authorizing `identity:create_grant(project_id=95faccee4f0940e98a9d62a275c0548c, group_id=c913b61014fc4785b92b169d39ae4329, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:22.793402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c20a9d-b543-4789-9377-7f51766aba19 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:22.810465 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 205/415] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jun 16 16:03:22 2022] PUT /identity/v3/projects/95faccee4f0940e98a9d62a275c0548c/groups/c913b61014fc4785b92b169d39ae4329/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:03:22.812047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2cab1-a130-4847-a453-15116b37f48b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:22.812425 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2cab1-a130-4847-a453-15116b37f48b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:22.812727 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2cab1-a130-4847-a453-15116b37f48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:22.823525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8939cf2-83be-43bf-ba76-66c0b242d7c7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:22.844454 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-c9e2cab1-a130-4847-a453-15116b37f48b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:22.846008 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c9e2cab1-a130-4847-a453-15116b37f48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:22.875425 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3de4f7-0cfd-46c3-acda-dcd1fc365e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:22.876419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3de4f7-0cfd-46c3-acda-dcd1fc365e28 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:22.876708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3de4f7-0cfd-46c3-acda-dcd1fc365e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:22.876990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3de4f7-0cfd-46c3-acda-dcd1fc365e28 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982/groups/8603b9badd944a858765bb119fa39bfe/roles/255c2b4827324109a6d2068c8b0316c3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:22.880482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3de4f7-0cfd-46c3-acda-dcd1fc365e28 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5669c2ec4584aa9afe502b8365fd982, group_id=8603b9badd944a858765bb119fa39bfe, role_id=255c2b4827324109a6d2068c8b0316c3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:22.882296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3de4f7-0cfd-46c3-acda-dcd1fc365e28 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:22.921346 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 211/416] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jun 16 16:03:22 2022] PUT /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982/groups/8603b9badd944a858765bb119fa39bfe/roles/255c2b4827324109a6d2068c8b0316c3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:03:22.955088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 206/417] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:22.981139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3de4f7-0cfd-46c3-acda-dcd1fc365e28 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:23.105188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049863-345b-404f-ba6a-04adbd2a28cf None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:23.105772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049863-345b-404f-ba6a-04adbd2a28cf None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:23.106060 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049863-345b-404f-ba6a-04adbd2a28cf None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:23.107610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 207/418] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:23.112088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3de4f7-0cfd-46c3-acda-dcd1fc365e28 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:23.113700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e2791-ab84-4e99-9996-12dd3d1c241d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:23.114198 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e2791-ab84-4e99-9996-12dd3d1c241d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:23.114818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e2791-ab84-4e99-9996-12dd3d1c241d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:23.135928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f65e2791-ab84-4e99-9996-12dd3d1c241d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:23.137580 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f65e2791-ab84-4e99-9996-12dd3d1c241d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:23.151913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:23.163133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d876c-21ef-4471-bb58-9b171b0b09b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:23.163958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d876c-21ef-4471-bb58-9b171b0b09b3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:23.164240 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d876c-21ef-4471-bb58-9b171b0b09b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:23.164516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d876c-21ef-4471-bb58-9b171b0b09b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:23.180672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d876c-21ef-4471-bb58-9b171b0b09b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f15d876c-21ef-4471-bb58-9b171b0b09b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:23.191981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:23.193121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:23.194111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:23.194111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:23.194111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:23.194111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:23.194111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:23.194111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:23.194111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:23.194111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:23.194111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:23.194111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:23.194111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:23.194111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:23.197363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 212/419] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:03:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:23.204477 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d876c-21ef-4471-bb58-9b171b0b09b3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:23.204923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:23.235526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 208/420] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:03:23.260207 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e2791-ab84-4e99-9996-12dd3d1c241d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:23.346836 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d876c-21ef-4471-bb58-9b171b0b09b3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:23.411014 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09063322-bae9-428a-9c0e-ad7ff6940f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:23.412051 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09063322-bae9-428a-9c0e-ad7ff6940f18 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:23.412524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09063322-bae9-428a-9c0e-ad7ff6940f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:23.413003 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09063322-bae9-428a-9c0e-ad7ff6940f18 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:23.415268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e2791-ab84-4e99-9996-12dd3d1c241d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:23.416291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09063322-bae9-428a-9c0e-ad7ff6940f18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:23.416793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09063322-bae9-428a-9c0e-ad7ff6940f18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:23.418460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09063322-bae9-428a-9c0e-ad7ff6940f18 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:23.438991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 213/421] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:23.444359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09063322-bae9-428a-9c0e-ad7ff6940f18 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:23.488380 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633cfa6-ac79-45ad-b4b5-2f29ded0588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:23.489545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633cfa6-ac79-45ad-b4b5-2f29ded0588b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:23.490022 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633cfa6-ac79-45ad-b4b5-2f29ded0588b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:23.490655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633cfa6-ac79-45ad-b4b5-2f29ded0588b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:23.505662 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633cfa6-ac79-45ad-b4b5-2f29ded0588b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-f633cfa6-ac79-45ad-b4b5-2f29ded0588b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:23.513940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:23.514925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:23.515706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:23.515706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:23.515706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:23.515706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:23.515706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:23.515706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:23.515706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:23.515706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:23.515706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:23.515706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:23.515706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:23.515706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:23.522742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 209/422] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:03:23.524591 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633cfa6-ac79-45ad-b4b5-2f29ded0588b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:23.529553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:23.581625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09063322-bae9-428a-9c0e-ad7ff6940f18 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:23.619953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276d1f9-6c37-4110-8931-d363c579f9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:23.620677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d1f9-6c37-4110-8931-d363c579f9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:23.620964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d1f9-6c37-4110-8931-d363c579f9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:23.621237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d1f9-6c37-4110-8931-d363c579f9c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:23.628192 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:23.699231 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276d1f9-6c37-4110-8931-d363c579f9c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:23.700612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276d1f9-6c37-4110-8931-d363c579f9c2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:23.730988 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633cfa6-ac79-45ad-b4b5-2f29ded0588b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:23.761655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:23.814236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 214/423] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:23.823649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276d1f9-6c37-4110-8931-d363c579f9c2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:23.824033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cb82d-0caa-403f-a81e-ade1facb330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:23.824722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cb82d-0caa-403f-a81e-ade1facb330c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:23.825014 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cb82d-0caa-403f-a81e-ade1facb330c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:23.825296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cb82d-0caa-403f-a81e-ade1facb330c None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:23.826158 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cb82d-0caa-403f-a81e-ade1facb330c None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:23.826494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cb82d-0caa-403f-a81e-ade1facb330c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:23.828521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cb82d-0caa-403f-a81e-ade1facb330c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:23.852382 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 210/424] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:23.857952 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cb82d-0caa-403f-a81e-ade1facb330c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:23.948460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276d1f9-6c37-4110-8931-d363c579f9c2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:23.994903 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aab9e-81f1-4e2a-939c-38ce13975c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:23.995694 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aab9e-81f1-4e2a-939c-38ce13975c6c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:23.995974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aab9e-81f1-4e2a-939c-38ce13975c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:23.996249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aab9e-81f1-4e2a-939c-38ce13975c6c None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:23.997494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0aab9e-81f1-4e2a-939c-38ce13975c6c None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:23.999150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0aab9e-81f1-4e2a-939c-38ce13975c6c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:24.000884 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 215/425] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:23 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:24.008094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aab9e-81f1-4e2a-939c-38ce13975c6c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:24.036669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:24.068395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:24.080191 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cb82d-0caa-403f-a81e-ade1facb330c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:24.160894 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1ca14-b874-4a8f-b383-17e86d3ab23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:24.161557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1ca14-b874-4a8f-b383-17e86d3ab23c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:24.161844 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1ca14-b874-4a8f-b383-17e86d3ab23c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:24.162125 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1ca14-b874-4a8f-b383-17e86d3ab23c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:24.175795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aab9e-81f1-4e2a-939c-38ce13975c6c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:24.221703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f67d92-2438-4195-acc3-330aa3199b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:24.222941 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f67d92-2438-4195-acc3-330aa3199b76 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:24.223430 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f67d92-2438-4195-acc3-330aa3199b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:24.223982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f67d92-2438-4195-acc3-330aa3199b76 None admin] PATH_INFO: `/v3/groups/8603b9badd944a858765bb119fa39bfe` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:24.225341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f67d92-2438-4195-acc3-330aa3199b76 None admin] RBAC: Authorizing `identity:get_group(group_id=8603b9badd944a858765bb119fa39bfe)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:24.226996 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f67d92-2438-4195-acc3-330aa3199b76 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:24.229158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 216/426] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 16 16:03:24 2022] GET /identity/v3/groups/8603b9badd944a858765bb119fa39bfe => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:24.235491 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f67d92-2438-4195-acc3-330aa3199b76 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:24.292733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1ca14-b874-4a8f-b383-17e86d3ab23c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:24.294223 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1ca14-b874-4a8f-b383-17e86d3ab23c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:24.379712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f67d92-2438-4195-acc3-330aa3199b76 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:24.381282 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:24.425253 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f0a44-1593-4a50-ac6f-395e1558d297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:24.426091 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0a44-1593-4a50-ac6f-395e1558d297 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:24.426527 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0a44-1593-4a50-ac6f-395e1558d297 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:24.426891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0a44-1593-4a50-ac6f-395e1558d297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:24.430448 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f0a44-1593-4a50-ac6f-395e1558d297 None admin] RBAC: Adding query filter params (group.id=8603b9badd944a858765bb119fa39bfe, role.id=255c2b4827324109a6d2068c8b0316c3, scope.project.id=815bcedbe8ea4401944309ac6a34f4d0) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:24.430448 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f0a44-1593-4a50-ac6f-395e1558d297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:24.430448 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f0a44-1593-4a50-ac6f-395e1558d297 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:24.438074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 217/427] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 16 16:03:24 2022] GET /identity/v3/role_assignments?group.id=8603b9badd944a858765bb119fa39bfe&scope.project.id=815bcedbe8ea4401944309ac6a34f4d0&role.id=255c2b4827324109a6d2068c8b0316c3 => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:24.475178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:24.486975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 211/428] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 16:03:24.495668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f0a44-1593-4a50-ac6f-395e1558d297 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:24.673948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f0a44-1593-4a50-ac6f-395e1558d297 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:24.720448 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57a98c-1436-4026-a471-f1964aa30b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:24.721341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57a98c-1436-4026-a471-f1964aa30b43 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:24.721683 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57a98c-1436-4026-a471-f1964aa30b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:24.721968 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57a98c-1436-4026-a471-f1964aa30b43 None admin] PATH_INFO: `/v3/projects/815bcedbe8ea4401944309ac6a34f4d0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:24.723967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57a98c-1436-4026-a471-f1964aa30b43 None admin] RBAC: Authorizing `identity:get_project(project_id=815bcedbe8ea4401944309ac6a34f4d0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:24.725423 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57a98c-1436-4026-a471-f1964aa30b43 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:24.727167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 218/429] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:24 2022] GET /identity/v3/projects/815bcedbe8ea4401944309ac6a34f4d0 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:24.732912 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1ca14-b874-4a8f-b383-17e86d3ab23c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:24.850781 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1ca14-b874-4a8f-b383-17e86d3ab23c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:24.889865 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58311c6-711f-42e6-898f-21bc6334aefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:24.891114 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58311c6-711f-42e6-898f-21bc6334aefa None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:24.891592 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58311c6-711f-42e6-898f-21bc6334aefa None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:24.892061 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58311c6-711f-42e6-898f-21bc6334aefa None admin] PATH_INFO: `/v3/groups/8603b9badd944a858765bb119fa39bfe` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:24.893675 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58311c6-711f-42e6-898f-21bc6334aefa None admin] RBAC: Authorizing `identity:get_group(group_id=8603b9badd944a858765bb119fa39bfe)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:24.895354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58311c6-711f-42e6-898f-21bc6334aefa None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:24.897483 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 212/430] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 16 16:03:24 2022] GET /identity/v3/groups/8603b9badd944a858765bb119fa39bfe => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:24.903518 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57a98c-1436-4026-a471-f1964aa30b43 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:24.936115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:25.036889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57a98c-1436-4026-a471-f1964aa30b43 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:25.080988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed35226-13b5-4b08-a5b7-f824c0d087d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:25.083888 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed35226-13b5-4b08-a5b7-f824c0d087d1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:25.083888 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed35226-13b5-4b08-a5b7-f824c0d087d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:25.083888 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed35226-13b5-4b08-a5b7-f824c0d087d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:25.083888 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed35226-13b5-4b08-a5b7-f824c0d087d1 None admin] RBAC: Adding query filter params (group.id=8603b9badd944a858765bb119fa39bfe, role.id=2c5988d189bd4b4482fb3649b9cf1de4, scope.project.id=815bcedbe8ea4401944309ac6a34f4d0) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:25.083888 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed35226-13b5-4b08-a5b7-f824c0d087d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:25.084876 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed35226-13b5-4b08-a5b7-f824c0d087d1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:25.092202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 219/431] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 16 16:03:24 2022] GET /identity/v3/role_assignments?group.id=8603b9badd944a858765bb119fa39bfe&scope.project.id=815bcedbe8ea4401944309ac6a34f4d0&role.id=2c5988d189bd4b4482fb3649b9cf1de4 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:25.314320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d080b0f-de6a-4169-a83c-e1db065017a7 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:25.314854 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d080b0f-de6a-4169-a83c-e1db065017a7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:25.314854 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d080b0f-de6a-4169-a83c-e1db065017a7 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:25.316399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 213/432] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:25.324524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b0018-7bae-44d9-9719-46440163336c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:25.325239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b0018-7bae-44d9-9719-46440163336c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:25.325735 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b0018-7bae-44d9-9719-46440163336c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:25.349998 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cb6b0018-7bae-44d9-9719-46440163336c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:25.351553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cb6b0018-7bae-44d9-9719-46440163336c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:25.469329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 220/433] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:25.476801 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468e0ab-7eb9-4ef6-96bb-399b158fde79 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:25.477209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468e0ab-7eb9-4ef6-96bb-399b158fde79 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:25.477595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468e0ab-7eb9-4ef6-96bb-399b158fde79 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:25.479108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 214/434] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:25.485675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a180c-f539-4674-bbbb-6e628c60a9b6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:25.486080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a180c-f539-4674-bbbb-6e628c60a9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:25.486552 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a180c-f539-4674-bbbb-6e628c60a9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:25.501692 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468e0ab-7eb9-4ef6-96bb-399b158fde79 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:25.507734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8f9a180c-f539-4674-bbbb-6e628c60a9b6 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:25.509027 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8f9a180c-f539-4674-bbbb-6e628c60a9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:25.523346 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:25.606418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 221/435] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:25.611920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:25.632748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a180c-f539-4674-bbbb-6e628c60a9b6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:25.656275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468e0ab-7eb9-4ef6-96bb-399b158fde79 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:25.704854 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecb35b-01f0-4acd-8e82-277165f679a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:25.705669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecb35b-01f0-4acd-8e82-277165f679a6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:25.705953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecb35b-01f0-4acd-8e82-277165f679a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:25.706230 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecb35b-01f0-4acd-8e82-277165f679a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:25.719413 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecb35b-01f0-4acd-8e82-277165f679a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-cfecb35b-01f0-4acd-8e82-277165f679a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:25.727723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:25.728672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:25.729466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:25.729466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:25.729466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:25.729466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:25.729466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:25.729466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:25.729466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:25.729466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:25.729466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:25.729466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:25.729466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 16:03:25.729466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:25.732230 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 215/436] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:25.733883 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ba877-5b80-4ca7-9448-557a19275b19 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:25.734360 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ba877-5b80-4ca7-9448-557a19275b19 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:25.734856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ba877-5b80-4ca7-9448-557a19275b19 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:25.736315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 216/437] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:25.740348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ba877-5b80-4ca7-9448-557a19275b19 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:25.781034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a180c-f539-4674-bbbb-6e628c60a9b6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:25.825916 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b6fc5-20f4-4caf-b478-0b6fb8374daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:25.827477 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b6fc5-20f4-4caf-b478-0b6fb8374daa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:25.828328 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b6fc5-20f4-4caf-b478-0b6fb8374daa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:25.828619 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b6fc5-20f4-4caf-b478-0b6fb8374daa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:25.840385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b6fc5-20f4-4caf-b478-0b6fb8374daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-728b6fc5-20f4-4caf-b478-0b6fb8374daa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:25.849108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:25.850104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:25.850988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:25.850988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:25.850988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:25.850988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:25.850988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:25.850988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:25.850988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:25.850988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:25.850988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:25.850988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:25.850988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:03:25.850988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:25.850988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 222/438] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:03:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:03:25.851654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93091c84-dcd0-413a-b3e4-08b5b59e54da None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:25.852028 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93091c84-dcd0-413a-b3e4-08b5b59e54da None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:25.853121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93091c84-dcd0-413a-b3e4-08b5b59e54da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:25.865843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:25.872332 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-93091c84-dcd0-413a-b3e4-08b5b59e54da None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:25.877666 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-93091c84-dcd0-413a-b3e4-08b5b59e54da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:25.887920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ba877-5b80-4ca7-9448-557a19275b19 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:25.920100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:25.929529 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d1687-eef2-4969-a8bc-00a8234c95ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:25.930956 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d1687-eef2-4969-a8bc-00a8234c95ed None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:25.931261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d1687-eef2-4969-a8bc-00a8234c95ed None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:25.932317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d1687-eef2-4969-a8bc-00a8234c95ed None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:25.932589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d1687-eef2-4969-a8bc-00a8234c95ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:25.932902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d1687-eef2-4969-a8bc-00a8234c95ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:25.934496 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d1687-eef2-4969-a8bc-00a8234c95ed None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:25.945464 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 217/439] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:03:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:25.949044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d1687-eef2-4969-a8bc-00a8234c95ed None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:25.962685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 223/440] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:25.963486 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93091c84-dcd0-413a-b3e4-08b5b59e54da None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:26.063610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93091c84-dcd0-413a-b3e4-08b5b59e54da None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:26.064471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d1687-eef2-4969-a8bc-00a8234c95ed None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:26.102725 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dde2c-b215-4ebe-9e8e-26e6da1a5e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:26.103401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dde2c-b215-4ebe-9e8e-26e6da1a5e8a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:26.103689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dde2c-b215-4ebe-9e8e-26e6da1a5e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:26.103972 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dde2c-b215-4ebe-9e8e-26e6da1a5e8a None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:26.104724 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dde2c-b215-4ebe-9e8e-26e6da1a5e8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:26.105036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dde2c-b215-4ebe-9e8e-26e6da1a5e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:26.106543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dde2c-b215-4ebe-9e8e-26e6da1a5e8a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:26.114336 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c36f2-8ea4-4235-9f91-9163fcb2da14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:26.115038 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c36f2-8ea4-4235-9f91-9163fcb2da14 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:26.115168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 218/441] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:26.115354 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c36f2-8ea4-4235-9f91-9163fcb2da14 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:26.115602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c36f2-8ea4-4235-9f91-9163fcb2da14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:26.115953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dde2c-b215-4ebe-9e8e-26e6da1a5e8a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:26.120097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:26.176878 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:26.207334 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c36f2-8ea4-4235-9f91-9163fcb2da14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:26.209404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c36f2-8ea4-4235-9f91-9163fcb2da14 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:26.228764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dde2c-b215-4ebe-9e8e-26e6da1a5e8a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:26.263646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8c455-10ea-44f0-abf5-b26d00b583db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:26.265114 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8c455-10ea-44f0-abf5-b26d00b583db None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:26.265451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8c455-10ea-44f0-abf5-b26d00b583db None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:26.265734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8c455-10ea-44f0-abf5-b26d00b583db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:26.276136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8c455-10ea-44f0-abf5-b26d00b583db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-f2c8c455-10ea-44f0-abf5-b26d00b583db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:26.284656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:26.285583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:26.286375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:26.286375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:26.286375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:26.286375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:26.286375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:26.286375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:26.286375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:26.286375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:26.286375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:26.286375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:26.286375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:26.286375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:26.286375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 219/442] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:03:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:26.287064 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8c455-10ea-44f0-abf5-b26d00b583db None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:26.314840 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 224/443] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:26.315885 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c36f2-8ea4-4235-9f91-9163fcb2da14 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:26.353657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:26.392206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8c455-10ea-44f0-abf5-b26d00b583db None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:26.405097 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:26.427959 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e602c8-0142-4623-b456-51f584cfcaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:26.428607 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e602c8-0142-4623-b456-51f584cfcaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:26.428890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e602c8-0142-4623-b456-51f584cfcaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:26.429208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e602c8-0142-4623-b456-51f584cfcaf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:26.429694 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c36f2-8ea4-4235-9f91-9163fcb2da14 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:26.465124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8b393-ecb6-48c3-a1a4-d039d446bf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:26.465796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8b393-ecb6-48c3-a1a4-d039d446bf3d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:26.466083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8b393-ecb6-48c3-a1a4-d039d446bf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:26.466463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8b393-ecb6-48c3-a1a4-d039d446bf3d None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:26.467231 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8b393-ecb6-48c3-a1a4-d039d446bf3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:26.468032 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8b393-ecb6-48c3-a1a4-d039d446bf3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:26.469866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8b393-ecb6-48c3-a1a4-d039d446bf3d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:26.478121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 225/444] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:26.479152 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8b393-ecb6-48c3-a1a4-d039d446bf3d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:26.502498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e602c8-0142-4623-b456-51f584cfcaf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:26.504011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e602c8-0142-4623-b456-51f584cfcaf7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:26.585551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:26.589673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8b393-ecb6-48c3-a1a4-d039d446bf3d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:26.605777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 220/445] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:26.606651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e602c8-0142-4623-b456-51f584cfcaf7 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:26.621130 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:26.629762 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d66d90-ffa2-4ad7-84de-c8e0d7ed1512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:26.630678 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d66d90-ffa2-4ad7-84de-c8e0d7ed1512 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:26.630965 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d66d90-ffa2-4ad7-84de-c8e0d7ed1512 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:26.631247 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d66d90-ffa2-4ad7-84de-c8e0d7ed1512 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:26.632462 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d66d90-ffa2-4ad7-84de-c8e0d7ed1512 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:26.633902 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d66d90-ffa2-4ad7-84de-c8e0d7ed1512 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:26.635630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 226/446] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:26 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:26.636393 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d66d90-ffa2-4ad7-84de-c8e0d7ed1512 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:26.709957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e602c8-0142-4623-b456-51f584cfcaf7 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:26.737854 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d66d90-ffa2-4ad7-84de-c8e0d7ed1512 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:26.746508 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff24fdb-743e-4c48-bfdc-29ab9ca48ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:26.747163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff24fdb-743e-4c48-bfdc-29ab9ca48ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:26.747451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff24fdb-743e-4c48-bfdc-29ab9ca48ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:26.747736 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff24fdb-743e-4c48-bfdc-29ab9ca48ca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:26.771952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5cca9-de42-4bb2-9f7f-4d36c8bac194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:26.772809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5cca9-de42-4bb2-9f7f-4d36c8bac194 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:26.773093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5cca9-de42-4bb2-9f7f-4d36c8bac194 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:26.773370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5cca9-de42-4bb2-9f7f-4d36c8bac194 None admin] PATH_INFO: `/v3/projects/95faccee4f0940e98a9d62a275c0548c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:26.774583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5cca9-de42-4bb2-9f7f-4d36c8bac194 None admin] RBAC: Authorizing `identity:get_project(project_id=95faccee4f0940e98a9d62a275c0548c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:26.776030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5cca9-de42-4bb2-9f7f-4d36c8bac194 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:26.777711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 227/447] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:26 2022] GET /identity/v3/projects/95faccee4f0940e98a9d62a275c0548c => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:26.778493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5cca9-de42-4bb2-9f7f-4d36c8bac194 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:26.812285 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:26.819689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff24fdb-743e-4c48-bfdc-29ab9ca48ca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:26.821442 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff24fdb-743e-4c48-bfdc-29ab9ca48ca2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:26.835282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:26.880238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5cca9-de42-4bb2-9f7f-4d36c8bac194 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:26.914902 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821203f9-537f-442d-92fa-031efcb98cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:26.915765 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821203f9-537f-442d-92fa-031efcb98cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:26.916048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821203f9-537f-442d-92fa-031efcb98cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:26.916325 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821203f9-537f-442d-92fa-031efcb98cd1 None admin] PATH_INFO: `/v3/groups/8603b9badd944a858765bb119fa39bfe` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:26.917512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821203f9-537f-442d-92fa-031efcb98cd1 None admin] RBAC: Authorizing `identity:get_group(group_id=8603b9badd944a858765bb119fa39bfe)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:26.918994 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821203f9-537f-442d-92fa-031efcb98cd1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:26.921271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 228/448] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 16 16:03:26 2022] GET /identity/v3/groups/8603b9badd944a858765bb119fa39bfe => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:26.922153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821203f9-537f-442d-92fa-031efcb98cd1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:26.930175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 221/449] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:26.931358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff24fdb-743e-4c48-bfdc-29ab9ca48ca2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:27.024822 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821203f9-537f-442d-92fa-031efcb98cd1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:27.026378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:27.032879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff24fdb-743e-4c48-bfdc-29ab9ca48ca2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:27.047059 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:27.062371 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b1267-085c-41c3-acb1-2961c3c4345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:27.063255 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b1267-085c-41c3-acb1-2961c3c4345a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:27.063534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b1267-085c-41c3-acb1-2961c3c4345a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:27.063808 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b1267-085c-41c3-acb1-2961c3c4345a None admin] PATH_INFO: `/v3/groups/c913b61014fc4785b92b169d39ae4329` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:27.064981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b1267-085c-41c3-acb1-2961c3c4345a None admin] RBAC: Authorizing `identity:get_group(group_id=c913b61014fc4785b92b169d39ae4329)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:27.066411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b1267-085c-41c3-acb1-2961c3c4345a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:27.070633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 229/450] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 16 16:03:26 2022] GET /identity/v3/groups/c913b61014fc4785b92b169d39ae4329 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:27.070633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b1267-085c-41c3-acb1-2961c3c4345a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:27.071444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f8a22-4374-4dba-9139-df938d27515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:27.072115 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f8a22-4374-4dba-9139-df938d27515d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:27.072401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f8a22-4374-4dba-9139-df938d27515d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:27.072681 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f8a22-4374-4dba-9139-df938d27515d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:27.073514 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f8a22-4374-4dba-9139-df938d27515d None admin] RBAC: Adding query filter params (group.id=8603b9badd944a858765bb119fa39bfe, role.id=2c5988d189bd4b4482fb3649b9cf1de4, scope.project.id=e5669c2ec4584aa9afe502b8365fd982) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:27.073827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f8a22-4374-4dba-9139-df938d27515d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:27.075271 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f8a22-4374-4dba-9139-df938d27515d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:27.081564 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 222/451] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 16 16:03:26 2022] GET /identity/v3/role_assignments?group.id=8603b9badd944a858765bb119fa39bfe&scope.project.id=e5669c2ec4584aa9afe502b8365fd982&role.id=2c5988d189bd4b4482fb3649b9cf1de4 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:27.082358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f8a22-4374-4dba-9139-df938d27515d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:27.193353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b1267-085c-41c3-acb1-2961c3c4345a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:27.207758 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f8a22-4374-4dba-9139-df938d27515d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:27.236047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e7d01-454b-4e08-bd97-f5197f3cff41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:27.236943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e7d01-454b-4e08-bd97-f5197f3cff41 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:27.237224 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e7d01-454b-4e08-bd97-f5197f3cff41 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:27.237499 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e7d01-454b-4e08-bd97-f5197f3cff41 None admin] PATH_INFO: `/v3/projects/e5669c2ec4584aa9afe502b8365fd982` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:27.239432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e7d01-454b-4e08-bd97-f5197f3cff41 None admin] RBAC: Authorizing `identity:get_project(project_id=e5669c2ec4584aa9afe502b8365fd982)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:27.240878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e7d01-454b-4e08-bd97-f5197f3cff41 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:27.244633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 230/452] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:03:27 2022] GET /identity/v3/projects/e5669c2ec4584aa9afe502b8365fd982 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:27.248054 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e7d01-454b-4e08-bd97-f5197f3cff41 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:27.254537 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815e85-fdfa-42b1-8b73-b45e9529686e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:27.255346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815e85-fdfa-42b1-8b73-b45e9529686e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:27.255638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815e85-fdfa-42b1-8b73-b45e9529686e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:27.255912 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815e85-fdfa-42b1-8b73-b45e9529686e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:27.256787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65815e85-fdfa-42b1-8b73-b45e9529686e None admin] RBAC: Adding query filter params (group.id=c913b61014fc4785b92b169d39ae4329, role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=95faccee4f0940e98a9d62a275c0548c) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:27.257100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65815e85-fdfa-42b1-8b73-b45e9529686e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:27.258605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65815e85-fdfa-42b1-8b73-b45e9529686e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:27.266088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 223/453] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 16 16:03:27 2022] GET /identity/v3/role_assignments?group.id=c913b61014fc4785b92b169d39ae4329&scope.project.id=95faccee4f0940e98a9d62a275c0548c&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:27.299386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:27.373997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e7d01-454b-4e08-bd97-f5197f3cff41 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:27.413858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6ad07-adeb-485c-9baf-b92a02063779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:27.414782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6ad07-adeb-485c-9baf-b92a02063779 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:27.415068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6ad07-adeb-485c-9baf-b92a02063779 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:27.415349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6ad07-adeb-485c-9baf-b92a02063779 None admin] PATH_INFO: `/v3/groups/8603b9badd944a858765bb119fa39bfe` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:27.417097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6ad07-adeb-485c-9baf-b92a02063779 None admin] RBAC: Authorizing `identity:get_group(group_id=8603b9badd944a858765bb119fa39bfe)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:27.418620 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6ad07-adeb-485c-9baf-b92a02063779 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:27.420845 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 231/454] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 16 16:03:27 2022] GET /identity/v3/groups/8603b9badd944a858765bb119fa39bfe => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:27.427295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815e85-fdfa-42b1-8b73-b45e9529686e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:27.478874 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:27.539698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815e85-fdfa-42b1-8b73-b45e9529686e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:27.573821 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1662c93-abb6-4d8c-aa42-6b10f49bede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:27.574501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1662c93-abb6-4d8c-aa42-6b10f49bede2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:27.574793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1662c93-abb6-4d8c-aa42-6b10f49bede2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:27.575076 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1662c93-abb6-4d8c-aa42-6b10f49bede2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:27.575907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1662c93-abb6-4d8c-aa42-6b10f49bede2 None admin] RBAC: Adding query filter params (group.id=8603b9badd944a858765bb119fa39bfe, role.id=255c2b4827324109a6d2068c8b0316c3, scope.project.id=e5669c2ec4584aa9afe502b8365fd982) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:27.576224 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1662c93-abb6-4d8c-aa42-6b10f49bede2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:27.578877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1662c93-abb6-4d8c-aa42-6b10f49bede2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:27.584659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 224/455] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 16 16:03:27 2022] GET /identity/v3/role_assignments?group.id=8603b9badd944a858765bb119fa39bfe&scope.project.id=e5669c2ec4584aa9afe502b8365fd982&role.id=255c2b4827324109a6d2068c8b0316c3 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:30.308164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62d8dc-8541-443a-ac1f-9aff2ca3ce5b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:30.309201 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62d8dc-8541-443a-ac1f-9aff2ca3ce5b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:30.309691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62d8dc-8541-443a-ac1f-9aff2ca3ce5b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:30.312247 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 232/456] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:30.317990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfc7ae-dd81-4313-80a2-4f15d667d534 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:30.318872 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfc7ae-dd81-4313-80a2-4f15d667d534 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:30.319383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfc7ae-dd81-4313-80a2-4f15d667d534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:30.343668 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-73dfc7ae-dd81-4313-80a2-4f15d667d534 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:30.345226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-73dfc7ae-dd81-4313-80a2-4f15d667d534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:30.436164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 225/457] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:30.484038 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62d8dc-8541-443a-ac1f-9aff2ca3ce5b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:30.594597 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fe25b-b7dc-4703-97eb-98cdb6881683 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:30.594886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fe25b-b7dc-4703-97eb-98cdb6881683 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:30.595085 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fe25b-b7dc-4703-97eb-98cdb6881683 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:30.596462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 226/458] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:03:30.601568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888821d-2fd3-437f-97ef-e4384dc3467b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:30.602117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888821d-2fd3-437f-97ef-e4384dc3467b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:30.602639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888821d-2fd3-437f-97ef-e4384dc3467b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:30.620316 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-c888821d-2fd3-437f-97ef-e4384dc3467b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:30.621860 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c888821d-2fd3-437f-97ef-e4384dc3467b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:30.635121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62d8dc-8541-443a-ac1f-9aff2ca3ce5b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:30.644042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:30.652292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:30.695354 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227a12c-32f7-49fe-af82-508dae50406a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:30.696779 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227a12c-32f7-49fe-af82-508dae50406a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:30.697261 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227a12c-32f7-49fe-af82-508dae50406a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:30.697733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227a12c-32f7-49fe-af82-508dae50406a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:30.709996 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227a12c-32f7-49fe-af82-508dae50406a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:30.712324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227a12c-32f7-49fe-af82-508dae50406a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:30.736375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f227a12c-32f7-49fe-af82-508dae50406a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:30.736375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:30.736375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:30.736375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:30.736375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:30.736375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:30.736375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:30.736375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:30.736375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:30.736375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:30.736375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:30.736375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:30.736375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:30.736375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:30.736375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:30.737330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:30.738188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:30.738188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:30.738188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:30.738188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:30.743029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 227/459] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:03:30.750154 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 233/460] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:30.751913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888821d-2fd3-437f-97ef-e4384dc3467b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:30.792921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227a12c-32f7-49fe-af82-508dae50406a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:30.946540 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888821d-2fd3-437f-97ef-e4384dc3467b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:30.979838 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227a12c-32f7-49fe-af82-508dae50406a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:30.990038 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc88554-d279-4fa3-9b27-e3e777606b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:30.991244 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc88554-d279-4fa3-9b27-e3e777606b37 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:30.991953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc88554-d279-4fa3-9b27-e3e777606b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:30.992802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc88554-d279-4fa3-9b27-e3e777606b37 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:30.994081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc88554-d279-4fa3-9b27-e3e777606b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:30.994569 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc88554-d279-4fa3-9b27-e3e777606b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:30.996885 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc88554-d279-4fa3-9b27-e3e777606b37 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:31.014614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 228/461] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:31.017054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82043d-9beb-423a-bffc-3c9198ba1c74 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:31.017499 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82043d-9beb-423a-bffc-3c9198ba1c74 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:31.017921 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82043d-9beb-423a-bffc-3c9198ba1c74 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:31.020212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 229/462] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:31.022234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24976f-7a8d-4e48-8816-ef42fcfd0c2d None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:31.022985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24976f-7a8d-4e48-8816-ef42fcfd0c2d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:31.023734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24976f-7a8d-4e48-8816-ef42fcfd0c2d None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:31.026133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 230/463] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:31.027583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24976f-7a8d-4e48-8816-ef42fcfd0c2d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:31.034211 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe61de7-b7b3-4102-9cb0-0f0d9cbd5411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:31.035245 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe61de7-b7b3-4102-9cb0-0f0d9cbd5411 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:31.035529 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe61de7-b7b3-4102-9cb0-0f0d9cbd5411 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:31.035805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe61de7-b7b3-4102-9cb0-0f0d9cbd5411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:31.047530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe61de7-b7b3-4102-9cb0-0f0d9cbd5411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:31.049614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe61de7-b7b3-4102-9cb0-0f0d9cbd5411 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:31.057378 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:31.070298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-cfe61de7-b7b3-4102-9cb0-0f0d9cbd5411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:31.070298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:31.070298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:31.070298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:31.070298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:31.070298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:31.070298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:31.070298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:31.070298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:31.070298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:31.070298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:31.070298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:31.070298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:31.070298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:31.070298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:31.071586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:31.073077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:31.073077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:31.073077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:31.073077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:31.073077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 234/464] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:03:31.073340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb2f40-a181-4f51-93ad-34e95948b82c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:31.073586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb2f40-a181-4f51-93ad-34e95948b82c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:31.073863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb2f40-a181-4f51-93ad-34e95948b82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:31.091765 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e0bb2f40-a181-4f51-93ad-34e95948b82c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:31.093088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e0bb2f40-a181-4f51-93ad-34e95948b82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:31.096449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:31.154728 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24976f-7a8d-4e48-8816-ef42fcfd0c2d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:31.168197 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 235/465] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:31.169293 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d100382-7553-46fa-a1a7-ca6a6ddc41f6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:31.169582 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d100382-7553-46fa-a1a7-ca6a6ddc41f6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:31.169859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d100382-7553-46fa-a1a7-ca6a6ddc41f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:31.188663 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7d100382-7553-46fa-a1a7-ca6a6ddc41f6 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:31.189926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7d100382-7553-46fa-a1a7-ca6a6ddc41f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:31.199808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91740c0-3dd0-4e23-8940-a08b911a8a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:31.201246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91740c0-3dd0-4e23-8940-a08b911a8a03 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:31.201970 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91740c0-3dd0-4e23-8940-a08b911a8a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:31.202399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91740c0-3dd0-4e23-8940-a08b911a8a03 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:31.203298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91740c0-3dd0-4e23-8940-a08b911a8a03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:31.204894 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91740c0-3dd0-4e23-8940-a08b911a8a03 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:31.230472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 231/466] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:03:31 2022] POST /identity/v3/users => generated 246 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:03:31.230472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91740c0-3dd0-4e23-8940-a08b911a8a03 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:31.278879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 236/467] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:31.280508 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d100382-7553-46fa-a1a7-ca6a6ddc41f6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:31.355922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:31.392732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91740c0-3dd0-4e23-8940-a08b911a8a03 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:31.409166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:31.451140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c6036-dfe7-4f9f-9452-edf5a7d99444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:31.451461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d100382-7553-46fa-a1a7-ca6a6ddc41f6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:31.452505 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6036-dfe7-4f9f-9452-edf5a7d99444 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:31.453226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6036-dfe7-4f9f-9452-edf5a7d99444 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:31.453691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6036-dfe7-4f9f-9452-edf5a7d99444 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:31.454697 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c6036-dfe7-4f9f-9452-edf5a7d99444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:31.455196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c6036-dfe7-4f9f-9452-edf5a7d99444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:31.456765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c6036-dfe7-4f9f-9452-edf5a7d99444 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:31.474198 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 232/468] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:31.474198 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c6036-dfe7-4f9f-9452-edf5a7d99444 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:31.503122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26b002-0384-40a9-a49a-5c916cd8f49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:31.504563 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26b002-0384-40a9-a49a-5c916cd8f49f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:31.505058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26b002-0384-40a9-a49a-5c916cd8f49f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:31.505333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26b002-0384-40a9-a49a-5c916cd8f49f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:31.517432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26b002-0384-40a9-a49a-5c916cd8f49f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:31.518929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26b002-0384-40a9-a49a-5c916cd8f49f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:31.543855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ad26b002-0384-40a9-a49a-5c916cd8f49f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:31.543855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:31.543855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:31.543855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:31.543855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:31.543855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:31.543855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:31.543855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:31.543855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:31.543855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:31.543855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:31.543855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:31.543855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:31.543855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:31.543855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:31.544776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:31.546626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:31.546626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:31.546626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:31.546626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:31.546626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 237/469] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:31.547524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26b002-0384-40a9-a49a-5c916cd8f49f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:31.609561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c6036-dfe7-4f9f-9452-edf5a7d99444 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:31.654134 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe9205-47a5-4e7c-9c20-1e38a329b35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:31.656647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe9205-47a5-4e7c-9c20-1e38a329b35c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:31.657105 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe9205-47a5-4e7c-9c20-1e38a329b35c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:31.657530 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe9205-47a5-4e7c-9c20-1e38a329b35c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:31.669100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:31.673678 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe9205-47a5-4e7c-9c20-1e38a329b35c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:31.676031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe9205-47a5-4e7c-9c20-1e38a329b35c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:31.684893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26b002-0384-40a9-a49a-5c916cd8f49f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:31.700733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-82fe9205-47a5-4e7c-9c20-1e38a329b35c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:31.700733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:31.700733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:31.700733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:31.700733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:31.700733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:31.700733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:31.700733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:31.700733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:31.700733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:31.700733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:31.700733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:31.700733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:31.700733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:31.700733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:31.702306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:31.703886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:31.703886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:31.703886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:31.703886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:31.706163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 233/470] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:31.707535 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe9205-47a5-4e7c-9c20-1e38a329b35c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:31.716564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:31.733708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434ea95-1f05-4ef6-9e06-c3547baded5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:31.735439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434ea95-1f05-4ef6-9e06-c3547baded5f None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:31.736001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434ea95-1f05-4ef6-9e06-c3547baded5f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:31.736377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434ea95-1f05-4ef6-9e06-c3547baded5f None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:31.737197 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434ea95-1f05-4ef6-9e06-c3547baded5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:31.738879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434ea95-1f05-4ef6-9e06-c3547baded5f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:31.765571 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 238/471] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:03:31 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:03:31.766782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434ea95-1f05-4ef6-9e06-c3547baded5f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:31.867783 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe9205-47a5-4e7c-9c20-1e38a329b35c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:31.924245 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ee094-b749-43ea-885e-aab0a9d8fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:31.924950 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ee094-b749-43ea-885e-aab0a9d8fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:31.925550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ee094-b749-43ea-885e-aab0a9d8fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:31.925865 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ee094-b749-43ea-885e-aab0a9d8fdb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:31.927201 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ee094-b749-43ea-885e-aab0a9d8fdb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:31.927201 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ee094-b749-43ea-885e-aab0a9d8fdb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:31.928392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ee094-b749-43ea-885e-aab0a9d8fdb7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:31.929704 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434ea95-1f05-4ef6-9e06-c3547baded5f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:31.942789 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 234/472] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:31.944538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20b407-2a95-4543-8c8a-63f474ddcfe5 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:31.944835 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20b407-2a95-4543-8c8a-63f474ddcfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:31.945117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20b407-2a95-4543-8c8a-63f474ddcfe5 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:31.946704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 235/473] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:31.952734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20b407-2a95-4543-8c8a-63f474ddcfe5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:31.970078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb493a5-f331-4d88-b436-81aad5fa79bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:31.970792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb493a5-f331-4d88-b436-81aad5fa79bb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:31.971078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb493a5-f331-4d88-b436-81aad5fa79bb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:31.971345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb493a5-f331-4d88-b436-81aad5fa79bb None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:31.972086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb493a5-f331-4d88-b436-81aad5fa79bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:31.972394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb493a5-f331-4d88-b436-81aad5fa79bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:31.973784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb493a5-f331-4d88-b436-81aad5fa79bb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:31.987149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 239/474] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:31.988452 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf27e9a-77fb-404f-be6c-78a5847a6929 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:31.988733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf27e9a-77fb-404f-be6c-78a5847a6929 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:31.989014 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf27e9a-77fb-404f-be6c-78a5847a6929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:32.005670 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-dbf27e9a-77fb-404f-be6c-78a5847a6929 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:32.006970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dbf27e9a-77fb-404f-be6c-78a5847a6929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:32.020925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:32.044484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:32.091932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 240/475] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:32.095237 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20b407-2a95-4543-8c8a-63f474ddcfe5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:32.096471 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf27e9a-77fb-404f-be6c-78a5847a6929 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:32.145132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330595aa-2716-4fff-be11-c2700440309a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:32.146089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330595aa-2716-4fff-be11-c2700440309a None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:32.146564 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330595aa-2716-4fff-be11-c2700440309a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:32.146987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330595aa-2716-4fff-be11-c2700440309a None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:32.147833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330595aa-2716-4fff-be11-c2700440309a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:32.149546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330595aa-2716-4fff-be11-c2700440309a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:32.172442 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 236/476] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:03:31 2022] POST /identity/v3/users => generated 249 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:03:32.173836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330595aa-2716-4fff-be11-c2700440309a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:32.217394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf27e9a-77fb-404f-be6c-78a5847a6929 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:32.255538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f522e05-9d2e-4c03-8bc0-e84cee0b8f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:32.256310 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f522e05-9d2e-4c03-8bc0-e84cee0b8f5c None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:32.256689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f522e05-9d2e-4c03-8bc0-e84cee0b8f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:32.257297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f522e05-9d2e-4c03-8bc0-e84cee0b8f5c None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:32.257820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f522e05-9d2e-4c03-8bc0-e84cee0b8f5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:32.259363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f522e05-9d2e-4c03-8bc0-e84cee0b8f5c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:32.281822 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 241/477] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:03:32 2022] POST /identity/v3/users => generated 248 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:03:32.300607 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330595aa-2716-4fff-be11-c2700440309a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:32.312615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:32.344111 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171f540-ab71-48b6-97cd-eed806f401b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:32.345089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171f540-ab71-48b6-97cd-eed806f401b8 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:32.345520 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171f540-ab71-48b6-97cd-eed806f401b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:32.345961 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171f540-ab71-48b6-97cd-eed806f401b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:32.346930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171f540-ab71-48b6-97cd-eed806f401b8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:32.348511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171f540-ab71-48b6-97cd-eed806f401b8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:32.355456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.sql.core [None req-7171f540-ab71-48b6-97cd-eed806f401b8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 16:03:32.355456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 16:03:32.355456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [parameters: {'id': '5cdcd663151846cea7bc432127062a10', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 16:03:32.355456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80324) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 16:03:32.373260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-7171f540-ab71-48b6-97cd-eed806f401b8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 16:03:32.373260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:32.373260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 16:03:32.373260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 16:03:32.373260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 16:03:32.373260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 16:03:32.373260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 16:03:32.373260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 16:03:32.373260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 16:03:32.373260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application conn.query(q) Jun 16 16:03:32.373260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 16:03:32.373260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 16:03:32.373260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 16:03:32.373260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result.read() Jun 16 16:03:32.373260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 16:03:32.375532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application next(self.gen) Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application yield resource Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application next(self.gen) Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise self.value Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application session.commit() Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 16:03:32.376538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.session.flush() Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application compat.raise_( Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 16:03:32.377383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 16:03:32.378257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application conn.query(q) Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result.read() Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 16:03:32.380539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [parameters: {'id': '5cdcd663151846cea7bc432127062a10', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:32.381892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 16:03:32.382984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:32.383955 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 237/478] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jun 16 16:03:32 2022] POST /identity/v3/roles => generated 144 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:32.384170 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f522e05-9d2e-4c03-8bc0-e84cee0b8f5c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:32.431824 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:32.542147 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f522e05-9d2e-4c03-8bc0-e84cee0b8f5c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:32.581921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6ecc7-8e7e-46bf-b30d-9e96ca6fe735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:32.583130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6ecc7-8e7e-46bf-b30d-9e96ca6fe735 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:32.583633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6ecc7-8e7e-46bf-b30d-9e96ca6fe735 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:32.584096 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6ecc7-8e7e-46bf-b30d-9e96ca6fe735 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:32.597407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6ecc7-8e7e-46bf-b30d-9e96ca6fe735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b1a6ecc7-8e7e-46bf-b30d-9e96ca6fe735 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:32.605599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:32.606538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:32.607341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:32.607341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:32.607341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:32.607341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:32.607341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:32.607341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:32.607341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:32.607341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:32.607341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:32.607341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:32.607341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 16:03:32.607341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:32.607341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 242/479] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:03:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:32.613640 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171f540-ab71-48b6-97cd-eed806f401b8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:32.727968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171f540-ab71-48b6-97cd-eed806f401b8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:32.773513 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b6fb2-589e-47df-97be-fcc70122df02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:32.774590 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b6fb2-589e-47df-97be-fcc70122df02 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:32.775092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b6fb2-589e-47df-97be-fcc70122df02 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:32.775556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b6fb2-589e-47df-97be-fcc70122df02 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:32.776491 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b6fb2-589e-47df-97be-fcc70122df02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:32.776986 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b6fb2-589e-47df-97be-fcc70122df02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:32.778571 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b6fb2-589e-47df-97be-fcc70122df02 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:32.789212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 238/480] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:33.893238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c19ae-1548-4f54-b58a-860fd64de1ac None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:33.893755 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c19ae-1548-4f54-b58a-860fd64de1ac None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:33.893830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c19ae-1548-4f54-b58a-860fd64de1ac None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:33.895489 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 243/481] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:33.900256 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d3cac-ad83-4445-ae75-35b7f8d16457 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:33.900640 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d3cac-ad83-4445-ae75-35b7f8d16457 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:33.900822 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d3cac-ad83-4445-ae75-35b7f8d16457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:33.923115 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-531d3cac-ad83-4445-ae75-35b7f8d16457 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:33.924305 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-531d3cac-ad83-4445-ae75-35b7f8d16457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:33.968528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:34.020029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 239/482] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:34.058923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c19ae-1548-4f54-b58a-860fd64de1ac None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:34.170181 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:34.190144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c19ae-1548-4f54-b58a-860fd64de1ac None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:34.225892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e42df1-172a-4d5a-8f13-a3e78297d7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:34.226721 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e42df1-172a-4d5a-8f13-a3e78297d7fa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:34.227005 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e42df1-172a-4d5a-8f13-a3e78297d7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:34.227282 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e42df1-172a-4d5a-8f13-a3e78297d7fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:34.238494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e42df1-172a-4d5a-8f13-a3e78297d7fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-61e42df1-172a-4d5a-8f13-a3e78297d7fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:34.246172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:34.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:34.247871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:34.247871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:34.247871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:34.247871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:34.247871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:34.247871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:34.247871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:34.247871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:34.247871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:34.247871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:34.247871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:34.247871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:34.247871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 244/483] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:34.259786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d3cac-ad83-4445-ae75-35b7f8d16457 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:34.382128 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d3cac-ad83-4445-ae75-35b7f8d16457 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:34.424575 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf403fb-895f-40f4-a5ff-25c92baf2797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:34.425190 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf403fb-895f-40f4-a5ff-25c92baf2797 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:34.425477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf403fb-895f-40f4-a5ff-25c92baf2797 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:34.425756 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf403fb-895f-40f4-a5ff-25c92baf2797 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:34.426564 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf403fb-895f-40f4-a5ff-25c92baf2797 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:34.426877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf403fb-895f-40f4-a5ff-25c92baf2797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:34.428309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf403fb-895f-40f4-a5ff-25c92baf2797 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:34.437848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 240/484] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:34.443013 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e42df1-172a-4d5a-8f13-a3e78297d7fa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:34.549453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6bd7-de2c-456b-b111-34d6a72b2562 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:34.549767 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6bd7-de2c-456b-b111-34d6a72b2562 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:34.550022 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6bd7-de2c-456b-b111-34d6a72b2562 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:34.551427 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 241/485] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:34.568774 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49dcb2-a506-4a4a-975a-bd9e09aa4d82 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:34.568774 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49dcb2-a506-4a4a-975a-bd9e09aa4d82 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:34.568774 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49dcb2-a506-4a4a-975a-bd9e09aa4d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:34.581897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e42df1-172a-4d5a-8f13-a3e78297d7fa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:34.595563 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-cf49dcb2-a506-4a4a-975a-bd9e09aa4d82 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:34.597167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cf49dcb2-a506-4a4a-975a-bd9e09aa4d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:34.628768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:34.635708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d950b-16e4-4310-8eb6-5ec63d7cacda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:34.636523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d950b-16e4-4310-8eb6-5ec63d7cacda None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:34.636809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d950b-16e4-4310-8eb6-5ec63d7cacda None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:34.637088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d950b-16e4-4310-8eb6-5ec63d7cacda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:34.663175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d950b-16e4-4310-8eb6-5ec63d7cacda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:34.664986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d950b-16e4-4310-8eb6-5ec63d7cacda None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:34.671696 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:34.693892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0a0d950b-16e4-4310-8eb6-5ec63d7cacda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:34.693892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:34.693892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:34.693892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:34.693892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:34.693892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:34.693892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:34.693892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:34.693892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:34.693892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:34.693892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:34.693892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:34.693892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:34.693892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:34.693892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:34.694985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:34.696004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:34.696004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:34.696004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:34.696004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:34.698371 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 245/486] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:03:34.704481 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d950b-16e4-4310-8eb6-5ec63d7cacda None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:34.716944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 242/487] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:34.749495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49dcb2-a506-4a4a-975a-bd9e09aa4d82 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:34.916599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d950b-16e4-4310-8eb6-5ec63d7cacda None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:34.936928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49dcb2-a506-4a4a-975a-bd9e09aa4d82 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:34.984806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92227af-7256-4d28-b506-d930ae853830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:34.985405 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92227af-7256-4d28-b506-d930ae853830 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:34.985691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92227af-7256-4d28-b506-d930ae853830 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:34.985974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92227af-7256-4d28-b506-d930ae853830 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:34.986743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92227af-7256-4d28-b506-d930ae853830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:34.987054 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92227af-7256-4d28-b506-d930ae853830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:34.988469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92227af-7256-4d28-b506-d930ae853830 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:35.006391 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe4e67-940b-453b-b37b-0cd1a3d5e621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:35.007262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe4e67-940b-453b-b37b-0cd1a3d5e621 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:35.007552 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe4e67-940b-453b-b37b-0cd1a3d5e621 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:35.007831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe4e67-940b-453b-b37b-0cd1a3d5e621 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:35.020570 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 246/488] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:35.026990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe4e67-940b-453b-b37b-0cd1a3d5e621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:35.032133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92227af-7256-4d28-b506-d930ae853830 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-31fe4e67-940b-453b-b37b-0cd1a3d5e621 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:35.049348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:35.050366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:35.051889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:35.051889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:35.051889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:35.051889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:35.051889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:35.051889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:35.051889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:35.051889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:35.051889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:35.051889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:35.051889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:35.051889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:35.053341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 243/489] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:03:35.063675 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe4e67-940b-453b-b37b-0cd1a3d5e621 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:35.107745 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:35.128823 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:35.180469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92227af-7256-4d28-b506-d930ae853830 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:35.199368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe4e67-940b-453b-b37b-0cd1a3d5e621 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:35.223461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9addac-1e9f-4927-9248-15d26f09eb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:35.224683 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9addac-1e9f-4927-9248-15d26f09eb74 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:35.225181 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9addac-1e9f-4927-9248-15d26f09eb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:35.225716 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9addac-1e9f-4927-9248-15d26f09eb74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:35.235724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9addac-1e9f-4927-9248-15d26f09eb74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:35.238111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9addac-1e9f-4927-9248-15d26f09eb74 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:35.239458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2455f30-bd44-4dff-a7b1-6684f746cc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:35.240151 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2455f30-bd44-4dff-a7b1-6684f746cc28 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:35.240436 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2455f30-bd44-4dff-a7b1-6684f746cc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:35.240716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2455f30-bd44-4dff-a7b1-6684f746cc28 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:35.241467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2455f30-bd44-4dff-a7b1-6684f746cc28 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:35.241981 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2455f30-bd44-4dff-a7b1-6684f746cc28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:35.243584 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2455f30-bd44-4dff-a7b1-6684f746cc28 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:35.257883 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 244/490] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0e9addac-1e9f-4927-9248-15d26f09eb74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:35.258206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:35.259132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:35.260017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:35.260017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:35.260017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:35.260017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:35.260017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:35.260017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:35.260017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:35.260017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:35.260017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:03:35.260017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:35.260017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 247/491] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 16 16:03:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:35.260572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9addac-1e9f-4927-9248-15d26f09eb74 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:35.262326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dea22-da0c-4142-8c2a-71aa5893a6d6 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:35.262791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dea22-da0c-4142-8c2a-71aa5893a6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:35.263241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dea22-da0c-4142-8c2a-71aa5893a6d6 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:35.265933 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 245/492] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:35.270782 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dea22-da0c-4142-8c2a-71aa5893a6d6 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:35.358979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:35.382266 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9addac-1e9f-4927-9248-15d26f09eb74 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:35.384645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dea22-da0c-4142-8c2a-71aa5893a6d6 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:35.400820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:35.421088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891c053-1a91-4411-a21f-b98b5900535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:35.421969 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891c053-1a91-4411-a21f-b98b5900535b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:35.422254 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891c053-1a91-4411-a21f-b98b5900535b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:35.422558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891c053-1a91-4411-a21f-b98b5900535b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:35.434384 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891c053-1a91-4411-a21f-b98b5900535b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:35.435896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891c053-1a91-4411-a21f-b98b5900535b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:35.438222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5be95-f5ba-4fce-b0b0-2ec490a99c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:35.439062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5be95-f5ba-4fce-b0b0-2ec490a99c2d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:35.439521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5be95-f5ba-4fce-b0b0-2ec490a99c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:35.439910 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5be95-f5ba-4fce-b0b0-2ec490a99c2d None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:35.440773 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5be95-f5ba-4fce-b0b0-2ec490a99c2d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:35.441093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5be95-f5ba-4fce-b0b0-2ec490a99c2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:35.443247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5be95-f5ba-4fce-b0b0-2ec490a99c2d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:35.456458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-7891c053-1a91-4411-a21f-b98b5900535b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:35.456458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:35.456458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:35.456458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:35.456458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:35.456458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:35.456458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:35.456458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:35.456458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:35.456458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:35.456458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:35.456458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:35.456458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:35.456458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:35.456458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:35.457373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:35.462977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:35.462977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:35.462977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:35.462977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:35.462977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 248/493] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:35.462977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b028af6-eab8-40cc-ace8-f6206a515570 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:35.462977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b028af6-eab8-40cc-ace8-f6206a515570 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:35.462977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b028af6-eab8-40cc-ace8-f6206a515570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:35.481059 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4b028af6-eab8-40cc-ace8-f6206a515570 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:35.482269 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4b028af6-eab8-40cc-ace8-f6206a515570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:35.488228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 246/494] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 16 16:03:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:35.489509 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293ae3f-6a52-4eee-98b8-10bc3692ae5d None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:35.489807 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293ae3f-6a52-4eee-98b8-10bc3692ae5d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:35.490089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293ae3f-6a52-4eee-98b8-10bc3692ae5d None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:35.494944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 247/495] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:35.494944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293ae3f-6a52-4eee-98b8-10bc3692ae5d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:35.570735 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 249/496] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:35.571921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b028af6-eab8-40cc-ace8-f6206a515570 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:35.614758 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293ae3f-6a52-4eee-98b8-10bc3692ae5d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:35.648914 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb1a5d-982a-45fc-92d5-e4955b85127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:35.649582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb1a5d-982a-45fc-92d5-e4955b85127f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:35.649884 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb1a5d-982a-45fc-92d5-e4955b85127f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:35.650179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb1a5d-982a-45fc-92d5-e4955b85127f None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:35.650939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb1a5d-982a-45fc-92d5-e4955b85127f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:35.651250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb1a5d-982a-45fc-92d5-e4955b85127f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:35.652630 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb1a5d-982a-45fc-92d5-e4955b85127f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:35.655287 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:35.664882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 248/497] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:35.665919 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7802288-af7e-45cc-9ee4-c27561619075 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:35.666204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7802288-af7e-45cc-9ee4-c27561619075 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:35.666512 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7802288-af7e-45cc-9ee4-c27561619075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:35.675239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:35.680410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b028af6-eab8-40cc-ace8-f6206a515570 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:35.683288 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e7802288-af7e-45cc-9ee4-c27561619075 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:35.684473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e7802288-af7e-45cc-9ee4-c27561619075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:35.715191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744807a-5ead-4c6d-b0da-491095a22ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:35.715846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744807a-5ead-4c6d-b0da-491095a22ecb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:35.716292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744807a-5ead-4c6d-b0da-491095a22ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:35.716574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744807a-5ead-4c6d-b0da-491095a22ecb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:35.757576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 249/498] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:35.758843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86fe04-c738-4fb3-94ee-2aafccd111b2 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:35.759140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86fe04-c738-4fb3-94ee-2aafccd111b2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:35.759424 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86fe04-c738-4fb3-94ee-2aafccd111b2 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:35.760687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 250/499] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:35.761385 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86fe04-c738-4fb3-94ee-2aafccd111b2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:35.803729 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744807a-5ead-4c6d-b0da-491095a22ecb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:35.805207 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744807a-5ead-4c6d-b0da-491095a22ecb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:35.868578 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86fe04-c738-4fb3-94ee-2aafccd111b2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:35.894335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:35.903217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bbc05-ceaa-436a-9e5c-5b9c8cff452c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:35.903786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:35.904023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bbc05-ceaa-436a-9e5c-5b9c8cff452c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:35.904312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bbc05-ceaa-436a-9e5c-5b9c8cff452c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:35.905195 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bbc05-ceaa-436a-9e5c-5b9c8cff452c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:35.914089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 250/500] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:35.914838 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744807a-5ead-4c6d-b0da-491095a22ecb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:35.916173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bbc05-ceaa-436a-9e5c-5b9c8cff452c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-249bbc05-ceaa-436a-9e5c-5b9c8cff452c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:35.924743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:35.925652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:35.926506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:35.926506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:35.926506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:35.926506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:35.926506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:35.926506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:35.926506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:35.926506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:35.926506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:35.926506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:35.926506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:35.926506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:35.926506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 251/501] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:35.927246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc6e7a-ec1a-4054-a709-15c1c9e47a30 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:35.927580 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc6e7a-ec1a-4054-a709-15c1c9e47a30 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:35.927826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc6e7a-ec1a-4054-a709-15c1c9e47a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:35.944554 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-dbdc6e7a-ec1a-4054-a709-15c1c9e47a30 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:35.945760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-dbdc6e7a-ec1a-4054-a709-15c1c9e47a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:36.021307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 252/502] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:36.021477 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744807a-5ead-4c6d-b0da-491095a22ecb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:36.022075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc6e7a-ec1a-4054-a709-15c1c9e47a30 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:36.068062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e71065-be29-4644-b861-94f09bbb6ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:36.068861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e71065-be29-4644-b861-94f09bbb6ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:36.069140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e71065-be29-4644-b861-94f09bbb6ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:36.069419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e71065-be29-4644-b861-94f09bbb6ec0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:36.076889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e71065-be29-4644-b861-94f09bbb6ec0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:36.078322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e71065-be29-4644-b861-94f09bbb6ec0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e4e71065-be29-4644-b861-94f09bbb6ec0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:36.093092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:36.094162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:36.095233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:36.095233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:36.095233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:36.095233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:36.095233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:36.095233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:36.095233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:36.095233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:36.095233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 16:03:36.095233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:36.095233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 251/503] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:36.095233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e71065-be29-4644-b861-94f09bbb6ec0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:36.127306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc6e7a-ec1a-4054-a709-15c1c9e47a30 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:36.144955 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:36.154510 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:36.163751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b838152-bc37-4e36-8745-7f9fb557b17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:36.164551 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b838152-bc37-4e36-8745-7f9fb557b17c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:36.164840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b838152-bc37-4e36-8745-7f9fb557b17c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:36.165138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b838152-bc37-4e36-8745-7f9fb557b17c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:36.176567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b838152-bc37-4e36-8745-7f9fb557b17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-5b838152-bc37-4e36-8745-7f9fb557b17c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:36.184394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:36.185270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:36.186067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:36.186067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:36.186067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:36.186067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:36.186067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:36.186067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:36.186067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:36.186067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:36.186067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:36.186067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:36.186067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:36.186067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:36.186067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 253/504] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:36.187404 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b838152-bc37-4e36-8745-7f9fb557b17c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:36.197250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e71065-be29-4644-b861-94f09bbb6ec0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:36.233427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196e3ab-bb07-4580-a740-5a13e2d82118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:36.234212 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196e3ab-bb07-4580-a740-5a13e2d82118 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:36.234522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196e3ab-bb07-4580-a740-5a13e2d82118 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:36.234797 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196e3ab-bb07-4580-a740-5a13e2d82118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:36.244865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196e3ab-bb07-4580-a740-5a13e2d82118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:36.246325 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196e3ab-bb07-4580-a740-5a13e2d82118 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:36.266621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d196e3ab-bb07-4580-a740-5a13e2d82118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:36.266621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:36.266621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:36.266621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:36.266621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:36.266621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:36.266621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:36.266621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:36.266621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:36.266621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:36.266621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:36.266621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:36.266621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:36.266621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:36.266621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:36.267525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:36.268368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:36.268368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:36.268368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:36.268368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:36.268368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 252/505] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:36.268640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196e3ab-bb07-4580-a740-5a13e2d82118 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:36.296552 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b838152-bc37-4e36-8745-7f9fb557b17c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:36.331773 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746d507-d28c-4c62-a463-174756bddd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:36.332441 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746d507-d28c-4c62-a463-174756bddd12 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:36.332726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746d507-d28c-4c62-a463-174756bddd12 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:36.333004 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746d507-d28c-4c62-a463-174756bddd12 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:36.333749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746d507-d28c-4c62-a463-174756bddd12 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:36.334047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746d507-d28c-4c62-a463-174756bddd12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:36.335475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746d507-d28c-4c62-a463-174756bddd12 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:36.348799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 254/506] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:36.348799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746d507-d28c-4c62-a463-174756bddd12 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:36.371449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196e3ab-bb07-4580-a740-5a13e2d82118 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:36.382088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:36.387832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:36.407622 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373c147-b38e-4626-94d2-5346dff0622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:36.408424 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373c147-b38e-4626-94d2-5346dff0622d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:36.408710 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373c147-b38e-4626-94d2-5346dff0622d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:36.408991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373c147-b38e-4626-94d2-5346dff0622d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:36.419080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373c147-b38e-4626-94d2-5346dff0622d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:36.420585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373c147-b38e-4626-94d2-5346dff0622d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:36.437953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8373c147-b38e-4626-94d2-5346dff0622d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:36.437953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:36.437953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:36.437953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:36.437953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:36.437953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:36.437953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:36.437953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:36.437953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:36.437953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:36.437953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:36.437953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:36.437953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:36.437953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:36.437953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:36.439007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:36.439858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:36.439858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:36.439858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:36.439858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:36.439858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 253/507] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:36.440132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373c147-b38e-4626-94d2-5346dff0622d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:36.455203 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746d507-d28c-4c62-a463-174756bddd12 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:36.489434 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b464d8-f90a-4492-8291-fe6a464650ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:36.490113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b464d8-f90a-4492-8291-fe6a464650ae None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:36.490400 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b464d8-f90a-4492-8291-fe6a464650ae None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:36.490723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b464d8-f90a-4492-8291-fe6a464650ae None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:36.491560 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b464d8-f90a-4492-8291-fe6a464650ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:36.491877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b464d8-f90a-4492-8291-fe6a464650ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:36.493333 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b464d8-f90a-4492-8291-fe6a464650ae None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:36.510070 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 255/508] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jun 16 16:03:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:36.510902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b464d8-f90a-4492-8291-fe6a464650ae None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:36.544314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373c147-b38e-4626-94d2-5346dff0622d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:36.580442 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d07a3-031f-44ae-ac8c-6af47d09110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:36.581037 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d07a3-031f-44ae-ac8c-6af47d09110d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:36.581316 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d07a3-031f-44ae-ac8c-6af47d09110d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:36.581590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d07a3-031f-44ae-ac8c-6af47d09110d None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:36.582329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d07a3-031f-44ae-ac8c-6af47d09110d None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:36.582663 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d07a3-031f-44ae-ac8c-6af47d09110d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:36.584047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d07a3-031f-44ae-ac8c-6af47d09110d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:36.592450 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 254/509] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:36.593172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d07a3-031f-44ae-ac8c-6af47d09110d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:36.610293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:36.617541 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b464d8-f90a-4492-8291-fe6a464650ae None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:36.619305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:36.653352 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38be24-29ca-4aab-9791-bf951ec8704c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:36.654030 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38be24-29ca-4aab-9791-bf951ec8704c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:36.654310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38be24-29ca-4aab-9791-bf951ec8704c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:36.654686 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38be24-29ca-4aab-9791-bf951ec8704c None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:36.655618 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38be24-29ca-4aab-9791-bf951ec8704c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:36.655933 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38be24-29ca-4aab-9791-bf951ec8704c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:36.657384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38be24-29ca-4aab-9791-bf951ec8704c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:36.668404 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 256/510] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:36.669199 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38be24-29ca-4aab-9791-bf951ec8704c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:36.695450 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d07a3-031f-44ae-ac8c-6af47d09110d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:36.728617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08179ec2-0af2-4aae-97a5-71e87974aa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:36.729635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08179ec2-0af2-4aae-97a5-71e87974aa4c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:36.730068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08179ec2-0af2-4aae-97a5-71e87974aa4c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:36.730342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08179ec2-0af2-4aae-97a5-71e87974aa4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:36.740617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08179ec2-0af2-4aae-97a5-71e87974aa4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:36.742053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08179ec2-0af2-4aae-97a5-71e87974aa4c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:36.760811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-08179ec2-0af2-4aae-97a5-71e87974aa4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:36.760811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:36.760811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:36.760811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:36.760811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:36.760811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:36.760811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:36.760811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:36.760811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:36.760811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:36.760811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:36.760811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:36.760811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:36.760811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:36.760811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:36.761848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:36.763291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:36.763291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:36.763291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:36.763291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:36.763291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 255/511] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:36.763291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08179ec2-0af2-4aae-97a5-71e87974aa4c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:36.773964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38be24-29ca-4aab-9791-bf951ec8704c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:36.807336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fabdf-b1fb-414f-9485-9dc0544baecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:36.808000 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fabdf-b1fb-414f-9485-9dc0544baecc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:36.808281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fabdf-b1fb-414f-9485-9dc0544baecc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:36.808559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fabdf-b1fb-414f-9485-9dc0544baecc None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:36.809271 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fabdf-b1fb-414f-9485-9dc0544baecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:36.809574 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fabdf-b1fb-414f-9485-9dc0544baecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:36.811595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fabdf-b1fb-414f-9485-9dc0544baecc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:36.823922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 257/512] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:36.824879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fabdf-b1fb-414f-9485-9dc0544baecc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:36.843331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:36.845705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:36.869296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08179ec2-0af2-4aae-97a5-71e87974aa4c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:36.905734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e93ec-759d-42db-8660-20e3b0271248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:36.906383 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e93ec-759d-42db-8660-20e3b0271248 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:36.906690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e93ec-759d-42db-8660-20e3b0271248 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:36.906964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e93ec-759d-42db-8660-20e3b0271248 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:36.928507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fabdf-b1fb-414f-9485-9dc0544baecc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:36.963369 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f1eb0-3ada-43ab-a937-8b106b2b231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:36.964164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f1eb0-3ada-43ab-a937-8b106b2b231e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:36.964447 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f1eb0-3ada-43ab-a937-8b106b2b231e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:36.964722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f1eb0-3ada-43ab-a937-8b106b2b231e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:36.974417 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e93ec-759d-42db-8660-20e3b0271248 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:36.974929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f1eb0-3ada-43ab-a937-8b106b2b231e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:36.975919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e93ec-759d-42db-8660-20e3b0271248 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:36.976362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f1eb0-3ada-43ab-a937-8b106b2b231e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:36.994283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-367f1eb0-3ada-43ab-a937-8b106b2b231e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:36.994283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:36.994283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:36.994283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:36.994283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:36.994283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:36.994283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:36.994283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:36.994283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:36.994283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:36.994283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:36.994283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:36.994283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:36.994283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:36.994283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:36.995306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:36.996173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:36.996173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:36.996173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:36.996173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:36.996173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 258/513] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:36.996467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f1eb0-3ada-43ab-a937-8b106b2b231e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:37.056828 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:37.064701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:37.081443 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 256/514] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:37.082288 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e93ec-759d-42db-8660-20e3b0271248 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:37.098777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f1eb0-3ada-43ab-a937-8b106b2b231e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:37.133133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0dc5a-1daa-442c-b510-f6162468b725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:37.133928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0dc5a-1daa-442c-b510-f6162468b725 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:37.134211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0dc5a-1daa-442c-b510-f6162468b725 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:37.134514 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0dc5a-1daa-442c-b510-f6162468b725 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:37.141402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0dc5a-1daa-442c-b510-f6162468b725 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:37.142902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0dc5a-1daa-442c-b510-f6162468b725 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:37.157323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-2ff0dc5a-1daa-442c-b510-f6162468b725 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:37.157323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:37.157323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:37.157323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:37.157323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:37.157323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:37.157323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:37.157323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:37.157323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:37.157323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:37.157323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:37.157323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:37.157323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:37.157323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:37.157323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:37.158177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:37.159083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:37.159083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:37.159083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:37.159083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:37.159083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:37.159083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:37.159083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:37.159083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:37.159083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 259/515] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:37.159628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0dc5a-1daa-442c-b510-f6162468b725 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:37.187433 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e93ec-759d-42db-8660-20e3b0271248 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:37.222163 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9f3a8-8640-4492-9e35-ef6647120172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:37.222859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9f3a8-8640-4492-9e35-ef6647120172 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:37.223140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9f3a8-8640-4492-9e35-ef6647120172 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:37.223414 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9f3a8-8640-4492-9e35-ef6647120172 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:37.224119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9f3a8-8640-4492-9e35-ef6647120172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:37.224420 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9f3a8-8640-4492-9e35-ef6647120172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:37.225789 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9f3a8-8640-4492-9e35-ef6647120172 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:37.237427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 257/516] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:37.238139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9f3a8-8640-4492-9e35-ef6647120172 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:37.269249 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0dc5a-1daa-442c-b510-f6162468b725 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:37.274359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:37.296603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:37.305078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7632744-4e5a-435f-a61e-506808101300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:37.305752 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632744-4e5a-435f-a61e-506808101300 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:37.306039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632744-4e5a-435f-a61e-506808101300 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:37.306318 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632744-4e5a-435f-a61e-506808101300 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:37.307055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7632744-4e5a-435f-a61e-506808101300 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:37.308501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7632744-4e5a-435f-a61e-506808101300 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:37.328076 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 260/517] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:03:37 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:03:37.328941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7632744-4e5a-435f-a61e-506808101300 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:37.344837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9f3a8-8640-4492-9e35-ef6647120172 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:37.394324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824907f2-d8af-417c-88e6-50d8f2125234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:37.395407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824907f2-d8af-417c-88e6-50d8f2125234 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:37.395866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824907f2-d8af-417c-88e6-50d8f2125234 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:37.396291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824907f2-d8af-417c-88e6-50d8f2125234 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:37.397172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824907f2-d8af-417c-88e6-50d8f2125234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:37.397731 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824907f2-d8af-417c-88e6-50d8f2125234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:37.399491 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824907f2-d8af-417c-88e6-50d8f2125234 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:37.415163 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 258/518] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:37.416398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824907f2-d8af-417c-88e6-50d8f2125234 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:37.458178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7632744-4e5a-435f-a61e-506808101300 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:37.495991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1f23c-71e9-49bd-98b2-b58bee87d320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:37.496804 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1f23c-71e9-49bd-98b2-b58bee87d320 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:37.497096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1f23c-71e9-49bd-98b2-b58bee87d320 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:37.497379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1f23c-71e9-49bd-98b2-b58bee87d320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:37.509377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1f23c-71e9-49bd-98b2-b58bee87d320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:37.511254 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1f23c-71e9-49bd-98b2-b58bee87d320 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:37.528157 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:37.533270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-c9a1f23c-71e9-49bd-98b2-b58bee87d320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:37.533270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:37.533270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:37.533270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:37.533270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:37.533270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:37.533270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:37.533270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:37.533270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:37.533270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:37.533270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:37.533270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:37.533270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:37.533270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:37.533270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:37.534132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:37.535383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:37.535383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:37.535383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:37.535383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:37.535617 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 261/519] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:37.537439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1f23c-71e9-49bd-98b2-b58bee87d320 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:37.542246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824907f2-d8af-417c-88e6-50d8f2125234 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:37.580478 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114aed2e-7336-4f63-b6d4-d2a424300c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:37.581159 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114aed2e-7336-4f63-b6d4-d2a424300c47 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:37.581444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114aed2e-7336-4f63-b6d4-d2a424300c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:37.581724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114aed2e-7336-4f63-b6d4-d2a424300c47 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:37.582805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114aed2e-7336-4f63-b6d4-d2a424300c47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:37.582943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114aed2e-7336-4f63-b6d4-d2a424300c47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:37.583345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:37.584286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114aed2e-7336-4f63-b6d4-d2a424300c47 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:37.608698 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 259/520] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:37.608698 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114aed2e-7336-4f63-b6d4-d2a424300c47 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:37.655195 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1f23c-71e9-49bd-98b2-b58bee87d320 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:37.689722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf06e3-d680-4314-80ab-9d93e25ae5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:37.690659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf06e3-d680-4314-80ab-9d93e25ae5ea None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:37.691010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf06e3-d680-4314-80ab-9d93e25ae5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:37.691360 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf06e3-d680-4314-80ab-9d93e25ae5ea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:37.699691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf06e3-d680-4314-80ab-9d93e25ae5ea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:37.701158 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf06e3-d680-4314-80ab-9d93e25ae5ea None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:37.716712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114aed2e-7336-4f63-b6d4-d2a424300c47 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-9acf06e3-d680-4314-80ab-9d93e25ae5ea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:37.718066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:37.719161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:37.720049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:37.720049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:37.720049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:37.720049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:37.720049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:37.720049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:37.720049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:37.720049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:37.720049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 16:03:37.720049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:37.720049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 262/521] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:37.721136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf06e3-d680-4314-80ab-9d93e25ae5ea None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:37.757533 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdec1fe-f601-4581-82c7-443cce1f3cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:37.758340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdec1fe-f601-4581-82c7-443cce1f3cde None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:37.758658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdec1fe-f601-4581-82c7-443cce1f3cde None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:37.758943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdec1fe-f601-4581-82c7-443cce1f3cde None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:37.767031 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdec1fe-f601-4581-82c7-443cce1f3cde None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:37.768495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdec1fe-f601-4581-82c7-443cce1f3cde None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9bdec1fe-f601-4581-82c7-443cce1f3cde None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:37.784387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:37.785322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:37.786349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:37.786349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:37.786349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:37.786349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:37.786349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:37.786349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:37.786349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:37.786349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:37.786349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 16:03:37.786349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:37.786349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 260/522] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:37.786349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdec1fe-f601-4581-82c7-443cce1f3cde None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:37.805252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:37.825957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:37.834353 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf06e3-d680-4314-80ab-9d93e25ae5ea None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:37.873289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77dca8-6830-4522-be1e-8cd719256741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:37.874644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77dca8-6830-4522-be1e-8cd719256741 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:37.874947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77dca8-6830-4522-be1e-8cd719256741 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:37.875203 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77dca8-6830-4522-be1e-8cd719256741 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:37.875935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77dca8-6830-4522-be1e-8cd719256741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:37.876244 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77dca8-6830-4522-be1e-8cd719256741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:37.877647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77dca8-6830-4522-be1e-8cd719256741 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:37.889649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 263/523] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:37.890802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77dca8-6830-4522-be1e-8cd719256741 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:37.897621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdec1fe-f601-4581-82c7-443cce1f3cde None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:37.935548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4a03a-ea29-4102-aa60-69d3d7f79a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:37.936784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4a03a-ea29-4102-aa60-69d3d7f79a89 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:37.937072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4a03a-ea29-4102-aa60-69d3d7f79a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:37.937515 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4a03a-ea29-4102-aa60-69d3d7f79a89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:37.938352 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4a03a-ea29-4102-aa60-69d3d7f79a89 None admin] RBAC: Adding query filter params (role.id=6da95c91bacf48f9870a114e2ab05472, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=795c029cb14b42b5b0f3987e218d4239) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:37.938697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4a03a-ea29-4102-aa60-69d3d7f79a89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:37.940142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4a03a-ea29-4102-aa60-69d3d7f79a89 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:37.950775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 261/524] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:37 2022] GET /identity/v3/role_assignments?user.id=795c029cb14b42b5b0f3987e218d4239&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=6da95c91bacf48f9870a114e2ab05472 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:37.952451 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4a03a-ea29-4102-aa60-69d3d7f79a89 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:38.008593 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77dca8-6830-4522-be1e-8cd719256741 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:38.049492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc509091-74bb-4fcb-99fc-d994f4456c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:38.050192 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc509091-74bb-4fcb-99fc-d994f4456c2e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:38.050523 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc509091-74bb-4fcb-99fc-d994f4456c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:38.050810 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc509091-74bb-4fcb-99fc-d994f4456c2e None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:38.051671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc509091-74bb-4fcb-99fc-d994f4456c2e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:38.051985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc509091-74bb-4fcb-99fc-d994f4456c2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:38.053573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc509091-74bb-4fcb-99fc-d994f4456c2e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:38.060170 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:38.073697 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 264/525] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jun 16 16:03:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:38.079439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc509091-74bb-4fcb-99fc-d994f4456c2e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:38.086337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4a03a-ea29-4102-aa60-69d3d7f79a89 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:38.097615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:38.130766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d8ab2-b208-4b23-97e1-549dc4ee49b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:38.131703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d8ab2-b208-4b23-97e1-549dc4ee49b8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:38.131991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d8ab2-b208-4b23-97e1-549dc4ee49b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:38.132272 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d8ab2-b208-4b23-97e1-549dc4ee49b8 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:38.133152 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d8ab2-b208-4b23-97e1-549dc4ee49b8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:38.133468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d8ab2-b208-4b23-97e1-549dc4ee49b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:38.134930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d8ab2-b208-4b23-97e1-549dc4ee49b8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:38.192171 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc509091-74bb-4fcb-99fc-d994f4456c2e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:38.196454 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 262/526] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Jun 16 16:03:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:38.198281 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d8ab2-b208-4b23-97e1-549dc4ee49b8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:38.232250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586ddfd-605e-424e-bf28-d5ffd418b856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:38.233669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586ddfd-605e-424e-bf28-d5ffd418b856 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:38.233957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586ddfd-605e-424e-bf28-d5ffd418b856 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:38.234238 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586ddfd-605e-424e-bf28-d5ffd418b856 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:38.243036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586ddfd-605e-424e-bf28-d5ffd418b856 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:38.244493 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586ddfd-605e-424e-bf28-d5ffd418b856 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:38.259565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-0586ddfd-605e-424e-bf28-d5ffd418b856 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:38.259565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:38.259565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:38.259565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:38.259565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:38.259565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:38.259565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:38.259565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:38.259565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:38.259565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:38.259565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:38.259565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:38.259565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:38.259565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:38.259565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:38.260444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:38.261702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:38.261702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:38.261702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:38.261702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:38.261702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:38.261702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:38.261702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:38.261702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:38.261702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 265/527] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:38.262251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586ddfd-605e-424e-bf28-d5ffd418b856 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:38.321024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d8ab2-b208-4b23-97e1-549dc4ee49b8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:38.362538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e082c-194e-4ace-8d6b-d241f5c05330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:38.363243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e082c-194e-4ace-8d6b-d241f5c05330 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:38.363533 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e082c-194e-4ace-8d6b-d241f5c05330 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:38.363798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:38.363937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e082c-194e-4ace-8d6b-d241f5c05330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:38.386792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:38.394035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586ddfd-605e-424e-bf28-d5ffd418b856 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:38.441847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5250-9de5-4a45-9fa0-d315d775f490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:38.442606 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5250-9de5-4a45-9fa0-d315d775f490 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:38.442840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5250-9de5-4a45-9fa0-d315d775f490 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:38.443123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5250-9de5-4a45-9fa0-d315d775f490 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:38.465186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e082c-194e-4ace-8d6b-d241f5c05330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:38.466727 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e082c-194e-4ace-8d6b-d241f5c05330 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:38.521947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca5250-9de5-4a45-9fa0-d315d775f490 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:38.523476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca5250-9de5-4a45-9fa0-d315d775f490 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:38.609139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:38.616890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 263/528] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:38.617769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e082c-194e-4ace-8d6b-d241f5c05330 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:38.643701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 266/529] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:38.644709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5250-9de5-4a45-9fa0-d315d775f490 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:38.676456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:38.741872 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e082c-194e-4ace-8d6b-d241f5c05330 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:38.780729 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26936204-c082-4050-8251-90f5a7ebba47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:38.780729 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26936204-c082-4050-8251-90f5a7ebba47 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:38.781451 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26936204-c082-4050-8251-90f5a7ebba47 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:38.781852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26936204-c082-4050-8251-90f5a7ebba47 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:38.782856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26936204-c082-4050-8251-90f5a7ebba47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:38.783274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26936204-c082-4050-8251-90f5a7ebba47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:38.784831 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26936204-c082-4050-8251-90f5a7ebba47 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:38.786077 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5250-9de5-4a45-9fa0-d315d775f490 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:38.805140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 264/530] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:38.805140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26936204-c082-4050-8251-90f5a7ebba47 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:38.832258 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ad1d8-f11f-4c86-856a-c7dde6563f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:38.833218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ad1d8-f11f-4c86-856a-c7dde6563f7d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:38.833602 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ad1d8-f11f-4c86-856a-c7dde6563f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:38.833984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ad1d8-f11f-4c86-856a-c7dde6563f7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:38.845335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ad1d8-f11f-4c86-856a-c7dde6563f7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:38.846976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ad1d8-f11f-4c86-856a-c7dde6563f7d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:38.869093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-570ad1d8-f11f-4c86-856a-c7dde6563f7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:38.869093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:38.869093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:38.869093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:38.869093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:38.869093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:38.869093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:38.869093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:38.869093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:38.869093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:38.869093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:38.869093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:38.869093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:38.869093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:38.869093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:38.870178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:38.871281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:38.871281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:38.871281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:38.871281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:38.874113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 267/531] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:38.875341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ad1d8-f11f-4c86-856a-c7dde6563f7d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:38.913168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:38.927451 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:38.932690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26936204-c082-4050-8251-90f5a7ebba47 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:38.970238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3fab0-50df-40e8-827c-d0db1ecce511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:38.971195 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3fab0-50df-40e8-827c-d0db1ecce511 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:38.971586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3fab0-50df-40e8-827c-d0db1ecce511 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:38.971931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3fab0-50df-40e8-827c-d0db1ecce511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:38.984263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3fab0-50df-40e8-827c-d0db1ecce511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:38.985833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3fab0-50df-40e8-827c-d0db1ecce511 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:39.009094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-06f3fab0-50df-40e8-827c-d0db1ecce511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:39.009094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:39.009094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:39.009094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:39.009094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:39.009094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:39.009094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:39.009094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:39.009094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:39.009094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:39.009094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:39.009094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:39.009094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:39.009094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:39.009094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:39.009982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:39.010863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:39.010863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:39.010863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:39.010863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:39.012773 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ad1d8-f11f-4c86-856a-c7dde6563f7d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:39.015679 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 265/532] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:39.016843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3fab0-50df-40e8-827c-d0db1ecce511 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:39.061633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454af5e-1dad-48e8-8c33-7922e783e04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:39.062696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454af5e-1dad-48e8-8c33-7922e783e04a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:39.063326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454af5e-1dad-48e8-8c33-7922e783e04a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:39.063787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454af5e-1dad-48e8-8c33-7922e783e04a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:39.065704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454af5e-1dad-48e8-8c33-7922e783e04a None admin] RBAC: Adding query filter params (role.id=6da95c91bacf48f9870a114e2ab05472, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=59174974208c469b8bb44d94d0e55427) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:39.066241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454af5e-1dad-48e8-8c33-7922e783e04a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:39.067968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454af5e-1dad-48e8-8c33-7922e783e04a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:39.084487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 268/533] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:38 2022] GET /identity/v3/role_assignments?user.id=59174974208c469b8bb44d94d0e55427&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=6da95c91bacf48f9870a114e2ab05472 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:39.084487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454af5e-1dad-48e8-8c33-7922e783e04a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:39.197466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3fab0-50df-40e8-827c-d0db1ecce511 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:39.270501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389de1-30ba-41c5-9273-b034d9718eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:39.271108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389de1-30ba-41c5-9273-b034d9718eea None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:39.271398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389de1-30ba-41c5-9273-b034d9718eea None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:39.271681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389de1-30ba-41c5-9273-b034d9718eea None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:39.272422 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d389de1-30ba-41c5-9273-b034d9718eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:39.272734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d389de1-30ba-41c5-9273-b034d9718eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:39.274156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d389de1-30ba-41c5-9273-b034d9718eea None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:39.293995 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:39.300818 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 266/534] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:39.306228 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389de1-30ba-41c5-9273-b034d9718eea None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:39.316360 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454af5e-1dad-48e8-8c33-7922e783e04a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:39.323135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:39.385843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15319694-a8b9-40a9-aa96-d3b19600e20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:39.386546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319694-a8b9-40a9-aa96-d3b19600e20d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:39.386834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319694-a8b9-40a9-aa96-d3b19600e20d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:39.387116 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319694-a8b9-40a9-aa96-d3b19600e20d None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:39.387861 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15319694-a8b9-40a9-aa96-d3b19600e20d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:39.388261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15319694-a8b9-40a9-aa96-d3b19600e20d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:39.389830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15319694-a8b9-40a9-aa96-d3b19600e20d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:39.416073 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 269/535] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:39.424665 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15319694-a8b9-40a9-aa96-d3b19600e20d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:39.491009 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389de1-30ba-41c5-9273-b034d9718eea None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:39.575244 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ccb06-a9a3-4992-b6d1-286bfbd0919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:39.575973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ccb06-a9a3-4992-b6d1-286bfbd0919e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:39.576259 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ccb06-a9a3-4992-b6d1-286bfbd0919e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:39.576634 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ccb06-a9a3-4992-b6d1-286bfbd0919e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:39.579623 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15319694-a8b9-40a9-aa96-d3b19600e20d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:39.583893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ccb06-a9a3-4992-b6d1-286bfbd0919e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:39.585374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ccb06-a9a3-4992-b6d1-286bfbd0919e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:39.601536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-086ccb06-a9a3-4992-b6d1-286bfbd0919e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:39.601536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:39.601536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:39.601536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:39.601536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:39.601536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:39.601536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:39.601536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:39.601536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:39.601536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:39.601536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:39.601536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:39.601536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:39.601536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:39.601536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:39.602502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:39.603353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:39.603353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:39.603353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:39.603353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:39.603353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:39.603353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:39.603353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:39.603353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:39.603353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 267/536] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:03:39.609723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46614f-635e-4ab2-88f7-ec867535daaf None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:39.609723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46614f-635e-4ab2-88f7-ec867535daaf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:39.609723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46614f-635e-4ab2-88f7-ec867535daaf None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:39.611098 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 268/537] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:39.611975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46614f-635e-4ab2-88f7-ec867535daaf None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:39.622781 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c8520-e0cd-45ab-9cfb-1b0fde8cda49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:39.623638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c8520-e0cd-45ab-9cfb-1b0fde8cda49 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:39.623930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c8520-e0cd-45ab-9cfb-1b0fde8cda49 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:39.624208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c8520-e0cd-45ab-9cfb-1b0fde8cda49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:39.632033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c8520-e0cd-45ab-9cfb-1b0fde8cda49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:39.633660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c8520-e0cd-45ab-9cfb-1b0fde8cda49 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:39.649498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-392c8520-e0cd-45ab-9cfb-1b0fde8cda49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:39.649498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:39.649498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:39.649498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:39.649498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:39.649498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:39.649498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:39.649498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:39.649498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:39.649498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:39.649498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:39.649498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:39.649498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:39.649498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:39.649498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:39.650389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:39.651277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:39.651277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:39.651277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:39.651277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:39.651277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:39.651277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:39.651277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:39.651277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:39.651277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 270/538] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:03:39.652477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c620c-cc45-4f97-b4ea-0377fdc987d1 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:39.655464 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c620c-cc45-4f97-b4ea-0377fdc987d1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:39.655464 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c620c-cc45-4f97-b4ea-0377fdc987d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:39.677212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-fc8c620c-cc45-4f97-b4ea-0377fdc987d1 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:39.679483 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fc8c620c-cc45-4f97-b4ea-0377fdc987d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:39.683273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:39.707238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:39.745998 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46614f-635e-4ab2-88f7-ec867535daaf None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:39.786580 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99d42d-b20e-4d44-bbba-611c1138d0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:39.786918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 271/539] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:39.787805 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c620c-cc45-4f97-b4ea-0377fdc987d1 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:39.787999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99d42d-b20e-4d44-bbba-611c1138d0bd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:39.788469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99d42d-b20e-4d44-bbba-611c1138d0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:39.788941 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99d42d-b20e-4d44-bbba-611c1138d0bd None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:39.789930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99d42d-b20e-4d44-bbba-611c1138d0bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:39.790532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99d42d-b20e-4d44-bbba-611c1138d0bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:39.792483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99d42d-b20e-4d44-bbba-611c1138d0bd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:39.808253 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 269/540] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:39.814937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99d42d-b20e-4d44-bbba-611c1138d0bd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:39.909479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c620c-cc45-4f97-b4ea-0377fdc987d1 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:39.928581 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99d42d-b20e-4d44-bbba-611c1138d0bd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:39.945056 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6f07d-8e6c-427c-8096-7530f37e55b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:39.945737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6f07d-8e6c-427c-8096-7530f37e55b9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:39.946064 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6f07d-8e6c-427c-8096-7530f37e55b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:39.946657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6f07d-8e6c-427c-8096-7530f37e55b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:39.947501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6f07d-8e6c-427c-8096-7530f37e55b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:39.947816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6f07d-8e6c-427c-8096-7530f37e55b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:39.949284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6f07d-8e6c-427c-8096-7530f37e55b9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:39.962542 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:39.965604 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:39.969402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 272/541] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:39.972692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fa095-6bc9-4abb-b9b0-1b59f48a81a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:39.973602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fa095-6bc9-4abb-b9b0-1b59f48a81a0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:39.974223 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fa095-6bc9-4abb-b9b0-1b59f48a81a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:39.974730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fa095-6bc9-4abb-b9b0-1b59f48a81a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:39.974968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6f07d-8e6c-427c-8096-7530f37e55b9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:39.976012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fa095-6bc9-4abb-b9b0-1b59f48a81a0 None admin] RBAC: Adding query filter params (role.id=6da95c91bacf48f9870a114e2ab05472, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=65e8905bab4c47f9a5fb374ef0377983) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:39.976530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fa095-6bc9-4abb-b9b0-1b59f48a81a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:39.978590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fa095-6bc9-4abb-b9b0-1b59f48a81a0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:39.994597 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 270/542] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:39 2022] GET /identity/v3/role_assignments?user.id=65e8905bab4c47f9a5fb374ef0377983&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=6da95c91bacf48f9870a114e2ab05472 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:39.996165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fa095-6bc9-4abb-b9b0-1b59f48a81a0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:40.135633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6f07d-8e6c-427c-8096-7530f37e55b9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:40.188044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c164954-32ae-47bd-a281-0ad759b8c8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:40.188870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c164954-32ae-47bd-a281-0ad759b8c8aa None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:40.189155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c164954-32ae-47bd-a281-0ad759b8c8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:40.189438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c164954-32ae-47bd-a281-0ad759b8c8aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:40.195541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fa095-6bc9-4abb-b9b0-1b59f48a81a0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:40.201294 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c164954-32ae-47bd-a281-0ad759b8c8aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-1c164954-32ae-47bd-a281-0ad759b8c8aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:40.209850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:40.210848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:40.211648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:40.211648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:40.211648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:40.211648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:40.211648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:40.211648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:40.211648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:40.211648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:40.211648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:40.211648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:40.211648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:40.211648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:40.211648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 273/543] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:40.213055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd2916-927e-4cd1-8617-33f8a6f74150 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:40.213055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd2916-927e-4cd1-8617-33f8a6f74150 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:40.213055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd2916-927e-4cd1-8617-33f8a6f74150 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:40.214204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 274/544] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:40.224471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d937554-77c2-474c-90f7-5cec3dfd0ad2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:40.224471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d937554-77c2-474c-90f7-5cec3dfd0ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:40.224471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d937554-77c2-474c-90f7-5cec3dfd0ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:40.243529 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0d937554-77c2-474c-90f7-5cec3dfd0ad2 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:40.244219 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265b76c-686b-41da-a3f0-7b5fb38ac9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:40.244888 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265b76c-686b-41da-a3f0-7b5fb38ac9eb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:40.244987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0d937554-77c2-474c-90f7-5cec3dfd0ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:40.245170 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265b76c-686b-41da-a3f0-7b5fb38ac9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:40.245443 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265b76c-686b-41da-a3f0-7b5fb38ac9eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:40.246276 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265b76c-686b-41da-a3f0-7b5fb38ac9eb None admin] RBAC: Adding query filter params (role.id=6da95c91bacf48f9870a114e2ab05472, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=087adcbf737843db97dabfa9708484c0) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:40.246617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265b76c-686b-41da-a3f0-7b5fb38ac9eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:40.248045 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265b76c-686b-41da-a3f0-7b5fb38ac9eb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:40.254116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 271/545] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:39 2022] GET /identity/v3/role_assignments?user.id=087adcbf737843db97dabfa9708484c0&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=6da95c91bacf48f9870a114e2ab05472 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:40.259817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265b76c-686b-41da-a3f0-7b5fb38ac9eb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:40.369394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:40.389643 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 275/546] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:03:40.400584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:40.445022 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d937554-77c2-474c-90f7-5cec3dfd0ad2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:40.500397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265b76c-686b-41da-a3f0-7b5fb38ac9eb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:40.547187 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a380947-160f-4ed3-8ff6-ab4324e7f61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:40.547875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a380947-160f-4ed3-8ff6-ab4324e7f61e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:40.548231 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a380947-160f-4ed3-8ff6-ab4324e7f61e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:40.548509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a380947-160f-4ed3-8ff6-ab4324e7f61e None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:40.549322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a380947-160f-4ed3-8ff6-ab4324e7f61e None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:40.549632 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a380947-160f-4ed3-8ff6-ab4324e7f61e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:40.551044 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a380947-160f-4ed3-8ff6-ab4324e7f61e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:40.563300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 272/547] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:40.568713 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a380947-160f-4ed3-8ff6-ab4324e7f61e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:40.586867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d937554-77c2-474c-90f7-5cec3dfd0ad2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:40.636357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb47fa-a1ad-4966-bd46-7db26297f2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:40.637703 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb47fa-a1ad-4966-bd46-7db26297f2af None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:40.638189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb47fa-a1ad-4966-bd46-7db26297f2af None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:40.638698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb47fa-a1ad-4966-bd46-7db26297f2af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:40.650104 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb47fa-a1ad-4966-bd46-7db26297f2af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-6bcb47fa-a1ad-4966-bd46-7db26297f2af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:40.658766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:40.659644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:40.660456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:40.660456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:40.660456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:40.660456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:40.660456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:40.660456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:40.660456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:40.660456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:40.660456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:40.660456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:40.660456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:40.660456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:40.663260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 276/548] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:40.688110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb47fa-a1ad-4966-bd46-7db26297f2af None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:40.703465 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a380947-160f-4ed3-8ff6-ab4324e7f61e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:40.759363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:40.768075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256ef47-4d7d-4006-b310-f84704257317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:40.769256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256ef47-4d7d-4006-b310-f84704257317 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:40.769672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256ef47-4d7d-4006-b310-f84704257317 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:40.770077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256ef47-4d7d-4006-b310-f84704257317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:40.800750 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256ef47-4d7d-4006-b310-f84704257317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:40.802243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256ef47-4d7d-4006-b310-f84704257317 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:40.823400 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:40.835249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c256ef47-4d7d-4006-b310-f84704257317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:40.835249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:40.835249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:40.835249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:40.835249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:40.835249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:40.835249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:40.835249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:40.835249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:40.835249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:40.835249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:40.835249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:40.835249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:40.835249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:40.835249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:40.836674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:40.837726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:40.837726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:40.837726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:40.837726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:40.837726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 273/549] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:40.845200 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256ef47-4d7d-4006-b310-f84704257317 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:40.910974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb47fa-a1ad-4966-bd46-7db26297f2af None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:40.968971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256ef47-4d7d-4006-b310-f84704257317 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:40.980739 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d90c21-e40a-464b-ab89-1c163d7e8389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:40.981427 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d90c21-e40a-464b-ab89-1c163d7e8389 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:40.981719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d90c21-e40a-464b-ab89-1c163d7e8389 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:40.982296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d90c21-e40a-464b-ab89-1c163d7e8389 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:40.984324 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d90c21-e40a-464b-ab89-1c163d7e8389 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:40.984646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d90c21-e40a-464b-ab89-1c163d7e8389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:40.986175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d90c21-e40a-464b-ab89-1c163d7e8389 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:41.004440 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac2a48-476a-48a3-9ad3-71f568b97703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:41.005115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac2a48-476a-48a3-9ad3-71f568b97703 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:41.005400 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac2a48-476a-48a3-9ad3-71f568b97703 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:41.005674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac2a48-476a-48a3-9ad3-71f568b97703 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:41.006396 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac2a48-476a-48a3-9ad3-71f568b97703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:41.006739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac2a48-476a-48a3-9ad3-71f568b97703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:41.008123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac2a48-476a-48a3-9ad3-71f568b97703 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:41.009658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 277/550] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:41.027273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d90c21-e40a-464b-ab89-1c163d7e8389 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:41.030536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 274/551] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:41.032739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac2a48-476a-48a3-9ad3-71f568b97703 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:41.066928 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:41.139809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac2a48-476a-48a3-9ad3-71f568b97703 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:41.183798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673ee89-29a8-4a18-9a91-be9a769fb07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:41.185080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673ee89-29a8-4a18-9a91-be9a769fb07a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:41.185540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673ee89-29a8-4a18-9a91-be9a769fb07a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:41.186569 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673ee89-29a8-4a18-9a91-be9a769fb07a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:41.197578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673ee89-29a8-4a18-9a91-be9a769fb07a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:41.199077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673ee89-29a8-4a18-9a91-be9a769fb07a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8673ee89-29a8-4a18-9a91-be9a769fb07a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:41.219773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:41.220786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:41.221795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:41.221795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:41.221795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:41.221795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:41.221795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:41.221795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:41.221795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:41.221795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:41.221795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 16:03:41.221795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:41.221795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 275/552] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:03:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:41.230120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673ee89-29a8-4a18-9a91-be9a769fb07a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:41.262615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d90c21-e40a-464b-ab89-1c163d7e8389 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:41.291024 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:41.341051 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d3df1-55c9-4d71-80e1-928cb1949116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:41.341876 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d3df1-55c9-4d71-80e1-928cb1949116 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:41.342222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d3df1-55c9-4d71-80e1-928cb1949116 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:41.342891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d3df1-55c9-4d71-80e1-928cb1949116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:41.348510 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:41.360073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673ee89-29a8-4a18-9a91-be9a769fb07a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:41.371815 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d3df1-55c9-4d71-80e1-928cb1949116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:41.373940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d3df1-55c9-4d71-80e1-928cb1949116 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:41.414365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-c89d3df1-55c9-4d71-80e1-928cb1949116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:41.414365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:41.414365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:41.414365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:41.414365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:41.414365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:41.414365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:41.414365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:41.414365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:41.414365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:41.414365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:41.414365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:41.414365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:41.414365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:41.414365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:41.415320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:41.416407 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:41.416407 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:41.416407 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:41.416407 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:41.416407 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 278/553] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:03:41.422611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d3df1-55c9-4d71-80e1-928cb1949116 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:41.426793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a545ade-5b53-4bc2-ab18-e1e3442f95d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:41.427490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a545ade-5b53-4bc2-ab18-e1e3442f95d8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:41.427775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a545ade-5b53-4bc2-ab18-e1e3442f95d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:41.428056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a545ade-5b53-4bc2-ab18-e1e3442f95d8 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:41.428973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a545ade-5b53-4bc2-ab18-e1e3442f95d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:41.429294 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a545ade-5b53-4bc2-ab18-e1e3442f95d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:41.430764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a545ade-5b53-4bc2-ab18-e1e3442f95d8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:41.459370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 276/554] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jun 16 16:03:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:41.468761 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a545ade-5b53-4bc2-ab18-e1e3442f95d8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:41.607688 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a545ade-5b53-4bc2-ab18-e1e3442f95d8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:41.616357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d3df1-55c9-4d71-80e1-928cb1949116 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:41.647546 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f7568-3d42-4307-b773-0277430bb121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:41.648762 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f7568-3d42-4307-b773-0277430bb121 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:41.649185 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f7568-3d42-4307-b773-0277430bb121 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:41.649470 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f7568-3d42-4307-b773-0277430bb121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:41.660483 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb62f2b-a2db-45e0-9a72-e2830e7fee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:41.661350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb62f2b-a2db-45e0-9a72-e2830e7fee33 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:41.661709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb62f2b-a2db-45e0-9a72-e2830e7fee33 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:41.662069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb62f2b-a2db-45e0-9a72-e2830e7fee33 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:41.662929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb62f2b-a2db-45e0-9a72-e2830e7fee33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:41.663409 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb62f2b-a2db-45e0-9a72-e2830e7fee33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:41.664973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb62f2b-a2db-45e0-9a72-e2830e7fee33 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:41.672636 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:41.681871 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 279/555] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:41.683561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ff9ab-7119-46f1-8d0a-eaa8fac1b9e9 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:41.684004 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ff9ab-7119-46f1-8d0a-eaa8fac1b9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:41.684459 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ff9ab-7119-46f1-8d0a-eaa8fac1b9e9 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:41.686631 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 280/556] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:41.687703 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ff9ab-7119-46f1-8d0a-eaa8fac1b9e9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:41.716735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:41.730796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f7568-3d42-4307-b773-0277430bb121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:41.732429 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f7568-3d42-4307-b773-0277430bb121 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:41.809232 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ff9ab-7119-46f1-8d0a-eaa8fac1b9e9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:41.842133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 277/557] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:41.843631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5802d-0306-4934-a021-f5669038dfb1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:41.843924 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5802d-0306-4934-a021-f5669038dfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:41.844205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5802d-0306-4934-a021-f5669038dfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:41.850991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73f712-68ab-4487-9b71-933572a4357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:41.852063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73f712-68ab-4487-9b71-933572a4357c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:41.852556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73f712-68ab-4487-9b71-933572a4357c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:41.853048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73f712-68ab-4487-9b71-933572a4357c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:41.861855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73f712-68ab-4487-9b71-933572a4357c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:41.862774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b6d5802d-0306-4934-a021-f5669038dfb1 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:41.863902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73f712-68ab-4487-9b71-933572a4357c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:41.864015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b6d5802d-0306-4934-a021-f5669038dfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-cf73f712-68ab-4487-9b71-933572a4357c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:41.881015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:41.882504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:41.883450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:41.883450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:41.883450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:41.883450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:41.883450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:41.883450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:41.883450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:41.883450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:41.883450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:03:41.883450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:41.886250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 281/558] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 16 16:03:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:41.887353 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73f712-68ab-4487-9b71-933572a4357c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:41.914761 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:41.937703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 278/559] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:41.938600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5802d-0306-4934-a021-f5669038dfb1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:42.003135 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:42.005644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73f712-68ab-4487-9b71-933572a4357c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:42.044681 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521cd5a-fcd9-4922-9716-d823ab028a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:42.046481 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521cd5a-fcd9-4922-9716-d823ab028a77 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:42.046778 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521cd5a-fcd9-4922-9716-d823ab028a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:42.047096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521cd5a-fcd9-4922-9716-d823ab028a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:42.058312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521cd5a-fcd9-4922-9716-d823ab028a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:42.059818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521cd5a-fcd9-4922-9716-d823ab028a77 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:42.083588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-f521cd5a-fcd9-4922-9716-d823ab028a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:42.083588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:42.083588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:42.083588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:42.083588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:42.083588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:42.083588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:42.083588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:42.083588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:42.083588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:42.083588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:42.083588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:42.083588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:42.083588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:42.083588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:42.085252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:42.086731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:42.086731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:42.086731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:42.086731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:42.086731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 282/560] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:42.086731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521cd5a-fcd9-4922-9716-d823ab028a77 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:42.105978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5802d-0306-4934-a021-f5669038dfb1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:42.146102 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf0dcf-1b0a-47fd-994b-4dd81850aa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:42.146747 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf0dcf-1b0a-47fd-994b-4dd81850aa84 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:42.147040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf0dcf-1b0a-47fd-994b-4dd81850aa84 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:42.147327 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf0dcf-1b0a-47fd-994b-4dd81850aa84 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:42.148171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf0dcf-1b0a-47fd-994b-4dd81850aa84 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:42.148488 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf0dcf-1b0a-47fd-994b-4dd81850aa84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:42.150145 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf0dcf-1b0a-47fd-994b-4dd81850aa84 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:42.176724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 279/561] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 16 16:03:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:42.177836 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf0dcf-1b0a-47fd-994b-4dd81850aa84 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:42.197578 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521cd5a-fcd9-4922-9716-d823ab028a77 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:42.225787 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:42.237924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c041e5-fa8a-480e-8199-6c35ffed7061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:42.238881 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c041e5-fa8a-480e-8199-6c35ffed7061 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:42.239164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c041e5-fa8a-480e-8199-6c35ffed7061 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:42.239441 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c041e5-fa8a-480e-8199-6c35ffed7061 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:42.242472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:42.252371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c041e5-fa8a-480e-8199-6c35ffed7061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-52c041e5-fa8a-480e-8199-6c35ffed7061 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:42.260826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:42.263355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:42.264299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:42.264299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:42.264299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:42.264299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:42.264299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:42.264299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:42.264299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:42.264299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:42.264299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:42.264299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:42.264299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:42.264299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:42.270332 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 283/562] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:42.270332 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c041e5-fa8a-480e-8199-6c35ffed7061 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:42.301642 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf0dcf-1b0a-47fd-994b-4dd81850aa84 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:42.343874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b770c-7636-442c-811d-96055e94802e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:42.344556 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b770c-7636-442c-811d-96055e94802e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:42.344839 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b770c-7636-442c-811d-96055e94802e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:42.345112 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b770c-7636-442c-811d-96055e94802e None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:42.345842 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b770c-7636-442c-811d-96055e94802e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:42.346151 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b770c-7636-442c-811d-96055e94802e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:42.347569 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b770c-7636-442c-811d-96055e94802e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:42.365719 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 280/563] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:42.366833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b770c-7636-442c-811d-96055e94802e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:42.396404 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c041e5-fa8a-480e-8199-6c35ffed7061 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:42.437908 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb863d32-f491-4c8c-84ae-eab87ab4de8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:42.438961 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb863d32-f491-4c8c-84ae-eab87ab4de8e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:42.439331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb863d32-f491-4c8c-84ae-eab87ab4de8e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:42.439686 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb863d32-f491-4c8c-84ae-eab87ab4de8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:42.452556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb863d32-f491-4c8c-84ae-eab87ab4de8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:42.454276 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb863d32-f491-4c8c-84ae-eab87ab4de8e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:42.478643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:42.480275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-eb863d32-f491-4c8c-84ae-eab87ab4de8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:42.480275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:42.480275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:42.480275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:42.480275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:42.480275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:42.480275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:42.480275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:42.480275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:42.480275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:42.480275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:42.480275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:42.480275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:42.480275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:42.480275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:42.483189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:42.485280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:42.485280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:42.485280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:42.485280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:42.485280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 284/564] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:42.485280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb863d32-f491-4c8c-84ae-eab87ab4de8e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:42.494603 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b770c-7636-442c-811d-96055e94802e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:42.526304 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55030a-b743-4eed-afe5-9e77152fbe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:42.527076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55030a-b743-4eed-afe5-9e77152fbe53 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:42.527368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55030a-b743-4eed-afe5-9e77152fbe53 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:42.527649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55030a-b743-4eed-afe5-9e77152fbe53 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:42.528437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55030a-b743-4eed-afe5-9e77152fbe53 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:42.528748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55030a-b743-4eed-afe5-9e77152fbe53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:42.530777 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55030a-b743-4eed-afe5-9e77152fbe53 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:42.546624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 281/565] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:42.547748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55030a-b743-4eed-afe5-9e77152fbe53 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:42.549070 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:42.607001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb863d32-f491-4c8c-84ae-eab87ab4de8e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:42.647034 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726576ef-ab6f-4e40-a812-6475be54b626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:42.647755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726576ef-ab6f-4e40-a812-6475be54b626 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:42.648045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726576ef-ab6f-4e40-a812-6475be54b626 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:42.648328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726576ef-ab6f-4e40-a812-6475be54b626 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:42.656704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726576ef-ab6f-4e40-a812-6475be54b626 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:42.658164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726576ef-ab6f-4e40-a812-6475be54b626 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:42.665799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55030a-b743-4eed-afe5-9e77152fbe53 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:42.673611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-726576ef-ab6f-4e40-a812-6475be54b626 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:42.673611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:42.673611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:42.673611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:42.673611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:42.673611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:42.673611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:42.673611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:42.673611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:42.673611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:42.673611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:42.673611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:42.673611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:42.673611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:42.673611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:42.674585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:42.675486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:42.675486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:42.675486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:42.675486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:42.675486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:42.675486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:42.675486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:42.675486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:42.675486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 285/566] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:42.675993 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726576ef-ab6f-4e40-a812-6475be54b626 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:42.709514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d84f0b-7dd0-4601-be12-d25789ca3200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:42.710301 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d84f0b-7dd0-4601-be12-d25789ca3200 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:42.710619 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d84f0b-7dd0-4601-be12-d25789ca3200 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:42.711013 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d84f0b-7dd0-4601-be12-d25789ca3200 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:42.711743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d84f0b-7dd0-4601-be12-d25789ca3200 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:42.712055 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d84f0b-7dd0-4601-be12-d25789ca3200 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:42.713481 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d84f0b-7dd0-4601-be12-d25789ca3200 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:42.731757 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 282/567] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:42.731757 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8576d-1555-47f2-bbd3-73bb5331232f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:42.731757 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8576d-1555-47f2-bbd3-73bb5331232f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:42.731757 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8576d-1555-47f2-bbd3-73bb5331232f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:42.731757 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 283/568] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:42.732215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8576d-1555-47f2-bbd3-73bb5331232f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:42.756297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:42.786011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726576ef-ab6f-4e40-a812-6475be54b626 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:42.796085 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:42.825543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558210dc-51b3-4039-94e9-16dda078fc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:42.826399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558210dc-51b3-4039-94e9-16dda078fc63 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:42.827050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558210dc-51b3-4039-94e9-16dda078fc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:42.827346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558210dc-51b3-4039-94e9-16dda078fc63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:42.846470 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558210dc-51b3-4039-94e9-16dda078fc63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:42.846470 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558210dc-51b3-4039-94e9-16dda078fc63 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:42.852182 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8576d-1555-47f2-bbd3-73bb5331232f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:42.870421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-558210dc-51b3-4039-94e9-16dda078fc63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:42.870421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:42.870421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:42.870421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:42.870421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:42.870421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:42.870421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:42.870421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:42.870421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:42.870421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:42.870421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:42.870421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:42.870421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:42.870421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:42.870421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:42.871422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:42.872329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:42.872329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:42.872329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:42.872329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:42.872329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 286/569] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:42.872628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558210dc-51b3-4039-94e9-16dda078fc63 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:42.901221 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586415f-f367-4c87-bbb1-5fd8dcc26a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:42.901800 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586415f-f367-4c87-bbb1-5fd8dcc26a75 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:42.902084 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586415f-f367-4c87-bbb1-5fd8dcc26a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:42.902361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586415f-f367-4c87-bbb1-5fd8dcc26a75 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:42.903197 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586415f-f367-4c87-bbb1-5fd8dcc26a75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:42.903514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586415f-f367-4c87-bbb1-5fd8dcc26a75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:42.906224 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586415f-f367-4c87-bbb1-5fd8dcc26a75 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:42.918655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 284/570] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:42.919929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657055f-cbc6-4a7f-924e-05ec5ff8705d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:42.921525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657055f-cbc6-4a7f-924e-05ec5ff8705d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:42.921831 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657055f-cbc6-4a7f-924e-05ec5ff8705d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:42.939687 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8657055f-cbc6-4a7f-924e-05ec5ff8705d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:42.940891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8657055f-cbc6-4a7f-924e-05ec5ff8705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:42.988875 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558210dc-51b3-4039-94e9-16dda078fc63 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:43.012916 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 285/571] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:43.013652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657055f-cbc6-4a7f-924e-05ec5ff8705d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:43.024030 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e484e9-d7f1-40d5-a5b3-0e73588cc938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:43.024969 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e484e9-d7f1-40d5-a5b3-0e73588cc938 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:43.025357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e484e9-d7f1-40d5-a5b3-0e73588cc938 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:43.025655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e484e9-d7f1-40d5-a5b3-0e73588cc938 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:43.027447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:43.034394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e484e9-d7f1-40d5-a5b3-0e73588cc938 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:43.035910 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e484e9-d7f1-40d5-a5b3-0e73588cc938 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:43.050734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-56e484e9-d7f1-40d5-a5b3-0e73588cc938 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:43.050734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:43.050734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:43.050734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:43.050734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:43.050734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:43.050734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:43.050734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:43.050734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:43.050734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:43.050734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:43.050734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:43.050734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:43.050734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:43.050734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:43.051761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:43.052667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:43.052667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:43.052667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:43.052667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:43.052667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:43.052667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:43.052667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:43.052667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:43.052667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 287/572] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:43.053158 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e484e9-d7f1-40d5-a5b3-0e73588cc938 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:43.075040 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:43.124551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657055f-cbc6-4a7f-924e-05ec5ff8705d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:43.156967 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e484e9-d7f1-40d5-a5b3-0e73588cc938 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:43.159114 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241d62f-bbff-4621-b715-c0245c506c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:43.159789 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241d62f-bbff-4621-b715-c0245c506c34 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:43.160073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241d62f-bbff-4621-b715-c0245c506c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:43.160351 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241d62f-bbff-4621-b715-c0245c506c34 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:43.161071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241d62f-bbff-4621-b715-c0245c506c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:43.161377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241d62f-bbff-4621-b715-c0245c506c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:43.162766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241d62f-bbff-4621-b715-c0245c506c34 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:43.174690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 286/573] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:43.176035 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0778fb-20f8-410e-8714-15b70060d43c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:43.176334 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0778fb-20f8-410e-8714-15b70060d43c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:43.176615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0778fb-20f8-410e-8714-15b70060d43c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:43.179711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 287/574] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:43.179711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0778fb-20f8-410e-8714-15b70060d43c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:43.191799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c683517-eaa0-4e29-9db9-830cedcbce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:43.192556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c683517-eaa0-4e29-9db9-830cedcbce60 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:43.192918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c683517-eaa0-4e29-9db9-830cedcbce60 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:43.193207 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c683517-eaa0-4e29-9db9-830cedcbce60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:43.194042 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c683517-eaa0-4e29-9db9-830cedcbce60 None admin] RBAC: Adding query filter params (role.id=6da95c91bacf48f9870a114e2ab05472, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=a8527cbb8efe43d7bb297d779929a50e) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:43.194366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c683517-eaa0-4e29-9db9-830cedcbce60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:43.195861 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c683517-eaa0-4e29-9db9-830cedcbce60 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:43.202834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 288/575] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:43 2022] GET /identity/v3/role_assignments?user.id=a8527cbb8efe43d7bb297d779929a50e&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=6da95c91bacf48f9870a114e2ab05472 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:43.203623 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c683517-eaa0-4e29-9db9-830cedcbce60 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:43.284448 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:43.305113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:43.321415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0778fb-20f8-410e-8714-15b70060d43c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:43.322707 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c683517-eaa0-4e29-9db9-830cedcbce60 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:43.364336 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fde7e8-eadd-4439-8e2a-a24dbcd231e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:43.364336 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fde7e8-eadd-4439-8e2a-a24dbcd231e7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:43.364336 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fde7e8-eadd-4439-8e2a-a24dbcd231e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:43.364708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fde7e8-eadd-4439-8e2a-a24dbcd231e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:43.366905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b4705-3076-43ef-ae9c-13010668ad7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:43.367779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4705-3076-43ef-ae9c-13010668ad7b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:43.368017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4705-3076-43ef-ae9c-13010668ad7b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:43.368370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4705-3076-43ef-ae9c-13010668ad7b None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:43.369263 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b4705-3076-43ef-ae9c-13010668ad7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:43.369586 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b4705-3076-43ef-ae9c-13010668ad7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:43.371072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b4705-3076-43ef-ae9c-13010668ad7b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:43.378159 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fde7e8-eadd-4439-8e2a-a24dbcd231e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:43.384715 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 289/576] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:43.389658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b4705-3076-43ef-ae9c-13010668ad7b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-66fde7e8-eadd-4439-8e2a-a24dbcd231e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:43.389830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:43.390801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:43.391668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:43.391668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:43.391668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:43.391668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:43.391668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:43.391668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:43.391668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:43.391668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:43.391668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:43.391668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:43.391668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:43.391668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:43.391668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 288/577] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:43.391668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942620a-e774-4f93-91c7-ec3b56d44428 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:43.392511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942620a-e774-4f93-91c7-ec3b56d44428 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:43.392511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942620a-e774-4f93-91c7-ec3b56d44428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:43.406853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7942620a-e774-4f93-91c7-ec3b56d44428 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:43.408099 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7942620a-e774-4f93-91c7-ec3b56d44428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:43.478466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 289/578] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:43.478466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942620a-e774-4f93-91c7-ec3b56d44428 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:43.518291 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b4705-3076-43ef-ae9c-13010668ad7b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:43.542062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:43.563069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cda7c-5515-4caf-9c63-1f08a623075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:43.563875 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cda7c-5515-4caf-9c63-1f08a623075e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:43.564155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cda7c-5515-4caf-9c63-1f08a623075e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:43.564431 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cda7c-5515-4caf-9c63-1f08a623075e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:43.572963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cda7c-5515-4caf-9c63-1f08a623075e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:43.574400 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cda7c-5515-4caf-9c63-1f08a623075e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:43.588087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942620a-e774-4f93-91c7-ec3b56d44428 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-d05cda7c-5515-4caf-9c63-1f08a623075e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:43.589647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:43.590611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:43.591562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:43.591562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:43.591562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:43.591562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:43.591562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:43.591562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:43.591562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:43.591562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:43.591562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 16:03:43.591562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:43.591562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 290/579] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:43.592705 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cda7c-5515-4caf-9c63-1f08a623075e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:43.597023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:43.629601 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459097f-6bb5-4b6f-8014-1697defe45b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:43.630622 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459097f-6bb5-4b6f-8014-1697defe45b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:43.630906 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459097f-6bb5-4b6f-8014-1697defe45b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:43.631180 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459097f-6bb5-4b6f-8014-1697defe45b2 None admin] PATH_INFO: `/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/795c029cb14b42b5b0f3987e218d4239/roles/6da95c91bacf48f9870a114e2ab05472` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:43.647476 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459097f-6bb5-4b6f-8014-1697defe45b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=227cd348bea64e1f89d77ae2cf63a031, user_id=795c029cb14b42b5b0f3987e218d4239, role_id=6da95c91bacf48f9870a114e2ab05472)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:43.649087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459097f-6bb5-4b6f-8014-1697defe45b2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:43.662998 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 290/580] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:03:43 2022] PUT /identity/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/795c029cb14b42b5b0f3987e218d4239/roles/6da95c91bacf48f9870a114e2ab05472 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:03:43.673314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459097f-6bb5-4b6f-8014-1697defe45b2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:43.710125 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cda7c-5515-4caf-9c63-1f08a623075e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:43.765142 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b3988-e1dc-4652-8e66-73083bf2fab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:43.766172 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3988-e1dc-4652-8e66-73083bf2fab2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:43.766457 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3988-e1dc-4652-8e66-73083bf2fab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:43.766759 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3988-e1dc-4652-8e66-73083bf2fab2 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:43.768056 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b3988-e1dc-4652-8e66-73083bf2fab2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:43.768382 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b3988-e1dc-4652-8e66-73083bf2fab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:43.770087 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b3988-e1dc-4652-8e66-73083bf2fab2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:43.786618 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 291/581] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:43.787926 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b3988-e1dc-4652-8e66-73083bf2fab2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:43.823365 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459097f-6bb5-4b6f-8014-1697defe45b2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:43.840230 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:43.875706 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d318006-34fc-4c3a-b807-7d2da149d217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:43.876670 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d318006-34fc-4c3a-b807-7d2da149d217 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:43.876966 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d318006-34fc-4c3a-b807-7d2da149d217 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:43.877248 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d318006-34fc-4c3a-b807-7d2da149d217 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:43.881526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:43.897179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d318006-34fc-4c3a-b807-7d2da149d217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9d318006-34fc-4c3a-b807-7d2da149d217 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:43.907869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:43.909150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:43.910210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:43.910210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:43.910210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:43.910210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:43.910210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:43.910210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:43.910210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:43.910210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:43.910210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:43.910210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:43.910210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:43.910210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:43.912140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 291/582] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:43.913202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d318006-34fc-4c3a-b807-7d2da149d217 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:43.935085 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b3988-e1dc-4652-8e66-73083bf2fab2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:43.981156 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8ef39-dc1a-474c-b22e-8599912c2865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:43.982200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8ef39-dc1a-474c-b22e-8599912c2865 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:43.983115 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8ef39-dc1a-474c-b22e-8599912c2865 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:43.983467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8ef39-dc1a-474c-b22e-8599912c2865 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:43.984384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8ef39-dc1a-474c-b22e-8599912c2865 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:43.984765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8ef39-dc1a-474c-b22e-8599912c2865 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:43.986515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8ef39-dc1a-474c-b22e-8599912c2865 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:44.006978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 292/583] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jun 16 16:03:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:44.008189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8ef39-dc1a-474c-b22e-8599912c2865 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:44.037272 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d318006-34fc-4c3a-b807-7d2da149d217 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:44.080978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df77b9-2ed7-4bac-aefc-780a6da047ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:44.082041 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df77b9-2ed7-4bac-aefc-780a6da047ea None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:44.082397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df77b9-2ed7-4bac-aefc-780a6da047ea None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:44.083102 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df77b9-2ed7-4bac-aefc-780a6da047ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:44.097879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df77b9-2ed7-4bac-aefc-780a6da047ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:44.100940 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df77b9-2ed7-4bac-aefc-780a6da047ea None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:44.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c9df77b9-2ed7-4bac-aefc-780a6da047ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:44.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:44.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:44.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:44.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:44.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:44.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:44.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:44.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:44.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:44.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:44.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:44.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:44.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:44.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:44.123991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:44.125239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:44.125239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:44.125239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:44.125239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:44.125873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 292/584] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:44.127235 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df77b9-2ed7-4bac-aefc-780a6da047ea None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:44.141861 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8ef39-dc1a-474c-b22e-8599912c2865 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:44.158608 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:44.177076 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:44.196343 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343db5e1-14e8-44e4-bdfa-a362b4462b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:44.197445 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343db5e1-14e8-44e4-bdfa-a362b4462b8f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:44.197891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343db5e1-14e8-44e4-bdfa-a362b4462b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:44.198266 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343db5e1-14e8-44e4-bdfa-a362b4462b8f None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:44.199590 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343db5e1-14e8-44e4-bdfa-a362b4462b8f None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:44.200200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343db5e1-14e8-44e4-bdfa-a362b4462b8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:44.202543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343db5e1-14e8-44e4-bdfa-a362b4462b8f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:44.214885 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 293/585] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:44.215999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343db5e1-14e8-44e4-bdfa-a362b4462b8f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:44.257028 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df77b9-2ed7-4bac-aefc-780a6da047ea None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:44.302937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd89c40-76bf-4fc4-b97c-d8b3726d1355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:44.304270 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd89c40-76bf-4fc4-b97c-d8b3726d1355 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:44.304622 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd89c40-76bf-4fc4-b97c-d8b3726d1355 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:44.304966 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd89c40-76bf-4fc4-b97c-d8b3726d1355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:44.319592 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd89c40-76bf-4fc4-b97c-d8b3726d1355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:44.322364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd89c40-76bf-4fc4-b97c-d8b3726d1355 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:44.331510 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343db5e1-14e8-44e4-bdfa-a362b4462b8f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:44.346030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-7cd89c40-76bf-4fc4-b97c-d8b3726d1355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:44.346030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:44.346030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:44.346030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:44.346030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:44.346030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:44.346030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:44.346030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:44.346030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:44.346030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:44.346030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:44.346030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:44.346030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:44.346030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:44.346030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:44.347063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:44.347978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:44.347978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:44.347978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:44.347978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:44.347978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 293/586] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:44.348704 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd89c40-76bf-4fc4-b97c-d8b3726d1355 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:44.384979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a5e30-5d13-449b-b220-283a1c52f53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:44.386012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a5e30-5d13-449b-b220-283a1c52f53b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:44.386598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a5e30-5d13-449b-b220-283a1c52f53b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:44.387088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a5e30-5d13-449b-b220-283a1c52f53b None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:44.388015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a5e30-5d13-449b-b220-283a1c52f53b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:44.388541 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a5e30-5d13-449b-b220-283a1c52f53b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:44.391005 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a5e30-5d13-449b-b220-283a1c52f53b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:44.410521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 294/587] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:44.411667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a5e30-5d13-449b-b220-283a1c52f53b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:44.454482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:44.479448 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:44.496256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd89c40-76bf-4fc4-b97c-d8b3726d1355 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:44.537978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a5e30-5d13-449b-b220-283a1c52f53b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:44.547141 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0debc4b-5bc4-498f-8a1c-32b50b4dc449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:44.547947 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0debc4b-5bc4-498f-8a1c-32b50b4dc449 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:44.548230 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0debc4b-5bc4-498f-8a1c-32b50b4dc449 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:44.548507 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0debc4b-5bc4-498f-8a1c-32b50b4dc449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:44.566177 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0debc4b-5bc4-498f-8a1c-32b50b4dc449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:44.568962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0debc4b-5bc4-498f-8a1c-32b50b4dc449 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:44.580037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7100ab-69ed-4641-9a29-e053605cbf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:44.580749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7100ab-69ed-4641-9a29-e053605cbf87 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:44.581039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7100ab-69ed-4641-9a29-e053605cbf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:44.581331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7100ab-69ed-4641-9a29-e053605cbf87 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:44.582458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7100ab-69ed-4641-9a29-e053605cbf87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:44.583045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7100ab-69ed-4641-9a29-e053605cbf87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:44.584667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7100ab-69ed-4641-9a29-e053605cbf87 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:44.593933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c0debc4b-5bc4-498f-8a1c-32b50b4dc449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:44.593933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:44.593933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:44.593933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:44.593933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:44.593933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:44.593933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:44.593933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:44.593933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:44.593933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:44.593933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:44.593933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:44.593933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:44.593933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:44.593933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:44.594858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:44.595773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:44.595773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:44.595773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:44.595773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:44.596626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 294/588] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:44.596940 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0debc4b-5bc4-498f-8a1c-32b50b4dc449 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:44.600321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 295/589] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:44.605036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7100ab-69ed-4641-9a29-e053605cbf87 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:44.718842 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7100ab-69ed-4641-9a29-e053605cbf87 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:44.726235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:44.745459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0debc4b-5bc4-498f-8a1c-32b50b4dc449 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:44.761162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d71338-7630-471c-91ed-5fa07a291bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:44.762099 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d71338-7630-471c-91ed-5fa07a291bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:44.762516 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d71338-7630-471c-91ed-5fa07a291bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:44.762900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d71338-7630-471c-91ed-5fa07a291bc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:44.771066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d71338-7630-471c-91ed-5fa07a291bc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:44.772782 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d71338-7630-471c-91ed-5fa07a291bc2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:44.781559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:44.792438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-24d71338-7630-471c-91ed-5fa07a291bc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:44.792438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:44.792438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:44.792438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:44.792438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:44.792438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:44.792438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:44.792438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:44.792438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:44.792438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:44.792438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:44.792438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:44.792438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:44.792438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:44.792438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:44.794164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:44.797371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:44.797371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:44.797371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:44.797371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:44.797371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:44.797371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:44.797371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:44.797371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:44.802161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 296/590] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:44.803159 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed24704-9fcb-410a-95ec-b1b28044069b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:44.803337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d71338-7630-471c-91ed-5fa07a291bc2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:44.804540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed24704-9fcb-410a-95ec-b1b28044069b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:44.805023 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed24704-9fcb-410a-95ec-b1b28044069b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:44.805471 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed24704-9fcb-410a-95ec-b1b28044069b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:44.815382 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed24704-9fcb-410a-95ec-b1b28044069b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:44.817292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed24704-9fcb-410a-95ec-b1b28044069b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3ed24704-9fcb-410a-95ec-b1b28044069b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:44.833859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:44.834910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:44.836074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:44.836074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:44.836074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:44.836074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:44.836074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:44.836074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:44.836074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:44.836074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:44.836074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 16:03:44.836074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:44.838102 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 295/591] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:44.839126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed24704-9fcb-410a-95ec-b1b28044069b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:44.927661 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d71338-7630-471c-91ed-5fa07a291bc2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:44.969561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0921bc3-ee0b-4a33-a041-93f706a6569a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:44.970586 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0921bc3-ee0b-4a33-a041-93f706a6569a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:44.971046 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0921bc3-ee0b-4a33-a041-93f706a6569a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:44.971504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0921bc3-ee0b-4a33-a041-93f706a6569a None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:44.972422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0921bc3-ee0b-4a33-a041-93f706a6569a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:44.972835 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0921bc3-ee0b-4a33-a041-93f706a6569a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:44.974300 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0921bc3-ee0b-4a33-a041-93f706a6569a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:44.991924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 297/592] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:44.991924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0921bc3-ee0b-4a33-a041-93f706a6569a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:44.999562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed24704-9fcb-410a-95ec-b1b28044069b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:45.022339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:45.052084 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a844-60cc-40b7-b84e-73ffd1d1c26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:45.053713 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a844-60cc-40b7-b84e-73ffd1d1c26b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:45.054225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a844-60cc-40b7-b84e-73ffd1d1c26b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:45.054863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a844-60cc-40b7-b84e-73ffd1d1c26b None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:45.055675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6a844-60cc-40b7-b84e-73ffd1d1c26b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:45.055990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6a844-60cc-40b7-b84e-73ffd1d1c26b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:45.057393 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6a844-60cc-40b7-b84e-73ffd1d1c26b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:45.075756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 296/593] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:45.075756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a844-60cc-40b7-b84e-73ffd1d1c26b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:45.116970 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0921bc3-ee0b-4a33-a041-93f706a6569a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:45.141638 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:45.163866 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323da9f-0547-4e67-954e-ddc0a80b1ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:45.164550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323da9f-0547-4e67-954e-ddc0a80b1ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:45.164836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323da9f-0547-4e67-954e-ddc0a80b1ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:45.165117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323da9f-0547-4e67-954e-ddc0a80b1ce7 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:45.165959 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323da9f-0547-4e67-954e-ddc0a80b1ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:45.166272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323da9f-0547-4e67-954e-ddc0a80b1ce7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:45.167736 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323da9f-0547-4e67-954e-ddc0a80b1ce7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:45.191205 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 298/594] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jun 16 16:03:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:45.191205 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323da9f-0547-4e67-954e-ddc0a80b1ce7 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:45.224744 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a844-60cc-40b7-b84e-73ffd1d1c26b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:45.265330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf019e-5c07-42e4-8109-217d9e883217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:45.266605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf019e-5c07-42e4-8109-217d9e883217 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:45.267122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf019e-5c07-42e4-8109-217d9e883217 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:45.267598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf019e-5c07-42e4-8109-217d9e883217 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:45.275526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf019e-5c07-42e4-8109-217d9e883217 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:45.277330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf019e-5c07-42e4-8109-217d9e883217 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:45.281765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9fdf019e-5c07-42e4-8109-217d9e883217 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:45.296412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:45.297432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:45.298367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:45.298367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:45.298367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:45.298367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:45.298367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:45.298367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:45.298367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:45.298367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:45.298367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 16:03:45.298367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:45.298955 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323da9f-0547-4e67-954e-ddc0a80b1ce7 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:45.305542 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 297/595] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:45.306763 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf019e-5c07-42e4-8109-217d9e883217 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:45.335690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350f75f-487f-4c9f-a539-5b16e56ee29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:45.336654 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350f75f-487f-4c9f-a539-5b16e56ee29a None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:45.336943 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350f75f-487f-4c9f-a539-5b16e56ee29a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:45.337272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350f75f-487f-4c9f-a539-5b16e56ee29a None admin] PATH_INFO: `/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/59174974208c469b8bb44d94d0e55427/roles/6da95c91bacf48f9870a114e2ab05472` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:45.353434 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350f75f-487f-4c9f-a539-5b16e56ee29a None admin] RBAC: Authorizing `identity:create_grant(project_id=227cd348bea64e1f89d77ae2cf63a031, user_id=59174974208c469b8bb44d94d0e55427, role_id=6da95c91bacf48f9870a114e2ab05472)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:45.355337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350f75f-487f-4c9f-a539-5b16e56ee29a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:45.378606 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 299/596] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:03:45 2022] PUT /identity/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/59174974208c469b8bb44d94d0e55427/roles/6da95c91bacf48f9870a114e2ab05472 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:03:45.378606 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350f75f-487f-4c9f-a539-5b16e56ee29a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:45.475503 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf019e-5c07-42e4-8109-217d9e883217 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:45.485401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:45.522795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350f75f-487f-4c9f-a539-5b16e56ee29a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:45.524160 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255bc00-14fc-40dd-84ae-0628f996870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:45.526643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255bc00-14fc-40dd-84ae-0628f996870c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:45.527181 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255bc00-14fc-40dd-84ae-0628f996870c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:45.527605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255bc00-14fc-40dd-84ae-0628f996870c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:45.544696 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255bc00-14fc-40dd-84ae-0628f996870c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:45.546898 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255bc00-14fc-40dd-84ae-0628f996870c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:45.564740 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c12fdf-7459-4bce-92a4-b43448f0248d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:45.565653 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c12fdf-7459-4bce-92a4-b43448f0248d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:45.566038 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c12fdf-7459-4bce-92a4-b43448f0248d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:45.566542 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c12fdf-7459-4bce-92a4-b43448f0248d None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:45.567507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c12fdf-7459-4bce-92a4-b43448f0248d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:45.567923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c12fdf-7459-4bce-92a4-b43448f0248d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:45.569549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c12fdf-7459-4bce-92a4-b43448f0248d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:45.572179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:45.575585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6255bc00-14fc-40dd-84ae-0628f996870c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:45.575585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:45.575585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:45.575585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:45.575585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:45.575585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:45.575585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:45.575585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:45.575585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:45.575585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:45.575585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:45.575585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:45.575585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:45.575585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:45.575585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:45.577204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:45.578202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:45.578202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:45.578202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:45.578202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:45.579122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 298/597] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:45.580282 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70930298-6b4c-494d-ace1-2a74a65b7932 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:45.580572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70930298-6b4c-494d-ace1-2a74a65b7932 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:45.580851 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70930298-6b4c-494d-ace1-2a74a65b7932 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:45.582244 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 299/598] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:45.587139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70930298-6b4c-494d-ace1-2a74a65b7932 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:45.602502 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 300/599] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Jun 16 16:03:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:45.604147 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99918d-56c9-45f7-9552-eb4d685c10b9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:45.604579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99918d-56c9-45f7-9552-eb4d685c10b9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:45.605008 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99918d-56c9-45f7-9552-eb4d685c10b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:45.624582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-cd99918d-56c9-45f7-9552-eb4d685c10b9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:45.625827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cd99918d-56c9-45f7-9552-eb4d685c10b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:45.708784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70930298-6b4c-494d-ace1-2a74a65b7932 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:45.709491 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 301/600] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:45.710445 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99918d-56c9-45f7-9552-eb4d685c10b9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:45.750128 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80d91b-9220-48cb-9c48-5a4f918e738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:45.751060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80d91b-9220-48cb-9c48-5a4f918e738b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:45.751352 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80d91b-9220-48cb-9c48-5a4f918e738b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:45.751630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80d91b-9220-48cb-9c48-5a4f918e738b None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:45.752363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80d91b-9220-48cb-9c48-5a4f918e738b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:45.752673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80d91b-9220-48cb-9c48-5a4f918e738b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:45.754928 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80d91b-9220-48cb-9c48-5a4f918e738b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:45.769070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 300/601] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:45.770140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80d91b-9220-48cb-9c48-5a4f918e738b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:45.801303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:45.853688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99918d-56c9-45f7-9552-eb4d685c10b9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:45.883631 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:45.898982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ede60-3d42-47b4-a86b-bf60e3ff131c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:45.899803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ede60-3d42-47b4-a86b-bf60e3ff131c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:45.900090 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ede60-3d42-47b4-a86b-bf60e3ff131c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:45.900370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ede60-3d42-47b4-a86b-bf60e3ff131c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:45.901881 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80d91b-9220-48cb-9c48-5a4f918e738b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:45.913010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ede60-3d42-47b4-a86b-bf60e3ff131c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:45.914922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ede60-3d42-47b4-a86b-bf60e3ff131c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:45.936794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-b73ede60-3d42-47b4-a86b-bf60e3ff131c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:45.936794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:45.936794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:45.936794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:45.936794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:45.936794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:45.936794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:45.936794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:45.936794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:45.936794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:45.936794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:45.936794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:45.936794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:45.936794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:45.936794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:45.937825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:45.938742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:45.938742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:45.938742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:45.938742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:45.942813 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 302/602] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:45.943859 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ede60-3d42-47b4-a86b-bf60e3ff131c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:45.947633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395f41c-aee2-4886-970c-fae84493271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:45.948792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395f41c-aee2-4886-970c-fae84493271d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:45.949239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395f41c-aee2-4886-970c-fae84493271d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:45.949653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395f41c-aee2-4886-970c-fae84493271d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:45.964237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395f41c-aee2-4886-970c-fae84493271d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-2395f41c-aee2-4886-970c-fae84493271d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:45.973875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:45.975068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:45.975974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:45.975974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:45.975974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:45.975974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:45.975974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:45.975974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:45.975974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:45.975974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:45.975974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:45.975974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:45.975974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:45.975974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:45.978315 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 301/603] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:45.979409 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395f41c-aee2-4886-970c-fae84493271d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:46.054704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ede60-3d42-47b4-a86b-bf60e3ff131c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:46.070494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:46.093880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a67fd-8279-4753-88a9-73dff3ece571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:46.094718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a67fd-8279-4753-88a9-73dff3ece571 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:46.094899 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395f41c-aee2-4886-970c-fae84493271d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:46.095002 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a67fd-8279-4753-88a9-73dff3ece571 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:46.095270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a67fd-8279-4753-88a9-73dff3ece571 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:46.103015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a67fd-8279-4753-88a9-73dff3ece571 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:46.104845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a67fd-8279-4753-88a9-73dff3ece571 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:46.119682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-c51a67fd-8279-4753-88a9-73dff3ece571 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:46.119682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:46.119682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:46.119682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:46.119682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:46.119682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:46.119682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:46.119682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:46.119682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:46.119682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:46.119682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:46.119682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:46.119682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:46.119682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:46.119682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:46.120561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:46.121456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:46.121456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:46.121456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:46.121456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:46.121456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:46.121456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:46.121456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:46.121456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:46.121456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 303/604] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:46.121942 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a67fd-8279-4753-88a9-73dff3ece571 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:46.137837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38727fa8-a6eb-4dab-a02c-08944f164556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:46.139526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38727fa8-a6eb-4dab-a02c-08944f164556 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:46.139801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38727fa8-a6eb-4dab-a02c-08944f164556 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:46.140078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38727fa8-a6eb-4dab-a02c-08944f164556 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:46.140975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38727fa8-a6eb-4dab-a02c-08944f164556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:46.141281 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38727fa8-a6eb-4dab-a02c-08944f164556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:46.143276 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38727fa8-a6eb-4dab-a02c-08944f164556 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:46.160873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 302/605] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:46.160873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fae31-0863-490a-a5c7-8afda2e2c991 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:46.160873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fae31-0863-490a-a5c7-8afda2e2c991 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:46.160873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fae31-0863-490a-a5c7-8afda2e2c991 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:46.160873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 303/606] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:46.160873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fae31-0863-490a-a5c7-8afda2e2c991 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:46.170421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:46.248288 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a67fd-8279-4753-88a9-73dff3ece571 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:46.273496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fae31-0863-490a-a5c7-8afda2e2c991 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:46.285952 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000dde9-ffb7-4854-8757-d8fed177d6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:46.286661 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000dde9-ffb7-4854-8757-d8fed177d6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:46.286949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000dde9-ffb7-4854-8757-d8fed177d6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:46.287240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000dde9-ffb7-4854-8757-d8fed177d6a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:46.288006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000dde9-ffb7-4854-8757-d8fed177d6a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:46.288321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000dde9-ffb7-4854-8757-d8fed177d6a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:46.289722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000dde9-ffb7-4854-8757-d8fed177d6a7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:46.298484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 304/607] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:46.299320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000dde9-ffb7-4854-8757-d8fed177d6a7 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:46.320884 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1ef81-e66c-40a2-9a8b-d4afedd4d7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:46.321730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1ef81-e66c-40a2-9a8b-d4afedd4d7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:46.322063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1ef81-e66c-40a2-9a8b-d4afedd4d7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:46.322332 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1ef81-e66c-40a2-9a8b-d4afedd4d7f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:46.323178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1ef81-e66c-40a2-9a8b-d4afedd4d7f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:46.323487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1ef81-e66c-40a2-9a8b-d4afedd4d7f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:46.324909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1ef81-e66c-40a2-9a8b-d4afedd4d7f3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:46.333644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:46.339658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 304/608] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:46.340882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdc3ab-0159-42bb-87fc-7d2d697af2ef None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:46.341169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdc3ab-0159-42bb-87fc-7d2d697af2ef None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:46.341455 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdc3ab-0159-42bb-87fc-7d2d697af2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:46.361185 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5bcdc3ab-0159-42bb-87fc-7d2d697af2ef None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:46.362524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5bcdc3ab-0159-42bb-87fc-7d2d697af2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:46.423936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:46.430495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000dde9-ffb7-4854-8757-d8fed177d6a7 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:46.442496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 305/609] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:46.442496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdc3ab-0159-42bb-87fc-7d2d697af2ef None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:46.470412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccf480-d6df-4cf1-82ab-4f04441b35c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:46.471280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccf480-d6df-4cf1-82ab-4f04441b35c8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:46.471568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccf480-d6df-4cf1-82ab-4f04441b35c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:46.471850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccf480-d6df-4cf1-82ab-4f04441b35c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:46.479389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccf480-d6df-4cf1-82ab-4f04441b35c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:46.480999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccf480-d6df-4cf1-82ab-4f04441b35c8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:46.496786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-37ccf480-d6df-4cf1-82ab-4f04441b35c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:46.496786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:46.496786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:46.496786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:46.496786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:46.496786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:46.496786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:46.496786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:46.496786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:46.496786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:46.496786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:46.496786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:46.496786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:46.496786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:46.496786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:46.497708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:46.499268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:46.499268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:46.499268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:46.499268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:46.499268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:46.499268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:46.499268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:46.499268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:46.499268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 305/610] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:46.500442 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccf480-d6df-4cf1-82ab-4f04441b35c8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:46.558282 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdc3ab-0159-42bb-87fc-7d2d697af2ef None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:46.590008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:46.599673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6d03c-f525-433b-ba6f-46c66c7e4926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:46.600500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d03c-f525-433b-ba6f-46c66c7e4926 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:46.600786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d03c-f525-433b-ba6f-46c66c7e4926 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:46.601066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d03c-f525-433b-ba6f-46c66c7e4926 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:46.609131 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccf480-d6df-4cf1-82ab-4f04441b35c8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:46.613778 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6d03c-f525-433b-ba6f-46c66c7e4926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:46.615300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6d03c-f525-433b-ba6f-46c66c7e4926 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:46.637173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-2ef6d03c-f525-433b-ba6f-46c66c7e4926 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:46.637173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:46.637173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:46.637173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:46.637173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:46.637173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:46.637173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:46.637173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:46.637173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:46.637173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:46.637173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:46.637173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:46.637173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:46.637173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:46.637173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:46.638166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:46.639781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:46.639781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:46.639781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:46.639781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:46.639781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 306/611] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:46.641572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6d03c-f525-433b-ba6f-46c66c7e4926 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:46.660923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9713da-4b2f-4a8d-a7cc-d2f6535ba582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:46.660923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9713da-4b2f-4a8d-a7cc-d2f6535ba582 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:46.660923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9713da-4b2f-4a8d-a7cc-d2f6535ba582 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:46.660923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9713da-4b2f-4a8d-a7cc-d2f6535ba582 None admin] PATH_INFO: `/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/65e8905bab4c47f9a5fb374ef0377983/roles/6da95c91bacf48f9870a114e2ab05472` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:46.674806 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9713da-4b2f-4a8d-a7cc-d2f6535ba582 None admin] RBAC: Authorizing `identity:create_grant(project_id=227cd348bea64e1f89d77ae2cf63a031, user_id=65e8905bab4c47f9a5fb374ef0377983, role_id=6da95c91bacf48f9870a114e2ab05472)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:46.676273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9713da-4b2f-4a8d-a7cc-d2f6535ba582 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:46.698462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 306/612] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:03:46 2022] PUT /identity/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/65e8905bab4c47f9a5fb374ef0377983/roles/6da95c91bacf48f9870a114e2ab05472 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:03:46.698462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9713da-4b2f-4a8d-a7cc-d2f6535ba582 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:46.713210 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:46.782811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6d03c-f525-433b-ba6f-46c66c7e4926 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:46.828719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9713da-4b2f-4a8d-a7cc-d2f6535ba582 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:46.838416 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78800b7c-8a8b-4660-ba9f-99a1b623c235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:46.840140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78800b7c-8a8b-4660-ba9f-99a1b623c235 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:46.840607 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78800b7c-8a8b-4660-ba9f-99a1b623c235 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:46.841042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78800b7c-8a8b-4660-ba9f-99a1b623c235 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:46.861701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78800b7c-8a8b-4660-ba9f-99a1b623c235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-78800b7c-8a8b-4660-ba9f-99a1b623c235 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:46.869807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:46.871169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:46.872923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:46.872923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:46.872923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:46.872923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:46.872923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:46.872923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:46.872923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:46.872923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:46.872923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:46.872923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:46.872923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:46.872923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:46.874866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 307/613] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:46.875914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78800b7c-8a8b-4660-ba9f-99a1b623c235 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:46.889284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76e36f-eba8-42af-a92b-f8fd7c661333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:46.894823 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76e36f-eba8-42af-a92b-f8fd7c661333 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:46.895439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76e36f-eba8-42af-a92b-f8fd7c661333 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:46.896096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76e36f-eba8-42af-a92b-f8fd7c661333 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:46.897841 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76e36f-eba8-42af-a92b-f8fd7c661333 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:46.898503 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76e36f-eba8-42af-a92b-f8fd7c661333 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:46.900768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76e36f-eba8-42af-a92b-f8fd7c661333 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:46.919597 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 307/614] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:46.921081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76e36f-eba8-42af-a92b-f8fd7c661333 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:46.930792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:47.000094 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:47.021770 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78800b7c-8a8b-4660-ba9f-99a1b623c235 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:47.043142 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76e36f-eba8-42af-a92b-f8fd7c661333 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:47.065047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f599c2e-8d08-45ed-afd9-c5bd8111fd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:47.065985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f599c2e-8d08-45ed-afd9-c5bd8111fd92 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:47.066341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f599c2e-8d08-45ed-afd9-c5bd8111fd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:47.066714 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f599c2e-8d08-45ed-afd9-c5bd8111fd92 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:47.067570 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f599c2e-8d08-45ed-afd9-c5bd8111fd92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:47.068050 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f599c2e-8d08-45ed-afd9-c5bd8111fd92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:47.069600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f599c2e-8d08-45ed-afd9-c5bd8111fd92 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:47.085115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 308/615] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:47.086157 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f599c2e-8d08-45ed-afd9-c5bd8111fd92 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:47.090276 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da447ba8-d836-43bb-b001-65287149c633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:47.092422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da447ba8-d836-43bb-b001-65287149c633 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:47.092716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da447ba8-d836-43bb-b001-65287149c633 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:47.092999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da447ba8-d836-43bb-b001-65287149c633 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:47.093766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da447ba8-d836-43bb-b001-65287149c633 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:47.094081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da447ba8-d836-43bb-b001-65287149c633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:47.095504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da447ba8-d836-43bb-b001-65287149c633 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:47.108304 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 308/616] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:47.109184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da447ba8-d836-43bb-b001-65287149c633 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:47.208878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:47.212422 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f599c2e-8d08-45ed-afd9-c5bd8111fd92 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:47.255152 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de69704-aa43-48a8-8690-b07af1fa3bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:47.256541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de69704-aa43-48a8-8690-b07af1fa3bd8 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:47.256933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de69704-aa43-48a8-8690-b07af1fa3bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:47.257318 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de69704-aa43-48a8-8690-b07af1fa3bd8 None admin] PATH_INFO: `/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/087adcbf737843db97dabfa9708484c0/roles/6da95c91bacf48f9870a114e2ab05472` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:47.258585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da447ba8-d836-43bb-b001-65287149c633 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:47.276104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de69704-aa43-48a8-8690-b07af1fa3bd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=227cd348bea64e1f89d77ae2cf63a031, user_id=087adcbf737843db97dabfa9708484c0, role_id=6da95c91bacf48f9870a114e2ab05472)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:47.278150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de69704-aa43-48a8-8690-b07af1fa3bd8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:47.293817 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:47.299095 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 309/617] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:03:47 2022] PUT /identity/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/087adcbf737843db97dabfa9708484c0/roles/6da95c91bacf48f9870a114e2ab05472 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:03:47.300448 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de69704-aa43-48a8-8690-b07af1fa3bd8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:47.303030 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cf25c-7e96-4986-8782-14728048cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:47.303971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cf25c-7e96-4986-8782-14728048cbda None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:47.304263 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cf25c-7e96-4986-8782-14728048cbda None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:47.304550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cf25c-7e96-4986-8782-14728048cbda None admin] PATH_INFO: `/v3/users/swift` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:47.315047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cf25c-7e96-4986-8782-14728048cbda None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:47.316663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cf25c-7e96-4986-8782-14728048cbda None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-185cf25c-7e96-4986-8782-14728048cbda None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:47.333018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:47.334065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:47.335696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:47.335696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:47.335696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:47.335696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:47.335696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:47.335696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:47.335696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:47.335696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:47.335696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 16:03:47.335696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:47.335696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 309/618] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:03:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:47.347763 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cf25c-7e96-4986-8782-14728048cbda None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:47.436831 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de69704-aa43-48a8-8690-b07af1fa3bd8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:47.481006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf0c4a-2521-4120-a5df-746fbe2c23d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:47.482269 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf0c4a-2521-4120-a5df-746fbe2c23d6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:47.483630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf0c4a-2521-4120-a5df-746fbe2c23d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:47.484175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf0c4a-2521-4120-a5df-746fbe2c23d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:47.496834 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf0c4a-2521-4120-a5df-746fbe2c23d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:47.499851 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf0c4a-2521-4120-a5df-746fbe2c23d6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:47.513347 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cf25c-7e96-4986-8782-14728048cbda None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:47.522980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-53cf0c4a-2521-4120-a5df-746fbe2c23d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:47.522980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:47.522980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:47.522980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:47.522980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:47.522980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:47.522980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:47.522980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:47.522980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:47.522980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:47.522980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:47.522980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:47.522980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:47.522980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:47.522980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:47.524136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:47.525080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:47.525080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:47.525080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:47.525080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:47.527671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 310/619] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:47.533627 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf0c4a-2521-4120-a5df-746fbe2c23d6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:47.537180 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:47.584429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb28db-c931-404f-b560-9140416d6ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:47.585170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb28db-c931-404f-b560-9140416d6ade None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:47.585525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb28db-c931-404f-b560-9140416d6ade None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:47.585816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb28db-c931-404f-b560-9140416d6ade None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:47.586735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb28db-c931-404f-b560-9140416d6ade None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:47.587052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb28db-c931-404f-b560-9140416d6ade None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:47.588518 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb28db-c931-404f-b560-9140416d6ade None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:47.614500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 310/620] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jun 16 16:03:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:47.620571 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb28db-c931-404f-b560-9140416d6ade None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:47.678390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf0c4a-2521-4120-a5df-746fbe2c23d6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:47.719691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:47.725485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae39a0-6b40-482d-b9fb-05005021700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:47.726164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae39a0-6b40-482d-b9fb-05005021700d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:47.726468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae39a0-6b40-482d-b9fb-05005021700d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:47.726751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae39a0-6b40-482d-b9fb-05005021700d None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:47.727477 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae39a0-6b40-482d-b9fb-05005021700d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:47.727784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae39a0-6b40-482d-b9fb-05005021700d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:47.729164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae39a0-6b40-482d-b9fb-05005021700d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:47.754854 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 311/621] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:47.764678 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae39a0-6b40-482d-b9fb-05005021700d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:47.859069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:47.871521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb28db-c931-404f-b560-9140416d6ade None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:47.892310 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae39a0-6b40-482d-b9fb-05005021700d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:47.935216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6b495-c49f-4064-a191-905d03b2f3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:47.936062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6b495-c49f-4064-a191-905d03b2f3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:47.936599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6b495-c49f-4064-a191-905d03b2f3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:47.936884 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6b495-c49f-4064-a191-905d03b2f3f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:47.946709 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6b495-c49f-4064-a191-905d03b2f3f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:47.947367 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59601c-ebc1-4312-8d3d-8345bab91c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:47.948170 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6b495-c49f-4064-a191-905d03b2f3f3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:47.948944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59601c-ebc1-4312-8d3d-8345bab91c16 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:47.949435 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59601c-ebc1-4312-8d3d-8345bab91c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:47.950262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59601c-ebc1-4312-8d3d-8345bab91c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-92f6b495-c49f-4064-a191-905d03b2f3f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:47.965204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:47.966238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:47.967796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:47.967796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:47.967796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:47.967796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:47.967796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:47.967796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:47.967796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:47.967796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:47.967796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:03:47.967796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:47.967796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 312/622] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 16 16:03:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:47.972105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f77b85-1344-4f91-b925-d35ce8f8c980 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:47.972391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f77b85-1344-4f91-b925-d35ce8f8c980 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:47.972672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f77b85-1344-4f91-b925-d35ce8f8c980 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:47.974174 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 313/623] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:47.976304 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f77b85-1344-4f91-b925-d35ce8f8c980 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:47.978304 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59601c-ebc1-4312-8d3d-8345bab91c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:47.979945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59601c-ebc1-4312-8d3d-8345bab91c16 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:48.005700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-7a59601c-ebc1-4312-8d3d-8345bab91c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:48.005700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:48.005700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:48.005700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:48.005700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:48.005700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:48.005700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:48.005700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:48.005700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:48.005700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:48.005700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:48.005700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:48.005700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:48.005700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:48.005700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:48.006700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:48.007627 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:48.007627 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:48.007627 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:48.007627 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:48.007627 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 311/624] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:48.012700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c64b0-0e59-41f1-82b7-9801ff69587d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:48.012700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c64b0-0e59-41f1-82b7-9801ff69587d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:48.012700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c64b0-0e59-41f1-82b7-9801ff69587d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:48.035605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0c1c64b0-0e59-41f1-82b7-9801ff69587d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:48.037358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0c1c64b0-0e59-41f1-82b7-9801ff69587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:48.103793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f77b85-1344-4f91-b925-d35ce8f8c980 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:48.127605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 312/625] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:48.128733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:48.129009 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c64b0-0e59-41f1-82b7-9801ff69587d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:48.140982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17549cdf-875f-4ab9-8958-eadca5acd33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:48.141653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17549cdf-875f-4ab9-8958-eadca5acd33b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:48.141990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17549cdf-875f-4ab9-8958-eadca5acd33b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:48.142283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17549cdf-875f-4ab9-8958-eadca5acd33b None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:48.143272 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17549cdf-875f-4ab9-8958-eadca5acd33b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:48.143579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17549cdf-875f-4ab9-8958-eadca5acd33b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:48.145004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17549cdf-875f-4ab9-8958-eadca5acd33b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:48.167731 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 314/626] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 16 16:03:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:48.168626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17549cdf-875f-4ab9-8958-eadca5acd33b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:48.170666 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:48.253078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c64b0-0e59-41f1-82b7-9801ff69587d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:48.272893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17549cdf-875f-4ab9-8958-eadca5acd33b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:48.293427 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab2ff3-6243-4ba2-a8fb-9d00cc50769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:48.294506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab2ff3-6243-4ba2-a8fb-9d00cc50769b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:48.295103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab2ff3-6243-4ba2-a8fb-9d00cc50769b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:48.295646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab2ff3-6243-4ba2-a8fb-9d00cc50769b None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:48.296584 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab2ff3-6243-4ba2-a8fb-9d00cc50769b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:48.297114 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab2ff3-6243-4ba2-a8fb-9d00cc50769b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:48.298916 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab2ff3-6243-4ba2-a8fb-9d00cc50769b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:48.309447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168804f-22c9-4bd6-8120-e263dffae1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:48.310244 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168804f-22c9-4bd6-8120-e263dffae1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:48.310579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168804f-22c9-4bd6-8120-e263dffae1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:48.310858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168804f-22c9-4bd6-8120-e263dffae1f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:48.314288 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 313/627] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:48.315420 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab2ff3-6243-4ba2-a8fb-9d00cc50769b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:48.323518 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168804f-22c9-4bd6-8120-e263dffae1f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-1168804f-22c9-4bd6-8120-e263dffae1f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:48.331883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:48.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:48.334324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:48.334324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:48.334324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:48.334324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:48.334324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:48.334324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:48.334324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:48.334324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:48.334324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:48.334324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:48.334324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:48.334324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:48.334324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 315/628] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:48.334324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168804f-22c9-4bd6-8120-e263dffae1f0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:48.389688 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:48.425011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:48.440728 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab2ff3-6243-4ba2-a8fb-9d00cc50769b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:48.453629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168804f-22c9-4bd6-8120-e263dffae1f0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:48.480555 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0602149-d17b-421e-a45f-ec7dadc4c8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:48.481690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0602149-d17b-421e-a45f-ec7dadc4c8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:48.482228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0602149-d17b-421e-a45f-ec7dadc4c8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:48.482903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0602149-d17b-421e-a45f-ec7dadc4c8d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:48.489135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bd800-ab59-4402-9319-73e9fa689b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:48.489933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bd800-ab59-4402-9319-73e9fa689b14 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:48.490210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bd800-ab59-4402-9319-73e9fa689b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:48.490508 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bd800-ab59-4402-9319-73e9fa689b14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:48.497509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571bd800-ab59-4402-9319-73e9fa689b14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:48.499060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571bd800-ab59-4402-9319-73e9fa689b14 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:48.514191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-571bd800-ab59-4402-9319-73e9fa689b14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:48.514191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:48.514191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:48.514191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:48.514191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:48.514191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:48.514191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:48.514191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:48.514191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:48.514191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:48.514191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:48.514191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:48.514191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:48.514191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:48.514191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:48.515596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:48.517061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:48.517061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:48.517061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:48.517061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:48.517061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:48.517061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:48.517061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:48.517061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:48.517061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 316/629] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:48.517061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bd800-ab59-4402-9319-73e9fa689b14 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:48.565824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0602149-d17b-421e-a45f-ec7dadc4c8d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:48.568160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0602149-d17b-421e-a45f-ec7dadc4c8d4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:48.633442 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:48.636752 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bd800-ab59-4402-9319-73e9fa689b14 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:48.674311 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55aa46-be53-42c4-a750-bc0c7f8875e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:48.674561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:48.675837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55aa46-be53-42c4-a750-bc0c7f8875e6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:48.676224 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55aa46-be53-42c4-a750-bc0c7f8875e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:48.676740 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55aa46-be53-42c4-a750-bc0c7f8875e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:48.678004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55aa46-be53-42c4-a750-bc0c7f8875e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:48.678418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55aa46-be53-42c4-a750-bc0c7f8875e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:48.679971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55aa46-be53-42c4-a750-bc0c7f8875e6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:48.690492 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 317/630] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:48.690937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55aa46-be53-42c4-a750-bc0c7f8875e6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:48.695788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 314/631] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:48.696899 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0602149-d17b-421e-a45f-ec7dadc4c8d4 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:48.801370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55aa46-be53-42c4-a750-bc0c7f8875e6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:48.816135 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0602149-d17b-421e-a45f-ec7dadc4c8d4 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:48.839139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ec877-db86-4d1c-8387-fa4c3709282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:48.839938 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ec877-db86-4d1c-8387-fa4c3709282f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:48.840296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ec877-db86-4d1c-8387-fa4c3709282f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:48.840651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ec877-db86-4d1c-8387-fa4c3709282f None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:48.841518 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ec877-db86-4d1c-8387-fa4c3709282f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:48.842030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ec877-db86-4d1c-8387-fa4c3709282f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:48.843751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ec877-db86-4d1c-8387-fa4c3709282f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:48.853549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705de994-a28e-49b5-853a-5ef5a9c30949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:48.854759 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705de994-a28e-49b5-853a-5ef5a9c30949 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:48.855158 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705de994-a28e-49b5-853a-5ef5a9c30949 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:48.855447 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705de994-a28e-49b5-853a-5ef5a9c30949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:48.858879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 318/632] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:48.859949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ec877-db86-4d1c-8387-fa4c3709282f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:48.871982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705de994-a28e-49b5-853a-5ef5a9c30949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:48.874135 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705de994-a28e-49b5-853a-5ef5a9c30949 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:48.886799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:48.900023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-705de994-a28e-49b5-853a-5ef5a9c30949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:48.900023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:48.900023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:48.900023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:48.900023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:48.900023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:48.900023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:48.900023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:48.900023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:48.900023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:48.900023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:48.900023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:48.900023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:48.900023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:48.900023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:48.901155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:48.902287 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:48.902287 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:48.902287 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:48.902287 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:48.903893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 315/633] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:48.905080 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705de994-a28e-49b5-853a-5ef5a9c30949 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:48.962907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:48.981106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ec877-db86-4d1c-8387-fa4c3709282f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:49.020188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6ef20-0911-4b01-8099-5ae96e7ec616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:49.021404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6ef20-0911-4b01-8099-5ae96e7ec616 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:49.021404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6ef20-0911-4b01-8099-5ae96e7ec616 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:49.021729 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6ef20-0911-4b01-8099-5ae96e7ec616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:49.036034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6ef20-0911-4b01-8099-5ae96e7ec616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:49.037539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6ef20-0911-4b01-8099-5ae96e7ec616 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:49.050017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705de994-a28e-49b5-853a-5ef5a9c30949 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:49.057827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-1ff6ef20-0911-4b01-8099-5ae96e7ec616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:49.057827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:49.057827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:49.057827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:49.057827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:49.057827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:49.057827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:49.057827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:49.057827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:49.057827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:49.057827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:49.057827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:49.057827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:49.057827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:49.057827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:49.058874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:49.059782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:49.059782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:49.059782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:49.059782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:49.064677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 319/634] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:49.065674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6ef20-0911-4b01-8099-5ae96e7ec616 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:49.093423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80331c05-b8ab-4970-a337-9cb0d7601863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:49.094382 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80331c05-b8ab-4970-a337-9cb0d7601863 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:49.094723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80331c05-b8ab-4970-a337-9cb0d7601863 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:49.095145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80331c05-b8ab-4970-a337-9cb0d7601863 None admin] PATH_INFO: `/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/a8527cbb8efe43d7bb297d779929a50e/roles/6da95c91bacf48f9870a114e2ab05472` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:49.111303 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80331c05-b8ab-4970-a337-9cb0d7601863 None admin] RBAC: Authorizing `identity:create_grant(project_id=227cd348bea64e1f89d77ae2cf63a031, user_id=a8527cbb8efe43d7bb297d779929a50e, role_id=6da95c91bacf48f9870a114e2ab05472)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:49.112755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80331c05-b8ab-4970-a337-9cb0d7601863 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:49.129401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 316/635] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:03:48 2022] PUT /identity/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/a8527cbb8efe43d7bb297d779929a50e/roles/6da95c91bacf48f9870a114e2ab05472 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:03:49.130652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80331c05-b8ab-4970-a337-9cb0d7601863 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:49.158616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:49.186640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6ef20-0911-4b01-8099-5ae96e7ec616 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:49.233465 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cd351-bd6c-4f17-af2d-25dbb2914f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:49.235149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cd351-bd6c-4f17-af2d-25dbb2914f1c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:49.235942 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cd351-bd6c-4f17-af2d-25dbb2914f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:49.236437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cd351-bd6c-4f17-af2d-25dbb2914f1c None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:49.237533 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cd351-bd6c-4f17-af2d-25dbb2914f1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:49.238035 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cd351-bd6c-4f17-af2d-25dbb2914f1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:49.240561 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cd351-bd6c-4f17-af2d-25dbb2914f1c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:49.256140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 320/636] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:49.258461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28358517-8924-4f12-b0be-76a6550c894a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:49.258996 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28358517-8924-4f12-b0be-76a6550c894a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:49.259469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28358517-8924-4f12-b0be-76a6550c894a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:49.261462 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 321/637] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:49.262584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28358517-8924-4f12-b0be-76a6550c894a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:49.271400 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:49.288021 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80331c05-b8ab-4970-a337-9cb0d7601863 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:49.338134 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935ac29-77d1-4bb1-ab5d-396ee506f0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:49.338920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935ac29-77d1-4bb1-ab5d-396ee506f0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:49.339273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935ac29-77d1-4bb1-ab5d-396ee506f0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:49.339553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935ac29-77d1-4bb1-ab5d-396ee506f0b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:49.340277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935ac29-77d1-4bb1-ab5d-396ee506f0b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:49.340582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935ac29-77d1-4bb1-ab5d-396ee506f0b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:49.341986 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935ac29-77d1-4bb1-ab5d-396ee506f0b2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:49.360186 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 317/638] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:49.361490 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efbb42-696f-427e-96aa-8e6b6b615687 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:49.361781 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efbb42-696f-427e-96aa-8e6b6b615687 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:49.362062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efbb42-696f-427e-96aa-8e6b6b615687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:49.391033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-30efbb42-696f-427e-96aa-8e6b6b615687 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:49.392595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-30efbb42-696f-427e-96aa-8e6b6b615687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:49.395896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28358517-8924-4f12-b0be-76a6550c894a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:49.431254 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397fe95-70f4-48ee-aa25-8ecf3c462d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:49.432053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397fe95-70f4-48ee-aa25-8ecf3c462d54 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:49.432334 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397fe95-70f4-48ee-aa25-8ecf3c462d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:49.432611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397fe95-70f4-48ee-aa25-8ecf3c462d54 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:49.434664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:49.442531 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397fe95-70f4-48ee-aa25-8ecf3c462d54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:49.444009 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397fe95-70f4-48ee-aa25-8ecf3c462d54 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9397fe95-70f4-48ee-aa25-8ecf3c462d54 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:49.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:49.460356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:49.461302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:49.461302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:49.461302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:49.461302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:49.461302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:49.461302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:49.461302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:49.461302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:49.461302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 16:03:49.461302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:49.461302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 322/639] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:49.461910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397fe95-70f4-48ee-aa25-8ecf3c462d54 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:49.473197 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 318/640] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:49.474074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efbb42-696f-427e-96aa-8e6b6b615687 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:49.564335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:49.588705 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efbb42-696f-427e-96aa-8e6b6b615687 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:49.597213 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397fe95-70f4-48ee-aa25-8ecf3c462d54 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:49.627176 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a2a34-8ffe-4721-928d-2c8467cb07fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:49.627862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a2a34-8ffe-4721-928d-2c8467cb07fc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:49.628255 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a2a34-8ffe-4721-928d-2c8467cb07fc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:49.628544 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a2a34-8ffe-4721-928d-2c8467cb07fc None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:49.629495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a2a34-8ffe-4721-928d-2c8467cb07fc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:49.629816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a2a34-8ffe-4721-928d-2c8467cb07fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:49.631315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a2a34-8ffe-4721-928d-2c8467cb07fc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:49.633885 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460df88-4b8a-4782-b164-eb955572e14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:49.634716 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460df88-4b8a-4782-b164-eb955572e14c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:49.634996 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460df88-4b8a-4782-b164-eb955572e14c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:49.635272 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460df88-4b8a-4782-b164-eb955572e14c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:49.643795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460df88-4b8a-4782-b164-eb955572e14c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:49.645249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460df88-4b8a-4782-b164-eb955572e14c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:49.651491 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 319/641] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jun 16 16:03:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:49.652434 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a2a34-8ffe-4721-928d-2c8467cb07fc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:49.661792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-7460df88-4b8a-4782-b164-eb955572e14c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:49.661792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:49.661792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:49.661792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:49.661792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:49.661792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:49.661792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:49.661792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:49.661792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:49.661792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:49.661792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:49.661792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:49.661792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:49.661792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:49.661792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:49.663937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:49.666208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:49.666208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:49.666208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:49.666208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:49.666208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:49.666208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:49.666208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:49.666208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:49.666208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 323/642] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:49.666208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460df88-4b8a-4782-b164-eb955572e14c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:49.727417 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:49.777806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460df88-4b8a-4782-b164-eb955572e14c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:49.782640 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a2a34-8ffe-4721-928d-2c8467cb07fc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:49.820783 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928109f-206d-446e-a12d-830e630a4f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:49.821625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928109f-206d-446e-a12d-830e630a4f36 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:49.821911 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928109f-206d-446e-a12d-830e630a4f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:49.822188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928109f-206d-446e-a12d-830e630a4f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:49.837616 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b7e08-7d34-463d-9d3f-e9dd474d5315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:49.839047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b7e08-7d34-463d-9d3f-e9dd474d5315 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:49.840023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b7e08-7d34-463d-9d3f-e9dd474d5315 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:49.840510 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b7e08-7d34-463d-9d3f-e9dd474d5315 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:49.851038 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:49.857837 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b7e08-7d34-463d-9d3f-e9dd474d5315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-c39b7e08-7d34-463d-9d3f-e9dd474d5315 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:49.865672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:49.866649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:49.867572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:49.867572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:49.867572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:49.867572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:49.867572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:49.867572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:49.867572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:49.867572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:49.867572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:49.867572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:49.867572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:49.867572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:49.867572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 320/643] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:49.868398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b7e08-7d34-463d-9d3f-e9dd474d5315 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:49.904073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928109f-206d-446e-a12d-830e630a4f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:49.905704 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928109f-206d-446e-a12d-830e630a4f36 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:49.965695 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:49.976994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b7e08-7d34-463d-9d3f-e9dd474d5315 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:50.012970 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd2afc-3677-420c-8ce2-0deee04c6fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:50.014465 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd2afc-3677-420c-8ce2-0deee04c6fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:50.014770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd2afc-3677-420c-8ce2-0deee04c6fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:50.015143 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd2afc-3677-420c-8ce2-0deee04c6fd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:50.016019 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd2afc-3677-420c-8ce2-0deee04c6fd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:50.016332 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd2afc-3677-420c-8ce2-0deee04c6fd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:50.017785 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd2afc-3677-420c-8ce2-0deee04c6fd3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:50.019169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 324/644] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:50.020636 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a0480-9f6d-43cf-992c-7a35ebb8a667 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:50.020997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a0480-9f6d-43cf-992c-7a35ebb8a667 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:50.021347 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a0480-9f6d-43cf-992c-7a35ebb8a667 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:50.022991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 325/645] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:50.024156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a0480-9f6d-43cf-992c-7a35ebb8a667 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:50.037405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 321/646] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:50.038704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd2afc-3677-420c-8ce2-0deee04c6fd3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:50.107229 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:50.145374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a0480-9f6d-43cf-992c-7a35ebb8a667 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:50.154293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd2afc-3677-420c-8ce2-0deee04c6fd3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:50.182498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9cb77-f06d-4c00-ba91-64c4496d587b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:50.183175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9cb77-f06d-4c00-ba91-64c4496d587b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:50.183461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9cb77-f06d-4c00-ba91-64c4496d587b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:50.183747 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9cb77-f06d-4c00-ba91-64c4496d587b None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:50.184489 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9cb77-f06d-4c00-ba91-64c4496d587b None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:50.184800 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9cb77-f06d-4c00-ba91-64c4496d587b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:50.187374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9cb77-f06d-4c00-ba91-64c4496d587b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:50.193816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc7ceb-82b1-4f03-8f49-b0c99d1886c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:50.194657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc7ceb-82b1-4f03-8f49-b0c99d1886c6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:50.194946 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc7ceb-82b1-4f03-8f49-b0c99d1886c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:50.195228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc7ceb-82b1-4f03-8f49-b0c99d1886c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:50.200917 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 326/647] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:50.200917 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89a993-8432-4bc9-8e8b-009a5c40ba18 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:50.200917 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89a993-8432-4bc9-8e8b-009a5c40ba18 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:50.200917 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89a993-8432-4bc9-8e8b-009a5c40ba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:50.211694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc7ceb-82b1-4f03-8f49-b0c99d1886c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:50.213283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc7ceb-82b1-4f03-8f49-b0c99d1886c6 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:50.215992 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1b89a993-8432-4bc9-8e8b-009a5c40ba18 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:50.217817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1b89a993-8432-4bc9-8e8b-009a5c40ba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:50.229618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:50.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-8dbc7ceb-82b1-4f03-8f49-b0c99d1886c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:50.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:50.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:50.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:50.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:50.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:50.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:50.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:50.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:50.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:50.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:50.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:50.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:50.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:50.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:50.233780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:50.234723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:50.234723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:50.234723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:50.234723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:50.234723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 322/648] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:50.235435 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc7ceb-82b1-4f03-8f49-b0c99d1886c6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:50.302615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 327/649] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:50.302615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89a993-8432-4bc9-8e8b-009a5c40ba18 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:50.353506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc7ceb-82b1-4f03-8f49-b0c99d1886c6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:50.371678 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:50.400456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ded3df-8990-431d-8ec8-979be8101135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:50.401123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ded3df-8990-431d-8ec8-979be8101135 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:50.401412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ded3df-8990-431d-8ec8-979be8101135 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:50.401693 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ded3df-8990-431d-8ec8-979be8101135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:50.402566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ded3df-8990-431d-8ec8-979be8101135 None admin] RBAC: Adding query filter params (role.id=6da95c91bacf48f9870a114e2ab05472, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=795c029cb14b42b5b0f3987e218d4239) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:50.402880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ded3df-8990-431d-8ec8-979be8101135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:50.404614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ded3df-8990-431d-8ec8-979be8101135 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:50.411558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 323/650] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:50 2022] GET /identity/v3/role_assignments?user.id=795c029cb14b42b5b0f3987e218d4239&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=6da95c91bacf48f9870a114e2ab05472 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:50.422275 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89a993-8432-4bc9-8e8b-009a5c40ba18 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:50.423537 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ded3df-8990-431d-8ec8-979be8101135 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:50.471802 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a5abe-77c8-4494-97e4-204d5741a673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:50.472802 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a5abe-77c8-4494-97e4-204d5741a673 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:50.473178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a5abe-77c8-4494-97e4-204d5741a673 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:50.473548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a5abe-77c8-4494-97e4-204d5741a673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:50.486925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a5abe-77c8-4494-97e4-204d5741a673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:50.488789 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a5abe-77c8-4494-97e4-204d5741a673 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:50.497768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:50.512820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ba7a5abe-77c8-4494-97e4-204d5741a673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:50.512820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:50.512820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:50.512820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:50.512820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:50.512820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:50.512820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:50.512820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:50.512820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:50.512820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:50.512820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:50.512820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:50.512820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:50.512820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:50.512820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:50.514002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:50.515128 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:50.515128 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:50.515128 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:50.515128 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:50.521543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 328/651] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:50.522671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a5abe-77c8-4494-97e4-204d5741a673 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:50.562050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ded3df-8990-431d-8ec8-979be8101135 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:50.603283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f467f6-31e2-4517-b625-523fe1055446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:50.604652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f467f6-31e2-4517-b625-523fe1055446 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:50.604999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f467f6-31e2-4517-b625-523fe1055446 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:50.605405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f467f6-31e2-4517-b625-523fe1055446 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:50.606282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f467f6-31e2-4517-b625-523fe1055446 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:50.606701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f467f6-31e2-4517-b625-523fe1055446 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:50.609155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f467f6-31e2-4517-b625-523fe1055446 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:50.635748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 324/652] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:50.635748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f467f6-31e2-4517-b625-523fe1055446 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:50.661833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a5abe-77c8-4494-97e4-204d5741a673 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:50.695643 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:50.705052 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e9763-87fd-4a4e-8977-975860d8e583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:50.706270 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e9763-87fd-4a4e-8977-975860d8e583 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:50.707052 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e9763-87fd-4a4e-8977-975860d8e583 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:50.707333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e9763-87fd-4a4e-8977-975860d8e583 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:50.719213 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e9763-87fd-4a4e-8977-975860d8e583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-094e9763-87fd-4a4e-8977-975860d8e583 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:50.726962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:50.728502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:50.729590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:50.729590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:50.729590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:50.729590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:50.729590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:50.729590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:50.729590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:50.729590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:50.729590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:50.729590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:50.729590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:50.729590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:50.729590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 329/653] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:50.730518 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e9763-87fd-4a4e-8977-975860d8e583 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:50.777431 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f467f6-31e2-4517-b625-523fe1055446 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:50.812259 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:50.815741 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c3133-587d-42ed-a4aa-1867d490e19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:50.816606 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c3133-587d-42ed-a4aa-1867d490e19a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:50.816989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c3133-587d-42ed-a4aa-1867d490e19a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:50.817368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c3133-587d-42ed-a4aa-1867d490e19a None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:50.818193 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c3133-587d-42ed-a4aa-1867d490e19a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:50.818632 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c3133-587d-42ed-a4aa-1867d490e19a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:50.820118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c3133-587d-42ed-a4aa-1867d490e19a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:50.838027 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 325/654] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:50.839156 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c3133-587d-42ed-a4aa-1867d490e19a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:50.873470 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e9763-87fd-4a4e-8977-975860d8e583 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:50.923964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306367dd-4050-4d80-85b5-a262198c259e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:50.924606 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306367dd-4050-4d80-85b5-a262198c259e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:50.924963 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306367dd-4050-4d80-85b5-a262198c259e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:50.925345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306367dd-4050-4d80-85b5-a262198c259e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:50.933091 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306367dd-4050-4d80-85b5-a262198c259e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:50.934873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306367dd-4050-4d80-85b5-a262198c259e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:50.950929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-306367dd-4050-4d80-85b5-a262198c259e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:50.950929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:50.950929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:50.950929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:50.950929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:50.950929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:50.950929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:50.950929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:50.950929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:50.950929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:50.950929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:50.950929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:50.950929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:50.950929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:50.950929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:50.952523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:50.953672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:50.953672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:50.953672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:50.953672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:50.953672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:50.953672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:50.953672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:50.953672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:50.955524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 330/655] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:50.956535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306367dd-4050-4d80-85b5-a262198c259e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:50.959555 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:50.969308 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c3133-587d-42ed-a4aa-1867d490e19a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:51.010015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ae9c1-10ab-453f-9281-cd6f53c71374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:51.010998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ae9c1-10ab-453f-9281-cd6f53c71374 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:51.011539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ae9c1-10ab-453f-9281-cd6f53c71374 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:51.011973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ae9c1-10ab-453f-9281-cd6f53c71374 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:51.012991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ae9c1-10ab-453f-9281-cd6f53c71374 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:51.013467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ae9c1-10ab-453f-9281-cd6f53c71374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:51.015395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ae9c1-10ab-453f-9281-cd6f53c71374 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:51.025182 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 326/656] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:51.026208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ae9c1-10ab-453f-9281-cd6f53c71374 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:51.075956 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306367dd-4050-4d80-85b5-a262198c259e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:51.094859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:51.117612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c27963-b438-4637-96a7-c8cc478cd334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:51.118615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c27963-b438-4637-96a7-c8cc478cd334 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:51.119006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c27963-b438-4637-96a7-c8cc478cd334 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:51.119427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c27963-b438-4637-96a7-c8cc478cd334 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:51.132079 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c27963-b438-4637-96a7-c8cc478cd334 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:51.134982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c27963-b438-4637-96a7-c8cc478cd334 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a8c27963-b438-4637-96a7-c8cc478cd334 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:51.153658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:51.155144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:51.156194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:51.156194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:51.156194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:51.156194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:51.156194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:51.156194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:51.156194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:51.156194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:51.156194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 16:03:51.156194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:51.156787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ae9c1-10ab-453f-9281-cd6f53c71374 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:51.159175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 331/657] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:51.160293 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c27963-b438-4637-96a7-c8cc478cd334 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:51.207506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace7429-cf43-4256-9816-6a9904f90ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:51.208113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace7429-cf43-4256-9816-6a9904f90ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:51.208405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace7429-cf43-4256-9816-6a9904f90ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:51.208691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace7429-cf43-4256-9816-6a9904f90ec7 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:51.209488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace7429-cf43-4256-9816-6a9904f90ec7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:51.209805 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace7429-cf43-4256-9816-6a9904f90ec7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:51.211735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace7429-cf43-4256-9816-6a9904f90ec7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:51.228537 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 327/658] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:51.229655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace7429-cf43-4256-9816-6a9904f90ec7 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:51.254665 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:51.290785 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c27963-b438-4637-96a7-c8cc478cd334 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:51.330132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8aeae-6fd5-4630-9f0d-c2523bc513ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:51.330965 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8aeae-6fd5-4630-9f0d-c2523bc513ff None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:51.331233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8aeae-6fd5-4630-9f0d-c2523bc513ff None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:51.331514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8aeae-6fd5-4630-9f0d-c2523bc513ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:51.342614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8aeae-6fd5-4630-9f0d-c2523bc513ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:51.344083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8aeae-6fd5-4630-9f0d-c2523bc513ff None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:51.369457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-aee8aeae-6fd5-4630-9f0d-c2523bc513ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:51.369457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:51.369457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:51.369457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:51.369457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:51.369457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:51.369457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:51.369457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:51.369457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:51.369457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:51.369457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:51.369457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:51.369457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:51.369457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:51.369457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:51.370421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:51.371348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:51.371348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:51.371348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:51.371348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:51.376795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 332/659] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:51.377746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8aeae-6fd5-4630-9f0d-c2523bc513ff None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:51.378806 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace7429-cf43-4256-9816-6a9904f90ec7 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:51.423093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b3624-e594-4e50-8c64-9a7d5fbbc93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:51.423710 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b3624-e594-4e50-8c64-9a7d5fbbc93c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:51.423970 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b3624-e594-4e50-8c64-9a7d5fbbc93c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:51.424261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b3624-e594-4e50-8c64-9a7d5fbbc93c None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:51.425132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b3624-e594-4e50-8c64-9a7d5fbbc93c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:51.425450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b3624-e594-4e50-8c64-9a7d5fbbc93c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:51.426323 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:51.428066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b3624-e594-4e50-8c64-9a7d5fbbc93c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:51.454244 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 328/660] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jun 16 16:03:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:51.455343 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b3624-e594-4e50-8c64-9a7d5fbbc93c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:51.509494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8aeae-6fd5-4630-9f0d-c2523bc513ff None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:51.538499 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:51.548121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d38381-29ae-4cfe-9560-61dcf19feb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:51.548798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d38381-29ae-4cfe-9560-61dcf19feb74 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:51.549228 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d38381-29ae-4cfe-9560-61dcf19feb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:51.549517 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d38381-29ae-4cfe-9560-61dcf19feb74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:51.550804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d38381-29ae-4cfe-9560-61dcf19feb74 None admin] RBAC: Adding query filter params (role.id=6da95c91bacf48f9870a114e2ab05472, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=59174974208c469b8bb44d94d0e55427) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:51.551129 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d38381-29ae-4cfe-9560-61dcf19feb74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:51.552582 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d38381-29ae-4cfe-9560-61dcf19feb74 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:51.566479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 333/661] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:51 2022] GET /identity/v3/role_assignments?user.id=59174974208c469b8bb44d94d0e55427&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=6da95c91bacf48f9870a114e2ab05472 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:51.566479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d38381-29ae-4cfe-9560-61dcf19feb74 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:51.566775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b3624-e594-4e50-8c64-9a7d5fbbc93c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:51.606873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3694e5f-02c6-4057-b26e-b19833b6d825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:51.607706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3694e5f-02c6-4057-b26e-b19833b6d825 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:51.608456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3694e5f-02c6-4057-b26e-b19833b6d825 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:51.608456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3694e5f-02c6-4057-b26e-b19833b6d825 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:51.609024 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3694e5f-02c6-4057-b26e-b19833b6d825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:51.609337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3694e5f-02c6-4057-b26e-b19833b6d825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:51.610838 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3694e5f-02c6-4057-b26e-b19833b6d825 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:51.629333 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 329/662] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:51.630964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd916cc-0243-44e2-9035-784611edda1f None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:51.631266 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd916cc-0243-44e2-9035-784611edda1f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:51.631553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd916cc-0243-44e2-9035-784611edda1f None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:51.633380 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 330/663] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:51.634248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd916cc-0243-44e2-9035-784611edda1f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:51.680790 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:51.689868 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d38381-29ae-4cfe-9560-61dcf19feb74 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:51.729915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6033b-35fa-4f56-ad8a-4e497b45ec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:51.730636 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6033b-35fa-4f56-ad8a-4e497b45ec89 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:51.730979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6033b-35fa-4f56-ad8a-4e497b45ec89 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:51.731267 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6033b-35fa-4f56-ad8a-4e497b45ec89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:51.769134 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd916cc-0243-44e2-9035-784611edda1f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:51.822218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f853e6b-efce-48a7-ab2f-db15cd4427b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:51.822451 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6033b-35fa-4f56-ad8a-4e497b45ec89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:51.823397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f853e6b-efce-48a7-ab2f-db15cd4427b9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:51.823848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f853e6b-efce-48a7-ab2f-db15cd4427b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:51.824047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6033b-35fa-4f56-ad8a-4e497b45ec89 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:51.824457 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f853e6b-efce-48a7-ab2f-db15cd4427b9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:51.831132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:51.838683 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f853e6b-efce-48a7-ab2f-db15cd4427b9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:51.840663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f853e6b-efce-48a7-ab2f-db15cd4427b9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-1f853e6b-efce-48a7-ab2f-db15cd4427b9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:51.861170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:51.862349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:51.863880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:51.863880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:51.863880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:51.863880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:51.863880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:51.863880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:51.863880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:51.863880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:51.863880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 16:03:51.863880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:51.863880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 331/664] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:51.864631 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a267f9a-f714-47d2-80c3-c0a5f4d0dbe9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:51.864631 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a267f9a-f714-47d2-80c3-c0a5f4d0dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:51.864631 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a267f9a-f714-47d2-80c3-c0a5f4d0dbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:51.884625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6a267f9a-f714-47d2-80c3-c0a5f4d0dbe9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:51.886893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6a267f9a-f714-47d2-80c3-c0a5f4d0dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:51.949698 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:51.960396 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 334/665] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:51.961565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6033b-35fa-4f56-ad8a-4e497b45ec89 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:51.972242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 332/666] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:51.973224 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a267f9a-f714-47d2-80c3-c0a5f4d0dbe9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:52.076797 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6033b-35fa-4f56-ad8a-4e497b45ec89 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:52.080477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a267f9a-f714-47d2-80c3-c0a5f4d0dbe9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:52.104393 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:52.116159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612dbfc-11be-44bb-a2e3-e11e6a5e0972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:52.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612dbfc-11be-44bb-a2e3-e11e6a5e0972 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:52.117530 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612dbfc-11be-44bb-a2e3-e11e6a5e0972 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:52.117868 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612dbfc-11be-44bb-a2e3-e11e6a5e0972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:52.118459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8a64d-1053-44e7-bcf6-d6c437d12f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:52.119420 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8a64d-1053-44e7-bcf6-d6c437d12f27 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:52.119846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8a64d-1053-44e7-bcf6-d6c437d12f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:52.120286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8a64d-1053-44e7-bcf6-d6c437d12f27 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:52.121373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8a64d-1053-44e7-bcf6-d6c437d12f27 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:52.121870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8a64d-1053-44e7-bcf6-d6c437d12f27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:52.124187 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8a64d-1053-44e7-bcf6-d6c437d12f27 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:52.130125 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612dbfc-11be-44bb-a2e3-e11e6a5e0972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:52.131724 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612dbfc-11be-44bb-a2e3-e11e6a5e0972 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:52.144135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 335/667] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Jun 16 16:03:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:52.145373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8a64d-1053-44e7-bcf6-d6c437d12f27 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:52.150455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-2612dbfc-11be-44bb-a2e3-e11e6a5e0972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:52.150455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:52.150455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:52.150455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:52.150455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:52.150455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:52.150455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:52.150455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:52.150455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:52.150455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:52.150455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:52.150455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:52.150455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:52.150455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:52.150455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:52.151361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:52.152426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:52.152426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:52.152426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:52.152426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:52.152426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 333/668] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:52.153815 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612dbfc-11be-44bb-a2e3-e11e6a5e0972 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:52.206346 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:52.259625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8a64d-1053-44e7-bcf6-d6c437d12f27 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:52.262007 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612dbfc-11be-44bb-a2e3-e11e6a5e0972 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:52.298623 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272b91-7fba-457a-a4e8-d916758743f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:52.299923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272b91-7fba-457a-a4e8-d916758743f1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:52.300435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272b91-7fba-457a-a4e8-d916758743f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:52.300858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272b91-7fba-457a-a4e8-d916758743f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:52.300972 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe8f30-4b26-4802-8a05-9ce773532b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:52.301695 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe8f30-4b26-4802-8a05-9ce773532b2c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:52.302088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe8f30-4b26-4802-8a05-9ce773532b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:52.302505 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe8f30-4b26-4802-8a05-9ce773532b2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:52.313009 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3272b91-7fba-457a-a4e8-d916758743f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-a3272b91-7fba-457a-a4e8-d916758743f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:52.321804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:52.322841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:52.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:52.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:52.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:52.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:52.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:52.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:52.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:52.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:52.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:52.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:52.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:52.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:52.327361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 336/669] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:52.328524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272b91-7fba-457a-a4e8-d916758743f1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:52.357105 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:52.383459 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe8f30-4b26-4802-8a05-9ce773532b2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:52.385116 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe8f30-4b26-4802-8a05-9ce773532b2c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:52.448124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272b91-7fba-457a-a4e8-d916758743f1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:52.462655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:52.487870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fccc6-7b18-4832-8dfd-7223e0128837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:52.488849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fccc6-7b18-4832-8dfd-7223e0128837 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:52.489357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fccc6-7b18-4832-8dfd-7223e0128837 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:52.489856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fccc6-7b18-4832-8dfd-7223e0128837 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:52.491016 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fccc6-7b18-4832-8dfd-7223e0128837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:52.491523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fccc6-7b18-4832-8dfd-7223e0128837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:52.493237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fccc6-7b18-4832-8dfd-7223e0128837 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:52.497627 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 334/670] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:52.498673 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe8f30-4b26-4802-8a05-9ce773532b2c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:52.508140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 337/671] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:52.509429 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fccc6-7b18-4832-8dfd-7223e0128837 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:52.580735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:52.605654 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe8f30-4b26-4802-8a05-9ce773532b2c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:52.621735 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fccc6-7b18-4832-8dfd-7223e0128837 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:52.642423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735417a-9515-4dd4-8eef-a3fa0ee96303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:52.643122 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735417a-9515-4dd4-8eef-a3fa0ee96303 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:52.643406 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735417a-9515-4dd4-8eef-a3fa0ee96303 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:52.643682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735417a-9515-4dd4-8eef-a3fa0ee96303 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:52.644432 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735417a-9515-4dd4-8eef-a3fa0ee96303 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:52.644736 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735417a-9515-4dd4-8eef-a3fa0ee96303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:52.646464 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735417a-9515-4dd4-8eef-a3fa0ee96303 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:52.656060 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 335/672] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:52.656878 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735417a-9515-4dd4-8eef-a3fa0ee96303 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:52.662924 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fd152-4011-4296-99c0-3008d567c7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:52.664008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fd152-4011-4296-99c0-3008d567c7be None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:52.664500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fd152-4011-4296-99c0-3008d567c7be None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:52.664991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fd152-4011-4296-99c0-3008d567c7be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:52.677976 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fd152-4011-4296-99c0-3008d567c7be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:52.679894 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fd152-4011-4296-99c0-3008d567c7be None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:52.700313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-076fd152-4011-4296-99c0-3008d567c7be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:52.700313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:52.700313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:52.700313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:52.700313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:52.700313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:52.700313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:52.700313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:52.700313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:52.700313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:52.700313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:52.700313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:52.700313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:52.700313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:52.700313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:52.701999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:52.703135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:52.703135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:52.703135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:52.703135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:52.705545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 338/673] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:52.706740 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fd152-4011-4296-99c0-3008d567c7be None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:52.735518 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:52.768993 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735417a-9515-4dd4-8eef-a3fa0ee96303 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:52.809690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3403a-a0ca-4efc-aa75-2ed2c82cb84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:52.810195 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3403a-a0ca-4efc-aa75-2ed2c82cb84d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:52.810677 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3403a-a0ca-4efc-aa75-2ed2c82cb84d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:52.811119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3403a-a0ca-4efc-aa75-2ed2c82cb84d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:52.819625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3403a-a0ca-4efc-aa75-2ed2c82cb84d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:52.821469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3403a-a0ca-4efc-aa75-2ed2c82cb84d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:52.823883 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:52.828886 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fd152-4011-4296-99c0-3008d567c7be None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:52.839399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-44c3403a-a0ca-4efc-aa75-2ed2c82cb84d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:52.839399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:52.839399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:52.839399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:52.839399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:52.839399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:52.839399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:52.839399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:52.839399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:52.839399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:52.839399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:52.839399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:52.839399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:52.839399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:52.839399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:52.840338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:52.842857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:52.842857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:52.842857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:52.842857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:52.842857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:52.842857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:52.842857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:52.842857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:52.842857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 336/674] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:52.842857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3403a-a0ca-4efc-aa75-2ed2c82cb84d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:52.876914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10e136-620f-4adf-9a42-3f5b88f2b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:52.877836 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10e136-620f-4adf-9a42-3f5b88f2b6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:52.878189 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10e136-620f-4adf-9a42-3f5b88f2b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:52.878694 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10e136-620f-4adf-9a42-3f5b88f2b6e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:52.889852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10e136-620f-4adf-9a42-3f5b88f2b6e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:52.891567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10e136-620f-4adf-9a42-3f5b88f2b6e2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:52.910104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5d10e136-620f-4adf-9a42-3f5b88f2b6e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:52.910104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:52.910104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:52.910104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:52.910104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:52.910104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:52.910104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:52.910104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:52.910104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:52.910104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:52.910104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:52.910104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:52.910104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:52.910104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:52.910104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:52.911317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:52.912436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:52.912436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:52.912436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:52.912436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:52.915897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 339/675] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:52.916665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10e136-620f-4adf-9a42-3f5b88f2b6e2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:52.958829 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3403a-a0ca-4efc-aa75-2ed2c82cb84d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:53.000706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c129b-e990-4ec0-ac76-b8a1e522848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:53.001283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:53.001736 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c129b-e990-4ec0-ac76-b8a1e522848f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:53.002328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c129b-e990-4ec0-ac76-b8a1e522848f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:53.002328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c129b-e990-4ec0-ac76-b8a1e522848f None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:53.003371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c129b-e990-4ec0-ac76-b8a1e522848f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:53.003686 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c129b-e990-4ec0-ac76-b8a1e522848f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:53.005398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c129b-e990-4ec0-ac76-b8a1e522848f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:53.025120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 337/676] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:53.025120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc62d53-1ba0-4145-87f5-d2cb65f1e138 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:53.025120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc62d53-1ba0-4145-87f5-d2cb65f1e138 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:53.025120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc62d53-1ba0-4145-87f5-d2cb65f1e138 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:53.025120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 338/677] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:53.025120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc62d53-1ba0-4145-87f5-d2cb65f1e138 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:53.035937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10e136-620f-4adf-9a42-3f5b88f2b6e2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:53.077516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a61ed-0447-4733-adec-bea76c1876b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:53.078196 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a61ed-0447-4733-adec-bea76c1876b5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:53.078511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a61ed-0447-4733-adec-bea76c1876b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:53.078795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a61ed-0447-4733-adec-bea76c1876b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:53.079589 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a61ed-0447-4733-adec-bea76c1876b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:53.079902 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a61ed-0447-4733-adec-bea76c1876b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:53.081342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a61ed-0447-4733-adec-bea76c1876b5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:53.094120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 340/678] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:53.094899 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a61ed-0447-4733-adec-bea76c1876b5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:53.102235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:53.149925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc62d53-1ba0-4145-87f5-d2cb65f1e138 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:53.186825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f64e2-7c0e-423d-9e93-d1d9b6252a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:53.187500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f64e2-7c0e-423d-9e93-d1d9b6252a9e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:53.187797 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f64e2-7c0e-423d-9e93-d1d9b6252a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:53.188080 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f64e2-7c0e-423d-9e93-d1d9b6252a9e None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:53.188809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f64e2-7c0e-423d-9e93-d1d9b6252a9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:53.189125 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f64e2-7c0e-423d-9e93-d1d9b6252a9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:53.190531 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f64e2-7c0e-423d-9e93-d1d9b6252a9e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:53.204620 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 339/679] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:53.205836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af6c1e-3645-470b-8d0e-51470c5a164a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:53.206129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af6c1e-3645-470b-8d0e-51470c5a164a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:53.206416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af6c1e-3645-470b-8d0e-51470c5a164a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:53.212762 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a61ed-0447-4733-adec-bea76c1876b5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:53.222229 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-33af6c1e-3645-470b-8d0e-51470c5a164a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:53.223452 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-33af6c1e-3645-470b-8d0e-51470c5a164a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:53.249801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ec64f-06d0-4613-87ae-5b2d4d479bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:53.251132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ec64f-06d0-4613-87ae-5b2d4d479bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:53.251423 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ec64f-06d0-4613-87ae-5b2d4d479bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:53.251984 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ec64f-06d0-4613-87ae-5b2d4d479bd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:53.255401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:53.260948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ec64f-06d0-4613-87ae-5b2d4d479bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:53.264797 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ec64f-06d0-4613-87ae-5b2d4d479bd4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:53.283063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-798ec64f-06d0-4613-87ae-5b2d4d479bd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:53.283063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:53.283063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:53.283063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:53.283063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:53.283063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:53.283063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:53.283063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:53.283063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:53.283063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:53.283063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:53.283063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:53.283063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:53.283063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:53.283063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:53.283993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:53.284900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:53.284900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:53.284900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:53.284900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:53.284900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:53.284900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:53.284900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:53.284900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:53.286003 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 341/680] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:53.286969 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ec64f-06d0-4613-87ae-5b2d4d479bd4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:53.300556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 340/681] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:53.301660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af6c1e-3645-470b-8d0e-51470c5a164a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:53.372866 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:53.415318 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ec64f-06d0-4613-87ae-5b2d4d479bd4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:53.434760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af6c1e-3645-470b-8d0e-51470c5a164a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:53.454257 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab3c3d-2193-46f8-a028-af85ffbe66b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:53.455238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab3c3d-2193-46f8-a028-af85ffbe66b4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:53.455529 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab3c3d-2193-46f8-a028-af85ffbe66b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:53.455810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab3c3d-2193-46f8-a028-af85ffbe66b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:53.456646 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab3c3d-2193-46f8-a028-af85ffbe66b4 None admin] RBAC: Adding query filter params (role.id=6da95c91bacf48f9870a114e2ab05472, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=65e8905bab4c47f9a5fb374ef0377983) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:53.456962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab3c3d-2193-46f8-a028-af85ffbe66b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:53.459026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab3c3d-2193-46f8-a028-af85ffbe66b4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:53.474467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 342/682] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:53 2022] GET /identity/v3/role_assignments?user.id=65e8905bab4c47f9a5fb374ef0377983&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=6da95c91bacf48f9870a114e2ab05472 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:53.474467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab3c3d-2193-46f8-a028-af85ffbe66b4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:53.482096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030ad83-0163-40a0-af34-c35b04f9e6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:53.483635 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030ad83-0163-40a0-af34-c35b04f9e6ba None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:53.483925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030ad83-0163-40a0-af34-c35b04f9e6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:53.484207 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030ad83-0163-40a0-af34-c35b04f9e6ba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:53.494072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030ad83-0163-40a0-af34-c35b04f9e6ba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:53.495626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030ad83-0163-40a0-af34-c35b04f9e6ba None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-a030ad83-0163-40a0-af34-c35b04f9e6ba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:53.512974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:53.514339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:53.515387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:53.515387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:53.515387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:53.515387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:53.515387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:53.515387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:53.515387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:53.515387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:53.515387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 16:03:53.515387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:53.515387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 341/683] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:03:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:53.515989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030ad83-0163-40a0-af34-c35b04f9e6ba None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:53.557696 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:53.621037 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab3c3d-2193-46f8-a028-af85ffbe66b4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:53.651514 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030ad83-0163-40a0-af34-c35b04f9e6ba None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:53.663545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:53.671925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ec3d2-3a74-4669-aa33-6eab451169f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:53.672840 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ec3d2-3a74-4669-aa33-6eab451169f2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:53.673159 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ec3d2-3a74-4669-aa33-6eab451169f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:53.673442 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ec3d2-3a74-4669-aa33-6eab451169f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:53.674238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ec3d2-3a74-4669-aa33-6eab451169f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:53.674592 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ec3d2-3a74-4669-aa33-6eab451169f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:53.676010 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ec3d2-3a74-4669-aa33-6eab451169f2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:53.690557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 343/684] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:53.691511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ec3d2-3a74-4669-aa33-6eab451169f2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:53.699079 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d770b7-d622-4dd5-be9f-2ff960856cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:53.699899 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d770b7-d622-4dd5-be9f-2ff960856cdc None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:53.700204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d770b7-d622-4dd5-be9f-2ff960856cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:53.700473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d770b7-d622-4dd5-be9f-2ff960856cdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:53.713548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d770b7-d622-4dd5-be9f-2ff960856cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-54d770b7-d622-4dd5-be9f-2ff960856cdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:53.723078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:53.724063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:53.724900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:53.724900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:53.724900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:53.724900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:53.724900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:53.724900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:53.724900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:53.724900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:53.724900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:53.724900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:53.724900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:03:53.724900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:53.724900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 342/685] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:03:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:53.725605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d770b7-d622-4dd5-be9f-2ff960856cdc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:53.820028 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ec3d2-3a74-4669-aa33-6eab451169f2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:53.847925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:53.865841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fad51-2e1a-43f5-979d-aa6d91400786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:53.866945 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fad51-2e1a-43f5-979d-aa6d91400786 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:53.867432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fad51-2e1a-43f5-979d-aa6d91400786 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:53.867881 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fad51-2e1a-43f5-979d-aa6d91400786 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:53.868902 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fad51-2e1a-43f5-979d-aa6d91400786 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:53.869390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fad51-2e1a-43f5-979d-aa6d91400786 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:53.871124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fad51-2e1a-43f5-979d-aa6d91400786 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:53.883777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d770b7-d622-4dd5-be9f-2ff960856cdc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:53.892916 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 344/686] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jun 16 16:03:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:53.893846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fad51-2e1a-43f5-979d-aa6d91400786 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:53.929117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d622fb-1165-46aa-9c17-ba350d36ba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:53.929923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d622fb-1165-46aa-9c17-ba350d36ba83 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:53.930283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d622fb-1165-46aa-9c17-ba350d36ba83 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:53.930672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d622fb-1165-46aa-9c17-ba350d36ba83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:53.931578 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d622fb-1165-46aa-9c17-ba350d36ba83 None admin] RBAC: Adding query filter params (role.id=6da95c91bacf48f9870a114e2ab05472, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=087adcbf737843db97dabfa9708484c0) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:53.932001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d622fb-1165-46aa-9c17-ba350d36ba83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:53.933460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d622fb-1165-46aa-9c17-ba350d36ba83 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:53.946471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 343/687] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:53 2022] GET /identity/v3/role_assignments?user.id=087adcbf737843db97dabfa9708484c0&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=6da95c91bacf48f9870a114e2ab05472 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:53.946471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d622fb-1165-46aa-9c17-ba350d36ba83 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:53.984562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:54.039064 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fad51-2e1a-43f5-979d-aa6d91400786 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:54.084839 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d622fb-1165-46aa-9c17-ba350d36ba83 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:54.087136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f01247-931f-4109-98c6-06202cfb77c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:54.087824 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f01247-931f-4109-98c6-06202cfb77c8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:54.088103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f01247-931f-4109-98c6-06202cfb77c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:54.088378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f01247-931f-4109-98c6-06202cfb77c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:54.089132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f01247-931f-4109-98c6-06202cfb77c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:54.089437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f01247-931f-4109-98c6-06202cfb77c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:54.090865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f01247-931f-4109-98c6-06202cfb77c8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:54.101341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 345/688] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:54.102859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee368b-1a20-47e4-9f87-2c6ec99fe6c7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:54.103150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee368b-1a20-47e4-9f87-2c6ec99fe6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:54.103429 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee368b-1a20-47e4-9f87-2c6ec99fe6c7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:54.104993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 346/689] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:54.106299 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee368b-1a20-47e4-9f87-2c6ec99fe6c7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:54.141462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390da625-01e7-409e-8669-2e90d4c69fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:54.142643 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390da625-01e7-409e-8669-2e90d4c69fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:54.143014 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390da625-01e7-409e-8669-2e90d4c69fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:54.143367 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390da625-01e7-409e-8669-2e90d4c69fb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:54.163262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:54.229072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390da625-01e7-409e-8669-2e90d4c69fb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:54.230927 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390da625-01e7-409e-8669-2e90d4c69fb6 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:54.238855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee368b-1a20-47e4-9f87-2c6ec99fe6c7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:54.276427 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:54.279332 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45de945-c7bf-4bd9-b790-d2a865a555c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:54.280302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de945-c7bf-4bd9-b790-d2a865a555c0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:54.280730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de945-c7bf-4bd9-b790-d2a865a555c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:54.281146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de945-c7bf-4bd9-b790-d2a865a555c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:54.292623 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45de945-c7bf-4bd9-b790-d2a865a555c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:54.294335 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45de945-c7bf-4bd9-b790-d2a865a555c0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:54.315686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e45de945-c7bf-4bd9-b790-d2a865a555c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:54.315686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:54.315686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:54.315686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:54.315686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:54.315686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:54.315686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:54.315686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:54.315686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:54.315686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:54.315686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:54.315686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:54.315686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:54.315686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:54.315686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:54.316657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:54.317539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:54.317539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:54.317539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:54.317539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:54.319807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 347/690] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:54.321610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e0de8-8946-4b19-a34e-ad4b4c26e1dc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:54.322087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e0de8-8946-4b19-a34e-ad4b4c26e1dc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:54.322557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e0de8-8946-4b19-a34e-ad4b4c26e1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:54.340066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-080e0de8-8946-4b19-a34e-ad4b4c26e1dc None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:54.341706 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-080e0de8-8946-4b19-a34e-ad4b4c26e1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:54.356026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 344/691] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:54.356948 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390da625-01e7-409e-8669-2e90d4c69fb6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:54.417860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 348/692] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:54.419397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e0de8-8946-4b19-a34e-ad4b4c26e1dc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:54.450443 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:54.494522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390da625-01e7-409e-8669-2e90d4c69fb6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:54.533412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e0de8-8946-4b19-a34e-ad4b4c26e1dc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:54.536684 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:54.545481 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2768c9-c0e2-47eb-8326-71819546d18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:54.546512 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2768c9-c0e2-47eb-8326-71819546d18e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:54.546805 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2768c9-c0e2-47eb-8326-71819546d18e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:54.547088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2768c9-c0e2-47eb-8326-71819546d18e None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:54.548079 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2768c9-c0e2-47eb-8326-71819546d18e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:54.548388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2768c9-c0e2-47eb-8326-71819546d18e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:54.550539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2768c9-c0e2-47eb-8326-71819546d18e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:54.564946 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 345/693] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:54.565795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2768c9-c0e2-47eb-8326-71819546d18e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:54.572978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac9d32-db6b-455e-82c2-3b04069f6c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:54.573785 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac9d32-db6b-455e-82c2-3b04069f6c3f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:54.574071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac9d32-db6b-455e-82c2-3b04069f6c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:54.574348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac9d32-db6b-455e-82c2-3b04069f6c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:54.588699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac9d32-db6b-455e-82c2-3b04069f6c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:54.590993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac9d32-db6b-455e-82c2-3b04069f6c3f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:54.618042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-16ac9d32-db6b-455e-82c2-3b04069f6c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:54.618042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:54.618042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:54.618042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:54.618042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:54.618042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:54.618042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:54.618042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:54.618042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:54.618042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:54.618042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:54.618042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:54.618042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:54.618042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:54.618042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:54.619139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:54.620291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:54.620291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:54.620291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:54.620291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:54.620291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 349/694] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:54.623476 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac9d32-db6b-455e-82c2-3b04069f6c3f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:54.682107 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2768c9-c0e2-47eb-8326-71819546d18e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:54.721941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f23f45-de74-479e-8ba9-fe458b4cc3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:54.722943 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f23f45-de74-479e-8ba9-fe458b4cc3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:54.723387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f23f45-de74-479e-8ba9-fe458b4cc3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:54.723690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f23f45-de74-479e-8ba9-fe458b4cc3e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:54.730056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:54.738619 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f23f45-de74-479e-8ba9-fe458b4cc3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:54.740205 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f23f45-de74-479e-8ba9-fe458b4cc3e7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:54.757851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-80f23f45-de74-479e-8ba9-fe458b4cc3e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:54.757851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:54.757851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:54.757851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:54.757851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:54.757851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:54.757851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:54.757851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:54.757851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:54.757851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:54.757851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:54.757851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:54.757851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:54.757851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:54.757851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:54.758985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:54.760098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:54.760098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:54.760098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:54.760098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:54.766285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 346/695] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:54.766285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f23f45-de74-479e-8ba9-fe458b4cc3e7 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:54.771619 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac9d32-db6b-455e-82c2-3b04069f6c3f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:54.810637 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a82ecb-8890-423b-95b5-d39114901d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:54.811845 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a82ecb-8890-423b-95b5-d39114901d30 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:54.812127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a82ecb-8890-423b-95b5-d39114901d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:54.812404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a82ecb-8890-423b-95b5-d39114901d30 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:54.821591 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a82ecb-8890-423b-95b5-d39114901d30 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:54.823153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a82ecb-8890-423b-95b5-d39114901d30 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:54.829855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d0a82ecb-8890-423b-95b5-d39114901d30 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:54.842317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:54.843397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:54.844359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:54.844359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:54.844359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:54.844359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:54.844359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:54.844359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:54.844359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:54.844359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:54.844359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:03:54.844359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:54.844359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 350/696] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 16 16:03:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:54.844957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a82ecb-8890-423b-95b5-d39114901d30 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:54.897307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f23f45-de74-479e-8ba9-fe458b4cc3e7 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:54.950635 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed0936-907b-464a-b189-1f27174b7341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:54.952204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed0936-907b-464a-b189-1f27174b7341 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:54.952705 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed0936-907b-464a-b189-1f27174b7341 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:54.953214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed0936-907b-464a-b189-1f27174b7341 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:54.954672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed0936-907b-464a-b189-1f27174b7341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:54.955189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed0936-907b-464a-b189-1f27174b7341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:54.957664 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed0936-907b-464a-b189-1f27174b7341 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:54.975748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 347/697] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:54.977096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed0936-907b-464a-b189-1f27174b7341 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:54.981389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a82ecb-8890-423b-95b5-d39114901d30 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:55.018146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f6c8b-d256-4486-b0f6-61611b7e91da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:55.018811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f6c8b-d256-4486-b0f6-61611b7e91da None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:55.019092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f6c8b-d256-4486-b0f6-61611b7e91da None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:55.019366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f6c8b-d256-4486-b0f6-61611b7e91da None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:55.020123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f6c8b-d256-4486-b0f6-61611b7e91da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:55.020384 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f6c8b-d256-4486-b0f6-61611b7e91da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:55.021738 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f6c8b-d256-4486-b0f6-61611b7e91da None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:55.023341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:55.042265 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 351/698] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:55.043211 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f6c8b-d256-4486-b0f6-61611b7e91da None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:55.115218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed0936-907b-464a-b189-1f27174b7341 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:55.118051 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:55.149900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f6c8b-d256-4486-b0f6-61611b7e91da None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:55.162462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa2d51-18d8-4a3f-b6b8-5304b5fcc6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:55.162462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa2d51-18d8-4a3f-b6b8-5304b5fcc6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:55.162462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa2d51-18d8-4a3f-b6b8-5304b5fcc6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:55.162462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa2d51-18d8-4a3f-b6b8-5304b5fcc6b1 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:55.162902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa2d51-18d8-4a3f-b6b8-5304b5fcc6b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:55.162902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa2d51-18d8-4a3f-b6b8-5304b5fcc6b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:55.164846 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa2d51-18d8-4a3f-b6b8-5304b5fcc6b1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:55.189254 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352facd-ecfe-4bdb-902f-8d568b469843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:55.190087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352facd-ecfe-4bdb-902f-8d568b469843 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:55.190367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352facd-ecfe-4bdb-902f-8d568b469843 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:55.190691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352facd-ecfe-4bdb-902f-8d568b469843 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:55.199894 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 348/699] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 16 16:03:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:55.199894 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa2d51-18d8-4a3f-b6b8-5304b5fcc6b1 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:55.202084 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352facd-ecfe-4bdb-902f-8d568b469843 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:55.203629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352facd-ecfe-4bdb-902f-8d568b469843 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:55.224070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4352facd-ecfe-4bdb-902f-8d568b469843 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:55.224070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:55.224070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:55.224070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:55.224070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:55.224070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:55.224070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:55.224070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:55.224070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:55.224070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:55.224070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:55.224070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:55.224070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:55.224070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:55.224070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:55.225024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:55.225933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:55.225933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:55.225933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:55.225933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:55.225933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:55.225933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:55.225933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:55.225933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:55.230076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 352/700] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:55.231083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352facd-ecfe-4bdb-902f-8d568b469843 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:55.293104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:55.343413 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa2d51-18d8-4a3f-b6b8-5304b5fcc6b1 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:55.348154 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352facd-ecfe-4bdb-902f-8d568b469843 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:55.385845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de2385-a794-4c29-9229-b90a45c523b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:55.386977 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de2385-a794-4c29-9229-b90a45c523b2 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:55.387460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de2385-a794-4c29-9229-b90a45c523b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:55.387933 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de2385-a794-4c29-9229-b90a45c523b2 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:55.388985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de2385-a794-4c29-9229-b90a45c523b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:55.390757 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de2385-a794-4c29-9229-b90a45c523b2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:55.397949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746184f-5c18-4c4a-8e9c-e367919666c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:55.398644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746184f-5c18-4c4a-8e9c-e367919666c6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:55.399020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746184f-5c18-4c4a-8e9c-e367919666c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:55.399201 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746184f-5c18-4c4a-8e9c-e367919666c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:55.415273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 349/701] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:03:55 2022] POST /identity/v3/users => generated 254 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:03:55.416747 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de2385-a794-4c29-9229-b90a45c523b2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:55.440574 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:55.488837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746184f-5c18-4c4a-8e9c-e367919666c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:55.490292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746184f-5c18-4c4a-8e9c-e367919666c6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:55.567069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:55.605110 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 353/702] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:03:55.611697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746184f-5c18-4c4a-8e9c-e367919666c6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:55.666408 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de2385-a794-4c29-9229-b90a45c523b2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:55.710942 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e157cdd-831a-4fda-8ed7-30d1c99cd401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:55.711664 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e157cdd-831a-4fda-8ed7-30d1c99cd401 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:55.711894 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e157cdd-831a-4fda-8ed7-30d1c99cd401 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:55.712168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e157cdd-831a-4fda-8ed7-30d1c99cd401 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:55.712988 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e157cdd-831a-4fda-8ed7-30d1c99cd401 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:55.713514 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e157cdd-831a-4fda-8ed7-30d1c99cd401 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:55.715595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e157cdd-831a-4fda-8ed7-30d1c99cd401 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:55.733061 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 350/703] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:55.739052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e157cdd-831a-4fda-8ed7-30d1c99cd401 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:55.765936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746184f-5c18-4c4a-8e9c-e367919666c6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:55.817797 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbec164-0ef5-4af9-9139-3ab76bdbc0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:55.818121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbec164-0ef5-4af9-9139-3ab76bdbc0ba None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:55.822450 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbec164-0ef5-4af9-9139-3ab76bdbc0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:55.822450 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbec164-0ef5-4af9-9139-3ab76bdbc0ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:55.835481 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbec164-0ef5-4af9-9139-3ab76bdbc0ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:55.837183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbec164-0ef5-4af9-9139-3ab76bdbc0ba None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:55.859002 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:55.864104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ebbec164-0ef5-4af9-9139-3ab76bdbc0ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:55.864104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:55.864104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:55.864104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:55.864104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:55.864104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:55.864104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:55.864104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:55.864104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:55.864104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:55.864104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:55.864104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:55.864104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:55.864104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:55.864104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:55.864989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:55.865896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:55.865896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:55.865896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:55.865896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:55.866589 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 354/704] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:55.868112 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad160934-7df0-462c-b1bf-d8e6908d2874 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:55.868801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad160934-7df0-462c-b1bf-d8e6908d2874 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:55.869180 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad160934-7df0-462c-b1bf-d8e6908d2874 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:55.870766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 355/705] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:55.872867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad160934-7df0-462c-b1bf-d8e6908d2874 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:55.884903 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:55.890358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e157cdd-831a-4fda-8ed7-30d1c99cd401 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:55.931277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8121cdf-b604-4c20-a140-169fbf602d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:55.932072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8121cdf-b604-4c20-a140-169fbf602d19 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:55.932357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8121cdf-b604-4c20-a140-169fbf602d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:55.932638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8121cdf-b604-4c20-a140-169fbf602d19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:55.933482 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8121cdf-b604-4c20-a140-169fbf602d19 None admin] RBAC: Adding query filter params (role.id=6da95c91bacf48f9870a114e2ab05472, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=a8527cbb8efe43d7bb297d779929a50e) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:55.933800 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8121cdf-b604-4c20-a140-169fbf602d19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:55.936145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8121cdf-b604-4c20-a140-169fbf602d19 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:55.943482 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 351/706] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:55 2022] GET /identity/v3/role_assignments?user.id=a8527cbb8efe43d7bb297d779929a50e&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=6da95c91bacf48f9870a114e2ab05472 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:55.944949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190ee4f-bb3a-45c7-97a5-bb672c69a779 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:55.945241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190ee4f-bb3a-45c7-97a5-bb672c69a779 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:55.945523 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190ee4f-bb3a-45c7-97a5-bb672c69a779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:55.964971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9190ee4f-bb3a-45c7-97a5-bb672c69a779 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:55.966337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9190ee4f-bb3a-45c7-97a5-bb672c69a779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:55.993847 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad160934-7df0-462c-b1bf-d8e6908d2874 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:56.084608 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b085e9-44fa-4a69-a0e1-684ca9ef3773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:56.085309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b085e9-44fa-4a69-a0e1-684ca9ef3773 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:56.085593 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b085e9-44fa-4a69-a0e1-684ca9ef3773 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:56.085869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b085e9-44fa-4a69-a0e1-684ca9ef3773 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:56.086647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b085e9-44fa-4a69-a0e1-684ca9ef3773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:56.086960 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b085e9-44fa-4a69-a0e1-684ca9ef3773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:56.088383 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b085e9-44fa-4a69-a0e1-684ca9ef3773 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:56.093312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 352/707] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:56.114624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 356/708] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:56.115970 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190ee4f-bb3a-45c7-97a5-bb672c69a779 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:56.127126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b085e9-44fa-4a69-a0e1-684ca9ef3773 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:56.221347 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:56.234607 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:56.253349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190ee4f-bb3a-45c7-97a5-bb672c69a779 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:56.278808 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b085e9-44fa-4a69-a0e1-684ca9ef3773 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:56.298916 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ab743-d62a-4234-ac9b-3fe999d38992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:56.299749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ab743-d62a-4234-ac9b-3fe999d38992 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:56.300034 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ab743-d62a-4234-ac9b-3fe999d38992 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:56.300310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ab743-d62a-4234-ac9b-3fe999d38992 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:56.301100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ab743-d62a-4234-ac9b-3fe999d38992 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:56.303468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ab743-d62a-4234-ac9b-3fe999d38992 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:56.318734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713fcbe-c820-4a31-bbb3-cb61988cd74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:56.319911 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713fcbe-c820-4a31-bbb3-cb61988cd74d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:56.320400 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713fcbe-c820-4a31-bbb3-cb61988cd74d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:56.321162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713fcbe-c820-4a31-bbb3-cb61988cd74d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-147ab743-d62a-4234-ac9b-3fe999d38992 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:56.322337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:56.323339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:56.324212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:56.324212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:56.324212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:56.324212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:56.324212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:56.324212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:56.324212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:56.324212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:56.324212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:56.324212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:56.324212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:56.324212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:03:56.324212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:03:56.324212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 16:03:56.324212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:56.329690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 353/709] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jun 16 16:03:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:56.331050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ab743-d62a-4234-ac9b-3fe999d38992 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:56.333507 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713fcbe-c820-4a31-bbb3-cb61988cd74d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:56.335499 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713fcbe-c820-4a31-bbb3-cb61988cd74d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:56.353283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0713fcbe-c820-4a31-bbb3-cb61988cd74d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:56.353283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:56.353283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:56.353283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:56.353283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:56.353283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:56.353283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:56.353283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:56.353283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:56.353283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:56.353283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:56.353283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:56.353283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:03:56.353283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:03:56.353283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:56.354305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:56.355273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:03:56.355273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:03:56.355273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:03:56.355273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:03:56.355273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:03:56.355273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:03:56.355273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:03:56.355273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:56.358296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 357/710] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:56.363832 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713fcbe-c820-4a31-bbb3-cb61988cd74d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:56.462509 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ab743-d62a-4234-ac9b-3fe999d38992 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:56.493451 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713fcbe-c820-4a31-bbb3-cb61988cd74d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:56.506350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a0491-046c-4a32-8262-4ce6f0cc1343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:56.507024 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a0491-046c-4a32-8262-4ce6f0cc1343 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:56.507315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a0491-046c-4a32-8262-4ce6f0cc1343 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:56.507598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a0491-046c-4a32-8262-4ce6f0cc1343 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:56.508321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a0491-046c-4a32-8262-4ce6f0cc1343 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:56.508632 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a0491-046c-4a32-8262-4ce6f0cc1343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:56.510162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a0491-046c-4a32-8262-4ce6f0cc1343 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:56.513209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:56.523066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 354/711] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jun 16 16:03:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:56.524627 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd14a7-b9dd-42b3-8f67-1b1da308a45b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:56.524931 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd14a7-b9dd-42b3-8f67-1b1da308a45b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:56.525220 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd14a7-b9dd-42b3-8f67-1b1da308a45b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:56.526867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 355/712] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:56.527594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd14a7-b9dd-42b3-8f67-1b1da308a45b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:56.550392 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:56.569202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d9175-1a5e-4ef3-ae7a-3725afc92ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:56.570663 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d9175-1a5e-4ef3-ae7a-3725afc92ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:56.571400 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d9175-1a5e-4ef3-ae7a-3725afc92ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:56.571861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d9175-1a5e-4ef3-ae7a-3725afc92ed4 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:56.573320 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d9175-1a5e-4ef3-ae7a-3725afc92ed4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:56.573928 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d9175-1a5e-4ef3-ae7a-3725afc92ed4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:56.578285 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d9175-1a5e-4ef3-ae7a-3725afc92ed4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:56.597257 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 358/713] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:03:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:56.599189 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46266b4e-3daa-41f0-96fa-f3a0fd80f035 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:56.599685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46266b4e-3daa-41f0-96fa-f3a0fd80f035 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:56.600192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46266b4e-3daa-41f0-96fa-f3a0fd80f035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:56.621210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-46266b4e-3daa-41f0-96fa-f3a0fd80f035 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:56.622805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-46266b4e-3daa-41f0-96fa-f3a0fd80f035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:56.672128 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd14a7-b9dd-42b3-8f67-1b1da308a45b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:56.712205 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7958c-847d-48ce-b808-1e8c50218969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:56.713707 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7958c-847d-48ce-b808-1e8c50218969 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:56.714195 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7958c-847d-48ce-b808-1e8c50218969 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:56.714722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7958c-847d-48ce-b808-1e8c50218969 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:56.715751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7958c-847d-48ce-b808-1e8c50218969 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:56.716457 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7958c-847d-48ce-b808-1e8c50218969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:56.718536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7958c-847d-48ce-b808-1e8c50218969 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:56.718836 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 359/714] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:56.719857 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46266b4e-3daa-41f0-96fa-f3a0fd80f035 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:56.725713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 356/715] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jun 16 16:03:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:56.770304 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7958c-847d-48ce-b808-1e8c50218969 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:56.900338 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46266b4e-3daa-41f0-96fa-f3a0fd80f035 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:56.914343 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:56.923767 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:56.950935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5d88-8f05-4f83-be41-ab5a8dd38183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:56.951882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5d88-8f05-4f83-be41-ab5a8dd38183 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:56.951882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5d88-8f05-4f83-be41-ab5a8dd38183 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:56.952163 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b5d88-8f05-4f83-be41-ab5a8dd38183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:56.952994 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b5d88-8f05-4f83-be41-ab5a8dd38183 None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=795c029cb14b42b5b0f3987e218d4239) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:56.953308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b5d88-8f05-4f83-be41-ab5a8dd38183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:56.954787 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b5d88-8f05-4f83-be41-ab5a8dd38183 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:56.962943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 360/716] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:03:56 2022] GET /identity/v3/role_assignments?user.id=795c029cb14b42b5b0f3987e218d4239&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:56.974771 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7958c-847d-48ce-b808-1e8c50218969 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:57.028271 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8f924-15fd-4698-8cc8-62946835daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:57.029740 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f924-15fd-4698-8cc8-62946835daf6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:57.030067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f924-15fd-4698-8cc8-62946835daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:57.030645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f924-15fd-4698-8cc8-62946835daf6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:57.031189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8f924-15fd-4698-8cc8-62946835daf6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:57.032760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8f924-15fd-4698-8cc8-62946835daf6 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-73e8f924-15fd-4698-8cc8-62946835daf6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:57.046909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:57.047996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:57.048852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:57.048852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:57.048852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:57.048852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:57.048852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:57.048852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:57.048852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:57.048852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:57.048852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:57.048852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:57.048852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:03:57.048852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:03:57.048852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 16:03:57.048852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:57.048852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 357/717] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:03:56 2022] GET /identity/v3/services/network => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:03:57.056139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5d88-8f05-4f83-be41-ab5a8dd38183 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:57.193587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b5d88-8f05-4f83-be41-ab5a8dd38183 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:57.238724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f35ba-af6f-4e63-800d-b61fdfb1816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:57.239412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f35ba-af6f-4e63-800d-b61fdfb1816a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:57.239695 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f35ba-af6f-4e63-800d-b61fdfb1816a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:57.239972 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f35ba-af6f-4e63-800d-b61fdfb1816a None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:57.240688 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f35ba-af6f-4e63-800d-b61fdfb1816a None admin] RBAC: Adding query filter params (name=network) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:57.240994 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f35ba-af6f-4e63-800d-b61fdfb1816a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:57.242370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f35ba-af6f-4e63-800d-b61fdfb1816a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:57.247894 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 361/718] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 16 16:03:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:57.256769 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8f924-15fd-4698-8cc8-62946835daf6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:57.383549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8f924-15fd-4698-8cc8-62946835daf6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:57.440621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:57.461355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c62729-7766-4282-888a-9470f1730501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:57.462714 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c62729-7766-4282-888a-9470f1730501 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:57.463326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c62729-7766-4282-888a-9470f1730501 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:57.463935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c62729-7766-4282-888a-9470f1730501 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:57.465249 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c62729-7766-4282-888a-9470f1730501 None admin] RBAC: Adding query filter params (type=network) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:57.465913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c62729-7766-4282-888a-9470f1730501 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:57.468440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c62729-7766-4282-888a-9470f1730501 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:57.476282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 358/719] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 16 16:03:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:58.468379 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b506904-4d19-4c3b-824f-cf1099a54f66 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:58.469273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b506904-4d19-4c3b-824f-cf1099a54f66 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:58.469725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b506904-4d19-4c3b-824f-cf1099a54f66 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:58.471521 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 362/720] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:58.477031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c471b7-ea14-4216-9e6b-8c22f783bf7a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:58.477954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c471b7-ea14-4216-9e6b-8c22f783bf7a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:58.478460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c471b7-ea14-4216-9e6b-8c22f783bf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:58.503495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b6c471b7-ea14-4216-9e6b-8c22f783bf7a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:58.504999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b6c471b7-ea14-4216-9e6b-8c22f783bf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:58.603979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 359/721] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 16:03:58.635784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b506904-4d19-4c3b-824f-cf1099a54f66 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:58.694341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:58.760091 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b506904-4d19-4c3b-824f-cf1099a54f66 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:58.795416 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f474f3-ad21-40fd-b3ba-dd870071be14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:58.796804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f474f3-ad21-40fd-b3ba-dd870071be14 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:58.797086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f474f3-ad21-40fd-b3ba-dd870071be14 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:58.797365 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f474f3-ad21-40fd-b3ba-dd870071be14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:58.808165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f474f3-ad21-40fd-b3ba-dd870071be14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-80f474f3-ad21-40fd-b3ba-dd870071be14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:58.816712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:58.817657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:58.818535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:58.818535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:58.818535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:58.818535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:58.818535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:58.818535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:58.818535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:58.818535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:58.818535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:58.818535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:58.818535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:03:58.818535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:58.818535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 363/722] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:03:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:58.820072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842ad99-3c30-4bc9-a085-f826378dec9c None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:58.820370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842ad99-3c30-4bc9-a085-f826378dec9c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:58.820650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842ad99-3c30-4bc9-a085-f826378dec9c None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:58.822397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 360/723] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:58.826651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f474f3-ad21-40fd-b3ba-dd870071be14 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:58.827848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f5a5a-8ca2-4955-8d23-1d5eb5d85157 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:58.828165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f5a5a-8ca2-4955-8d23-1d5eb5d85157 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:58.828453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f5a5a-8ca2-4955-8d23-1d5eb5d85157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:58.870286 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2a3f5a5a-8ca2-4955-8d23-1d5eb5d85157 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:58.871527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2a3f5a5a-8ca2-4955-8d23-1d5eb5d85157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:58.940539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f474f3-ad21-40fd-b3ba-dd870071be14 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:58.943148 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:58.981423 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d22ac-67da-49b6-8263-92a3bd7ece98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:58.982640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d22ac-67da-49b6-8263-92a3bd7ece98 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:58.983068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d22ac-67da-49b6-8263-92a3bd7ece98 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:58.983359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d22ac-67da-49b6-8263-92a3bd7ece98 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:58.984330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d22ac-67da-49b6-8263-92a3bd7ece98 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:58.984644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d22ac-67da-49b6-8263-92a3bd7ece98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:58.986604 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d22ac-67da-49b6-8263-92a3bd7ece98 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:58.995993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 364/724] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:03:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:03:59.003107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d22ac-67da-49b6-8263-92a3bd7ece98 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:59.053976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 361/725] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:59.099937 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f5a5a-8ca2-4955-8d23-1d5eb5d85157 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:59.179069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d22ac-67da-49b6-8263-92a3bd7ece98 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:59.206964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:59.222053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e70c4e-ba52-4b91-ab36-19ccd30d3b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:59.222893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e70c4e-ba52-4b91-ab36-19ccd30d3b88 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:59.223179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e70c4e-ba52-4b91-ab36-19ccd30d3b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:59.223456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e70c4e-ba52-4b91-ab36-19ccd30d3b88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:59.246303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e70c4e-ba52-4b91-ab36-19ccd30d3b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:59.248858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e70c4e-ba52-4b91-ab36-19ccd30d3b88 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:59.288726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c7e70c4e-ba52-4b91-ab36-19ccd30d3b88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:59.288726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:59.288726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:59.288726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:59.288726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:59.288726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:59.288726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:59.288726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:59.288726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:59.288726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:59.288726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:59.288726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:59.288726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:59.288726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:59.288726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:59.292119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:59.295187 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:59.295187 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:59.295187 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:59.295187 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:59.295187 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 365/726] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:59.301626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e70c4e-ba52-4b91-ab36-19ccd30d3b88 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:59.306256 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f5a5a-8ca2-4955-8d23-1d5eb5d85157 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:59.343980 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430e985-c69f-435f-973b-c5a60e09a51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:59.346118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430e985-c69f-435f-973b-c5a60e09a51b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:59.346118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430e985-c69f-435f-973b-c5a60e09a51b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:59.346118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430e985-c69f-435f-973b-c5a60e09a51b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:59.349891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:59.356891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430e985-c69f-435f-973b-c5a60e09a51b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-a430e985-c69f-435f-973b-c5a60e09a51b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:03:59.365145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:59.366118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:59.367006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:59.367006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:59.367006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:59.367006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:59.367006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:03:59.367006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:03:59.367006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:03:59.367006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:03:59.367006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:03:59.367006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:03:59.367006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:03:59.367006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:59.367006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 362/727] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:03:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:03:59.375410 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430e985-c69f-435f-973b-c5a60e09a51b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:59.516344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e70c4e-ba52-4b91-ab36-19ccd30d3b88 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:59.563577 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430e985-c69f-435f-973b-c5a60e09a51b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:59.581876 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822574ec-12a3-4a48-8510-f4fc73f1e9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:59.582576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822574ec-12a3-4a48-8510-f4fc73f1e9cc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:59.582863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822574ec-12a3-4a48-8510-f4fc73f1e9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:59.583137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822574ec-12a3-4a48-8510-f4fc73f1e9cc None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:59.583865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822574ec-12a3-4a48-8510-f4fc73f1e9cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:59.584167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822574ec-12a3-4a48-8510-f4fc73f1e9cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:59.585541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822574ec-12a3-4a48-8510-f4fc73f1e9cc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:59.590787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:59.604804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 366/728] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:59.607594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a4531-8bc7-448a-be43-699fd4d0923d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:59.608113 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a4531-8bc7-448a-be43-699fd4d0923d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:59.609107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a4531-8bc7-448a-be43-699fd4d0923d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:59.614471 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 367/729] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:59.616135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a4531-8bc7-448a-be43-699fd4d0923d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:59.621764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20042e3-834c-4d12-8525-7be09adaef3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:59.622616 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20042e3-834c-4d12-8525-7be09adaef3f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:59.623687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20042e3-834c-4d12-8525-7be09adaef3f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:59.623976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20042e3-834c-4d12-8525-7be09adaef3f None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:59.625649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20042e3-834c-4d12-8525-7be09adaef3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:03:59.625649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20042e3-834c-4d12-8525-7be09adaef3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:59.626682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20042e3-834c-4d12-8525-7be09adaef3f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:59.641631 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 363/730] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:03:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:03:59.643423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee28992-95f4-47e4-8736-7c5719a98355 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:59.643717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee28992-95f4-47e4-8736-7c5719a98355 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:59.644001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee28992-95f4-47e4-8736-7c5719a98355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:59.664495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-bee28992-95f4-47e4-8736-7c5719a98355 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:03:59.666790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bee28992-95f4-47e4-8736-7c5719a98355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:03:59.724467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:59.747026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 364/731] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:03:59.749776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a4531-8bc7-448a-be43-699fd4d0923d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:59.755429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee28992-95f4-47e4-8736-7c5719a98355 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:59.786550 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878a4cb-567b-4219-bac0-7acefa47e48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:59.787290 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878a4cb-567b-4219-bac0-7acefa47e48f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:59.787588 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878a4cb-567b-4219-bac0-7acefa47e48f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:59.787848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878a4cb-567b-4219-bac0-7acefa47e48f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:59.795962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878a4cb-567b-4219-bac0-7acefa47e48f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:59.797409 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878a4cb-567b-4219-bac0-7acefa47e48f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f878a4cb-567b-4219-bac0-7acefa47e48f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:03:59.812348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:59.813366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:59.814357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:59.814357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:59.814357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:03:59.814357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:03:59.814357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:03:59.814357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:03:59.814357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:03:59.814357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:03:59.814357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 16:03:59.814357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:03:59.818214 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 368/732] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 16 16:03:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:59.819248 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219949f-6db6-4e4f-bbc3-dd387e3c8fcd None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:59.819539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219949f-6db6-4e4f-bbc3-dd387e3c8fcd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:59.819818 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219949f-6db6-4e4f-bbc3-dd387e3c8fcd None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:59.821795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 369/733] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:03:59.822355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219949f-6db6-4e4f-bbc3-dd387e3c8fcd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:59.877309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee28992-95f4-47e4-8736-7c5719a98355 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:59.880532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:03:59.914648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d58fb0-e186-4e01-8ead-16216c6c12bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:59.915397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d58fb0-e186-4e01-8ead-16216c6c12bb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:59.915682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d58fb0-e186-4e01-8ead-16216c6c12bb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:59.915970 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d58fb0-e186-4e01-8ead-16216c6c12bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:59.927614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d58fb0-e186-4e01-8ead-16216c6c12bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:59.930232 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d58fb0-e186-4e01-8ead-16216c6c12bb None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:59.934553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219949f-6db6-4e4f-bbc3-dd387e3c8fcd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:03:59.955765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-24d58fb0-e186-4e01-8ead-16216c6c12bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:59.955765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:03:59.955765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:03:59.955765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:03:59.955765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:03:59.955765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:03:59.955765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:03:59.955765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:03:59.955765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:03:59.955765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:03:59.955765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:03:59.955765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:03:59.955765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:03:59.955765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:03:59.955765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:03:59.956701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:03:59.957647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:03:59.957647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:03:59.957647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:03:59.957647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:03:59.964449 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 365/734] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:03:59.964449 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d58fb0-e186-4e01-8ead-16216c6c12bb None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:03:59.977691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa9f0d-c785-46d8-a784-d1b60162a13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:03:59.978460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa9f0d-c785-46d8-a784-d1b60162a13e None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:03:59.978766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa9f0d-c785-46d8-a784-d1b60162a13e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:03:59.979044 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa9f0d-c785-46d8-a784-d1b60162a13e None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:03:59.979785 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa9f0d-c785-46d8-a784-d1b60162a13e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:03:59.981128 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa9f0d-c785-46d8-a784-d1b60162a13e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:03:59.993565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:00.000703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 370/735] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 16 16:03:59 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:04:00.002140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd66b-f5f2-4432-af29-f30ee4454cbd None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:00.002964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd66b-f5f2-4432-af29-f30ee4454cbd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:00.003249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd66b-f5f2-4432-af29-f30ee4454cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:00.027241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b41bd66b-f5f2-4432-af29-f30ee4454cbd None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:00.031594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b41bd66b-f5f2-4432-af29-f30ee4454cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:00.095566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d58fb0-e186-4e01-8ead-16216c6c12bb None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:00.157313 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e9c03-4926-432b-918b-72c96736b59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:00.158008 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e9c03-4926-432b-918b-72c96736b59f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:00.158297 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e9c03-4926-432b-918b-72c96736b59f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:00.158638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e9c03-4926-432b-918b-72c96736b59f None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:00.159307 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 371/736] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:04:00.159490 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e9c03-4926-432b-918b-72c96736b59f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:00.159808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e9c03-4926-432b-918b-72c96736b59f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:00.160162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bd66b-f5f2-4432-af29-f30ee4454cbd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:00.161343 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e9c03-4926-432b-918b-72c96736b59f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:00.194924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 366/737] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jun 16 16:03:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:00.196225 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e9c03-4926-432b-918b-72c96736b59f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:00.220618 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:00.294298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bd66b-f5f2-4432-af29-f30ee4454cbd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:00.326824 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:00.341133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f52a3a-37ef-4c7c-93a7-d5a8bc18f15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:00.341967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f52a3a-37ef-4c7c-93a7-d5a8bc18f15a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:00.342251 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f52a3a-37ef-4c7c-93a7-d5a8bc18f15a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:00.342559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f52a3a-37ef-4c7c-93a7-d5a8bc18f15a None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:00.343292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f52a3a-37ef-4c7c-93a7-d5a8bc18f15a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:00.343597 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f52a3a-37ef-4c7c-93a7-d5a8bc18f15a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:00.344988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f52a3a-37ef-4c7c-93a7-d5a8bc18f15a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:00.353468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e9c03-4926-432b-918b-72c96736b59f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:00.362184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 372/738] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:00.362184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f52a3a-37ef-4c7c-93a7-d5a8bc18f15a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:00.398155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8002c3-41e9-48b0-bb0e-79c6e646f672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:00.399004 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8002c3-41e9-48b0-bb0e-79c6e646f672 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:00.399291 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8002c3-41e9-48b0-bb0e-79c6e646f672 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:00.399570 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8002c3-41e9-48b0-bb0e-79c6e646f672 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:00.411187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8002c3-41e9-48b0-bb0e-79c6e646f672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-0f8002c3-41e9-48b0-bb0e-79c6e646f672 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:04:00.418954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:00.420037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:00.420863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:00.420863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:00.420863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:00.420863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:00.420863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:04:00.420863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:04:00.420863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:04:00.420863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:04:00.420863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:04:00.420863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:04:00.420863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:04:00.420863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:00.420863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 367/739] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:04:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:00.422365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fffd8-448f-4997-b385-a759dfd0a370 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:00.422365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fffd8-448f-4997-b385-a759dfd0a370 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:00.422365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fffd8-448f-4997-b385-a759dfd0a370 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:00.427645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 368/740] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:00.427645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fffd8-448f-4997-b385-a759dfd0a370 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:00.484499 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f52a3a-37ef-4c7c-93a7-d5a8bc18f15a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:00.502738 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:00.523140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d7b39-40cd-41de-a656-d43352e9cfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:00.523808 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d7b39-40cd-41de-a656-d43352e9cfd4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:00.524544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d7b39-40cd-41de-a656-d43352e9cfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:00.524831 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d7b39-40cd-41de-a656-d43352e9cfd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:00.538516 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fffd8-448f-4997-b385-a759dfd0a370 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:00.574892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba83270-877f-45f9-9bef-968110b26b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:00.575966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba83270-877f-45f9-9bef-968110b26b5c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:00.576759 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba83270-877f-45f9-9bef-968110b26b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:00.577792 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba83270-877f-45f9-9bef-968110b26b5c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:00.584606 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:00.587131 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba83270-877f-45f9-9bef-968110b26b5c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:00.588573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba83270-877f-45f9-9bef-968110b26b5c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-0ba83270-877f-45f9-9bef-968110b26b5c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:04:00.603694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:00.604685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:00.606345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:00.606345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:00.606345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:04:00.606345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:04:00.606345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:04:00.606345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:04:00.606345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:04:00.606345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:04:00.606345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 16:04:00.606345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:00.606923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d7b39-40cd-41de-a656-d43352e9cfd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:00.607001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 369/741] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:04:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:00.607001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d0229-be19-4a82-8d31-52843c956a15 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:00.607001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d0229-be19-4a82-8d31-52843c956a15 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:00.607001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d0229-be19-4a82-8d31-52843c956a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:00.609961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d7b39-40cd-41de-a656-d43352e9cfd4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:00.626971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-534d0229-be19-4a82-8d31-52843c956a15 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:00.628172 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-534d0229-be19-4a82-8d31-52843c956a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:00.711131 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 370/742] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 16:04:00.711993 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d0229-be19-4a82-8d31-52843c956a15 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:00.742924 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 373/743] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:04:00 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 16:04:00.743615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d7b39-40cd-41de-a656-d43352e9cfd4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:00.787827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:00.833200 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:00.835005 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d0229-be19-4a82-8d31-52843c956a15 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:00.854498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d7b39-40cd-41de-a656-d43352e9cfd4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:00.870867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690c088-7ef8-4e82-8841-3375c46485f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:00.871690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690c088-7ef8-4e82-8841-3375c46485f6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:00.871974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690c088-7ef8-4e82-8841-3375c46485f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:00.872250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690c088-7ef8-4e82-8841-3375c46485f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:00.873684 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690c088-7ef8-4e82-8841-3375c46485f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:00.874248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690c088-7ef8-4e82-8841-3375c46485f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:00.875453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690c088-7ef8-4e82-8841-3375c46485f6 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:00.884124 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 371/744] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:04:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:00.884832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690c088-7ef8-4e82-8841-3375c46485f6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:00.897374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c2dff-6789-459f-9e96-4ea92134f587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:00.898058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c2dff-6789-459f-9e96-4ea92134f587 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:00.898343 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c2dff-6789-459f-9e96-4ea92134f587 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:00.898668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c2dff-6789-459f-9e96-4ea92134f587 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:00.899507 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c2dff-6789-459f-9e96-4ea92134f587 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:00.899819 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c2dff-6789-459f-9e96-4ea92134f587 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:00.901243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c2dff-6789-459f-9e96-4ea92134f587 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:00.921291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 374/745] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jun 16 16:04:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:00.922041 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c2dff-6789-459f-9e96-4ea92134f587 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:01.009480 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690c088-7ef8-4e82-8841-3375c46485f6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:01.028033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c2dff-6789-459f-9e96-4ea92134f587 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:01.041627 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:01.056423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f090b-e1c2-43be-9513-e85d692ddff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:01.057027 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f090b-e1c2-43be-9513-e85d692ddff2 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:01.057307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f090b-e1c2-43be-9513-e85d692ddff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:01.057755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f090b-e1c2-43be-9513-e85d692ddff2 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:01.058401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f090b-e1c2-43be-9513-e85d692ddff2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:01.059724 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f090b-e1c2-43be-9513-e85d692ddff2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:01.069306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c148da-21d2-4bcb-929c-81282cb6dcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:01.070157 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c148da-21d2-4bcb-929c-81282cb6dcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:01.070552 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c148da-21d2-4bcb-929c-81282cb6dcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:01.071105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c148da-21d2-4bcb-929c-81282cb6dcd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:01.079557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 372/746] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 16 16:04:00 2022] POST /identity/v3/services => generated 240 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:04:01.080216 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f090b-e1c2-43be-9513-e85d692ddff2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:01.091383 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c148da-21d2-4bcb-929c-81282cb6dcd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:01.095208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c148da-21d2-4bcb-929c-81282cb6dcd4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:01.098905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:01.124975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-71c148da-21d2-4bcb-929c-81282cb6dcd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:01.124975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:01.124975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:01.124975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:01.124975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:01.124975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:01.124975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:01.124975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:01.124975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:01.124975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:01.124975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:01.124975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:01.124975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:01.124975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:01.124975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:01.125913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:01.126875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:01.126875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:01.126875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:01.126875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:01.129469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 375/747] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:01.130746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c148da-21d2-4bcb-929c-81282cb6dcd4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:01.219858 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f090b-e1c2-43be-9513-e85d692ddff2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:01.260544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c148da-21d2-4bcb-929c-81282cb6dcd4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:01.262346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0181b31-df79-4fa2-9928-9d53964b106b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:01.263634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0181b31-df79-4fa2-9928-9d53964b106b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:01.263634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0181b31-df79-4fa2-9928-9d53964b106b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:01.264088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0181b31-df79-4fa2-9928-9d53964b106b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:01.277109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0181b31-df79-4fa2-9928-9d53964b106b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:01.278764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0181b31-df79-4fa2-9928-9d53964b106b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:01.299299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-e0181b31-df79-4fa2-9928-9d53964b106b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:01.299299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:01.299299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:01.299299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:01.299299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:01.299299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:01.299299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:01.299299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:01.299299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:01.299299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:01.299299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:01.299299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:01.299299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:01.299299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:01.299299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:01.300234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:01.301126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:01.301126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:01.301126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:01.301126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:01.301126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 373/748] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:01.302255 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0181b31-df79-4fa2-9928-9d53964b106b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:01.306242 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d8d82-2831-4d17-a61e-c0cea7a8b851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:01.306947 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8d82-2831-4d17-a61e-c0cea7a8b851 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:01.307236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8d82-2831-4d17-a61e-c0cea7a8b851 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:01.307518 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8d82-2831-4d17-a61e-c0cea7a8b851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:01.339119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:01.399775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:01.410110 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d8d82-2831-4d17-a61e-c0cea7a8b851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:01.412290 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d8d82-2831-4d17-a61e-c0cea7a8b851 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:01.424889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0181b31-df79-4fa2-9928-9d53964b106b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:01.464010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b756ec-150b-4074-8780-ecdf791516ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:01.464817 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b756ec-150b-4074-8780-ecdf791516ce None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:01.465234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b756ec-150b-4074-8780-ecdf791516ce None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:01.465587 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b756ec-150b-4074-8780-ecdf791516ce None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:01.466799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b756ec-150b-4074-8780-ecdf791516ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:01.467249 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b756ec-150b-4074-8780-ecdf791516ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:01.468831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b756ec-150b-4074-8780-ecdf791516ce None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:01.486987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 374/749] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:01.488053 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b756ec-150b-4074-8780-ecdf791516ce None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:01.551504 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 376/750] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:04:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:04:01.551504 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d8d82-2831-4d17-a61e-c0cea7a8b851 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:01.607832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:01.621815 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b756ec-150b-4074-8780-ecdf791516ce None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:01.661185 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805141e-cf43-4677-8a7f-f740abe7528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:01.661839 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805141e-cf43-4677-8a7f-f740abe7528b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:01.662113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805141e-cf43-4677-8a7f-f740abe7528b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:01.662493 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805141e-cf43-4677-8a7f-f740abe7528b None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:01.663167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805141e-cf43-4677-8a7f-f740abe7528b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:01.663479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805141e-cf43-4677-8a7f-f740abe7528b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:01.664879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805141e-cf43-4677-8a7f-f740abe7528b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:01.676352 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d8d82-2831-4d17-a61e-c0cea7a8b851 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:01.678201 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:01.682036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 375/751] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:01.683068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805141e-cf43-4677-8a7f-f740abe7528b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:01.724886 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d9a27-90d1-41f3-a8b6-19e4db60478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:01.726048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d9a27-90d1-41f3-a8b6-19e4db60478e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:01.726590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d9a27-90d1-41f3-a8b6-19e4db60478e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:01.727064 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d9a27-90d1-41f3-a8b6-19e4db60478e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:01.735538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d9a27-90d1-41f3-a8b6-19e4db60478e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:01.737290 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d9a27-90d1-41f3-a8b6-19e4db60478e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:01.752615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d17d9a27-90d1-41f3-a8b6-19e4db60478e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:01.752615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:01.752615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:01.752615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:01.752615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:01.752615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:01.752615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:01.752615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:01.752615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:01.752615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:01.752615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:01.752615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:01.752615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:04:01.752615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:04:01.752615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:01.753547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:01.754468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:04:01.754468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:04:01.754468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:04:01.754468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:04:01.754468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:04:01.754468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:04:01.754468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:01.754468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:01.761449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 377/752] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:01.762698 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d9a27-90d1-41f3-a8b6-19e4db60478e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:01.793878 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805141e-cf43-4677-8a7f-f740abe7528b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:01.831601 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84719d1b-5ec1-4d1b-a402-99b3d7629b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:01.832410 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84719d1b-5ec1-4d1b-a402-99b3d7629b1c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:01.832695 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84719d1b-5ec1-4d1b-a402-99b3d7629b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:01.832970 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84719d1b-5ec1-4d1b-a402-99b3d7629b1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:01.845892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84719d1b-5ec1-4d1b-a402-99b3d7629b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:01.847497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84719d1b-5ec1-4d1b-a402-99b3d7629b1c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:01.866309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-84719d1b-5ec1-4d1b-a402-99b3d7629b1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:01.866309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:01.866309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:01.866309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:01.866309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:01.866309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:01.866309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:01.866309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:01.866309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:01.866309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:01.866309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:01.866309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:01.866309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:01.866309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:01.866309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:01.867567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:01.868538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:01.868538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:01.868538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:01.868538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:01.872035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 376/753] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:01.873040 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84719d1b-5ec1-4d1b-a402-99b3d7629b1c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:01.876270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:01.879548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d9a27-90d1-41f3-a8b6-19e4db60478e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:01.917832 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7c527-859e-450b-a309-ae9b0e1f85e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:01.918986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7c527-859e-450b-a309-ae9b0e1f85e5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:01.919538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7c527-859e-450b-a309-ae9b0e1f85e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:01.920535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7c527-859e-450b-a309-ae9b0e1f85e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:01.929294 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7c527-859e-450b-a309-ae9b0e1f85e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:01.931043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7c527-859e-450b-a309-ae9b0e1f85e5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3bc7c527-859e-450b-a309-ae9b0e1f85e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:04:01.947554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:01.948540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:01.949482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:01.949482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:01.949482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:04:01.949482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:04:01.949482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:04:01.949482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:04:01.949482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:04:01.949482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:04:01.949482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:04:01.949482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:01.952841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 378/754] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 16 16:04:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:01.953976 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7c527-859e-450b-a309-ae9b0e1f85e5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:01.989835 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84719d1b-5ec1-4d1b-a402-99b3d7629b1c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:02.006787 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:02.027407 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece5377-b568-4bc4-b5ff-979d02fee55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:02.027833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece5377-b568-4bc4-b5ff-979d02fee55c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:02.028170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece5377-b568-4bc4-b5ff-979d02fee55c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:02.028504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece5377-b568-4bc4-b5ff-979d02fee55c None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:02.030090 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece5377-b568-4bc4-b5ff-979d02fee55c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:02.030525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece5377-b568-4bc4-b5ff-979d02fee55c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:02.032198 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece5377-b568-4bc4-b5ff-979d02fee55c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:02.052168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 377/755] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:04:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:02.052168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece5377-b568-4bc4-b5ff-979d02fee55c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:02.073583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7c527-859e-450b-a309-ae9b0e1f85e5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:02.115737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3266f88-bc3e-4104-8a56-0942eb396129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:02.116417 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3266f88-bc3e-4104-8a56-0942eb396129 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:02.116707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3266f88-bc3e-4104-8a56-0942eb396129 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:02.116991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3266f88-bc3e-4104-8a56-0942eb396129 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:02.117881 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3266f88-bc3e-4104-8a56-0942eb396129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:02.118203 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3266f88-bc3e-4104-8a56-0942eb396129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:02.120039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3266f88-bc3e-4104-8a56-0942eb396129 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:02.133120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 379/756] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:02.134067 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3266f88-bc3e-4104-8a56-0942eb396129 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:02.137688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:02.191905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece5377-b568-4bc4-b5ff-979d02fee55c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:02.229943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:02.243514 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ba153-69e3-4ea7-9ec7-f83951cfc980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:02.244559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ba153-69e3-4ea7-9ec7-f83951cfc980 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:02.245048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ba153-69e3-4ea7-9ec7-f83951cfc980 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:02.245532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ba153-69e3-4ea7-9ec7-f83951cfc980 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:02.247267 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ba153-69e3-4ea7-9ec7-f83951cfc980 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:02.248211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ba153-69e3-4ea7-9ec7-f83951cfc980 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:02.250939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ba153-69e3-4ea7-9ec7-f83951cfc980 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:02.259316 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3266f88-bc3e-4104-8a56-0942eb396129 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:02.273888 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 378/757] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 16 16:04:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:02.274972 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ba153-69e3-4ea7-9ec7-f83951cfc980 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:02.301389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10af8c-9ed5-4772-8b16-5d61fe77d2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:02.302045 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10af8c-9ed5-4772-8b16-5d61fe77d2fb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:02.302324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10af8c-9ed5-4772-8b16-5d61fe77d2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:02.302629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10af8c-9ed5-4772-8b16-5d61fe77d2fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:02.303449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10af8c-9ed5-4772-8b16-5d61fe77d2fb None admin] RBAC: Adding query filter params (role.id=6da95c91bacf48f9870a114e2ab05472, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=36f7c6f172424967bb7749180711db07) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:02.303757 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10af8c-9ed5-4772-8b16-5d61fe77d2fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:02.305182 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10af8c-9ed5-4772-8b16-5d61fe77d2fb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:02.318478 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 380/758] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:04:02 2022] GET /identity/v3/role_assignments?user.id=36f7c6f172424967bb7749180711db07&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=6da95c91bacf48f9870a114e2ab05472 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:02.318478 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e37df-56b4-4b00-aaba-2ccd6d8d39ef None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:02.318478 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e37df-56b4-4b00-aaba-2ccd6d8d39ef None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:02.318478 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e37df-56b4-4b00-aaba-2ccd6d8d39ef None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:02.318478 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 381/759] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:02.318478 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e37df-56b4-4b00-aaba-2ccd6d8d39ef None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:02.426416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ba153-69e3-4ea7-9ec7-f83951cfc980 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:02.454410 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:02.467662 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e37df-56b4-4b00-aaba-2ccd6d8d39ef None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:02.472269 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482e2c2-6675-4082-bfc3-83d1dfc21063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:02.473239 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482e2c2-6675-4082-bfc3-83d1dfc21063 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:02.473626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482e2c2-6675-4082-bfc3-83d1dfc21063 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:02.474008 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482e2c2-6675-4082-bfc3-83d1dfc21063 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:02.485468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482e2c2-6675-4082-bfc3-83d1dfc21063 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:02.487167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482e2c2-6675-4082-bfc3-83d1dfc21063 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:02.506549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-3482e2c2-6675-4082-bfc3-83d1dfc21063 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:02.506549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:02.506549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:02.506549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:02.506549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:02.506549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:02.506549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:02.506549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:02.506549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:02.506549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:02.506549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:02.506549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:02.506549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:04:02.506549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:04:02.506549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:02.507500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:02.508401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:04:02.508401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:04:02.508401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:04:02.508401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:04:02.508401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:04:02.508401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:04:02.508401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:02.508401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:02.508832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 379/760] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:02.510390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55bb6f-ea12-47a8-9d2c-d1c860966ddf None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:02.510390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55bb6f-ea12-47a8-9d2c-d1c860966ddf None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:02.510671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55bb6f-ea12-47a8-9d2c-d1c860966ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:02.524475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374c90b-de2a-4171-ab1e-8e7c29ca74e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:02.525297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374c90b-de2a-4171-ab1e-8e7c29ca74e9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:02.525586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374c90b-de2a-4171-ab1e-8e7c29ca74e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:02.525864 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374c90b-de2a-4171-ab1e-8e7c29ca74e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:02.534378 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3e55bb6f-ea12-47a8-9d2c-d1c860966ddf None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:02.535256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:02.535620 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3e55bb6f-ea12-47a8-9d2c-d1c860966ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:02.542040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374c90b-de2a-4171-ab1e-8e7c29ca74e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:02.543895 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374c90b-de2a-4171-ab1e-8e7c29ca74e9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:02.569218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8374c90b-de2a-4171-ab1e-8e7c29ca74e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:02.569218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:02.569218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:02.569218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:02.569218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:02.569218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:02.569218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:02.569218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:02.569218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:02.569218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:02.569218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:02.569218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:02.569218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:02.569218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:02.569218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:02.570641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:02.571837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:02.571837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:02.571837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:02.571837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:02.575601 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 382/761] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:02.577318 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374c90b-de2a-4171-ab1e-8e7c29ca74e9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:02.637263 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 380/762] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:02.638140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55bb6f-ea12-47a8-9d2c-d1c860966ddf None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:02.706152 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374c90b-de2a-4171-ab1e-8e7c29ca74e9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:02.755681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dfc3f-31a7-4439-9a39-7f983144b8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:02.756635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dfc3f-31a7-4439-9a39-7f983144b8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:02.756925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dfc3f-31a7-4439-9a39-7f983144b8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:02.757205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dfc3f-31a7-4439-9a39-7f983144b8b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:02.758458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dfc3f-31a7-4439-9a39-7f983144b8b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:02.758812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dfc3f-31a7-4439-9a39-7f983144b8b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:02.760259 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dfc3f-31a7-4439-9a39-7f983144b8b7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:02.775840 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 383/763] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:04:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:02.776994 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dfc3f-31a7-4439-9a39-7f983144b8b7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:02.782205 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55bb6f-ea12-47a8-9d2c-d1c860966ddf None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:02.796780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:02.828717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8785a7e-a922-45fe-b791-4efe8b7ee0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:02.830118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8785a7e-a922-45fe-b791-4efe8b7ee0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:02.830533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8785a7e-a922-45fe-b791-4efe8b7ee0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:02.830918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8785a7e-a922-45fe-b791-4efe8b7ee0f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:02.832225 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8785a7e-a922-45fe-b791-4efe8b7ee0f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:02.832658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8785a7e-a922-45fe-b791-4efe8b7ee0f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:02.834768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8785a7e-a922-45fe-b791-4efe8b7ee0f3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:02.841048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:02.854150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 381/764] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:02.855583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8785a7e-a922-45fe-b791-4efe8b7ee0f3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:02.901079 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dfc3f-31a7-4439-9a39-7f983144b8b7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:02.940670 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f65c33-c43d-4ee5-9f3b-df6967c6bed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:02.941422 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f65c33-c43d-4ee5-9f3b-df6967c6bed4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:02.941786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f65c33-c43d-4ee5-9f3b-df6967c6bed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:02.942141 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f65c33-c43d-4ee5-9f3b-df6967c6bed4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:02.943190 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f65c33-c43d-4ee5-9f3b-df6967c6bed4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:02.944830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f65c33-c43d-4ee5-9f3b-df6967c6bed4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-31f65c33-c43d-4ee5-9f3b-df6967c6bed4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:02.965060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:02.966226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:02.967549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:02.967549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:02.967549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:02.967549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:02.967549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:02.967549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:02.967549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:02.967549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:02.967549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:02.967549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:02.967549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:02.967549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:02.967549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:02.967549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 16:04:02.967549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:02.973830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 384/765] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jun 16 16:04:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:02.973830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f65c33-c43d-4ee5-9f3b-df6967c6bed4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:02.989543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8785a7e-a922-45fe-b791-4efe8b7ee0f3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:03.037363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a31bb-f7c4-466a-928d-ed0172399119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:03.038757 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a31bb-f7c4-466a-928d-ed0172399119 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:03.039439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a31bb-f7c4-466a-928d-ed0172399119 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:03.039891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a31bb-f7c4-466a-928d-ed0172399119 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:03.041140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a31bb-f7c4-466a-928d-ed0172399119 None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=a8527cbb8efe43d7bb297d779929a50e) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:03.041990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a31bb-f7c4-466a-928d-ed0172399119 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:03.044154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a31bb-f7c4-466a-928d-ed0172399119 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:03.052586 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 382/766] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:04:02 2022] GET /identity/v3/role_assignments?user.id=a8527cbb8efe43d7bb297d779929a50e&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:03.054739 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a31bb-f7c4-466a-928d-ed0172399119 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:03.118463 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:03.118677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f65c33-c43d-4ee5-9f3b-df6967c6bed4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:03.157657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:03.208799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f50d1-2381-457e-987e-cbeeb4849cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:03.209626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f50d1-2381-457e-987e-cbeeb4849cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:03.209914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f50d1-2381-457e-987e-cbeeb4849cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:03.210194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f50d1-2381-457e-987e-cbeeb4849cc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:03.224030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f50d1-2381-457e-987e-cbeeb4849cc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:03.225527 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f50d1-2381-457e-987e-cbeeb4849cc4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:03.260893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-160f50d1-2381-457e-987e-cbeeb4849cc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:03.260893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:03.260893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:03.260893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:03.260893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:03.260893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:03.260893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:03.260893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:03.260893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:03.260893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:03.260893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:03.260893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:03.260893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:04:03.260893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:04:03.260893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:03.261926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:03.262909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:04:03.262909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:04:03.262909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:04:03.262909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:04:03.262909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:04:03.262909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:04:03.262909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:03.262909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:03.264337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 385/767] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:03.271519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f50d1-2381-457e-987e-cbeeb4849cc4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:03.283266 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a31bb-f7c4-466a-928d-ed0172399119 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:03.324157 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f76304-429d-4bcb-93b9-c95e7eaf7523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:03.324936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f76304-429d-4bcb-93b9-c95e7eaf7523 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:03.325224 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f76304-429d-4bcb-93b9-c95e7eaf7523 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:03.325598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f76304-429d-4bcb-93b9-c95e7eaf7523 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:03.326990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f76304-429d-4bcb-93b9-c95e7eaf7523 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:03.327300 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f76304-429d-4bcb-93b9-c95e7eaf7523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:03.328686 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f76304-429d-4bcb-93b9-c95e7eaf7523 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:03.344584 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 383/768] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jun 16 16:04:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:03.354402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f76304-429d-4bcb-93b9-c95e7eaf7523 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:03.398040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f50d1-2381-457e-987e-cbeeb4849cc4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:03.457388 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5579b20-aecd-46be-ab49-c654646265b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:03.458547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5579b20-aecd-46be-ab49-c654646265b2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:03.459044 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5579b20-aecd-46be-ab49-c654646265b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:03.460100 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5579b20-aecd-46be-ab49-c654646265b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:03.461383 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5579b20-aecd-46be-ab49-c654646265b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:03.461949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5579b20-aecd-46be-ab49-c654646265b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:03.464543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5579b20-aecd-46be-ab49-c654646265b2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:03.482978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 386/769] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:04:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:03.484644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bce10-31a8-4042-8d53-d8ea2f8f0dd4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:03.485780 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bce10-31a8-4042-8d53-d8ea2f8f0dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:03.486366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bce10-31a8-4042-8d53-d8ea2f8f0dd4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:03.492283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 387/770] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:03.493675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bce10-31a8-4042-8d53-d8ea2f8f0dd4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:03.514463 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:03.518923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f76304-429d-4bcb-93b9-c95e7eaf7523 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:03.543931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:03.563646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d8924-6455-4732-895f-e0c15f5c2b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:03.564325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d8924-6455-4732-895f-e0c15f5c2b78 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:03.564611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d8924-6455-4732-895f-e0c15f5c2b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:03.564886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d8924-6455-4732-895f-e0c15f5c2b78 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:03.565602 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d8924-6455-4732-895f-e0c15f5c2b78 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:03.565912 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d8924-6455-4732-895f-e0c15f5c2b78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:03.567453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d8924-6455-4732-895f-e0c15f5c2b78 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:03.577774 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 384/771] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jun 16 16:04:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:03.577774 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a1404-1b34-4f7b-844a-cf3ce2daa282 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:03.577774 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a1404-1b34-4f7b-844a-cf3ce2daa282 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:03.577774 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a1404-1b34-4f7b-844a-cf3ce2daa282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:03.594280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9e6a1404-1b34-4f7b-844a-cf3ce2daa282 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:03.595536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9e6a1404-1b34-4f7b-844a-cf3ce2daa282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:03.638937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bce10-31a8-4042-8d53-d8ea2f8f0dd4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:03.678451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 385/772] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:03.678451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a1404-1b34-4f7b-844a-cf3ce2daa282 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:03.700172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55576b0d-fa36-412c-81d0-77e50c57f4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:03.701743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55576b0d-fa36-412c-81d0-77e50c57f4fe None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:03.702030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55576b0d-fa36-412c-81d0-77e50c57f4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:03.702460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55576b0d-fa36-412c-81d0-77e50c57f4fe None admin] PATH_INFO: `/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/795c029cb14b42b5b0f3987e218d4239/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:03.704486 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55576b0d-fa36-412c-81d0-77e50c57f4fe None admin] RBAC: Authorizing `identity:create_grant(project_id=227cd348bea64e1f89d77ae2cf63a031, user_id=795c029cb14b42b5b0f3987e218d4239, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:03.706214 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55576b0d-fa36-412c-81d0-77e50c57f4fe None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:03.721428 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 388/773] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:04:03 2022] PUT /identity/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/795c029cb14b42b5b0f3987e218d4239/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:04:03.727115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55576b0d-fa36-412c-81d0-77e50c57f4fe None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:03.804234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:03.816748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a1404-1b34-4f7b-844a-cf3ce2daa282 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:03.856744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eb79a-f845-4597-8da1-20bb158fe87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:03.857999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb79a-f845-4597-8da1-20bb158fe87e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:03.858536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb79a-f845-4597-8da1-20bb158fe87e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:03.859040 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb79a-f845-4597-8da1-20bb158fe87e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:03.860191 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3eb79a-f845-4597-8da1-20bb158fe87e None admin] RBAC: Adding query filter params (interface=public, service_id=b19edeafc29c431384504f251510dfa3, region_id=RegionOne) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:03.860750 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3eb79a-f845-4597-8da1-20bb158fe87e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:03.862355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3eb79a-f845-4597-8da1-20bb158fe87e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:03.876495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 386/774] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 16 16:04:03 2022] GET /identity/v3/endpoints?service_id=b19edeafc29c431384504f251510dfa3&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:03.878188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eb79a-f845-4597-8da1-20bb158fe87e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:03.973084 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:03.980388 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55576b0d-fa36-412c-81d0-77e50c57f4fe None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:04.004336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eb79a-f845-4597-8da1-20bb158fe87e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:04.028369 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c0efc-d2c3-4317-9d21-f7506ad1109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:04.030061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0efc-d2c3-4317-9d21-f7506ad1109d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:04.030469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0efc-d2c3-4317-9d21-f7506ad1109d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:04.030760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0efc-d2c3-4317-9d21-f7506ad1109d None admin] PATH_INFO: `/v3/services/network` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:04.031441 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c0efc-d2c3-4317-9d21-f7506ad1109d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:04.032829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c0efc-d2c3-4317-9d21-f7506ad1109d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:04.049989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6622e30-3264-4355-bf17-b35f681ae7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:04.051197 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6622e30-3264-4355-bf17-b35f681ae7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:04.051731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6622e30-3264-4355-bf17-b35f681ae7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:04.052260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6622e30-3264-4355-bf17-b35f681ae7e0 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:04.053147 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6622e30-3264-4355-bf17-b35f681ae7e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:04.054912 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6622e30-3264-4355-bf17-b35f681ae7e0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-463c0efc-d2c3-4317-9d21-f7506ad1109d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:04.059355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:04.060967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:04.062012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:04.062012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:04.062012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:04.062012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:04.062012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:04.062012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:04.062012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:04.062012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:04.062012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:04.062012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:04.062012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:04.062012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:04.062012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 16:04:04.062012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:04.067675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 389/775] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:03 2022] GET /identity/v3/services/network => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:04.069828 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 387/776] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 16 16:04:03 2022] GET /identity/v3/services => generated 772 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:04.080487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c0efc-d2c3-4317-9d21-f7506ad1109d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:04.207940 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c0efc-d2c3-4317-9d21-f7506ad1109d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:04.248781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a3af1-3c1f-42b0-b8db-97aab4d07b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:04.249469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a3af1-3c1f-42b0-b8db-97aab4d07b9f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:04.249756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a3af1-3c1f-42b0-b8db-97aab4d07b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:04.250029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a3af1-3c1f-42b0-b8db-97aab4d07b9f None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:04.250781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a3af1-3c1f-42b0-b8db-97aab4d07b9f None admin] RBAC: Adding query filter params (name=network) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:04.251090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a3af1-3c1f-42b0-b8db-97aab4d07b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:04.252464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a3af1-3c1f-42b0-b8db-97aab4d07b9f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:04.257753 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 390/777] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 16 16:04:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:04.264035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6622e30-3264-4355-bf17-b35f681ae7e0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:04.301604 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:04.412379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6622e30-3264-4355-bf17-b35f681ae7e0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:04.464329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c6365-f903-43b3-8085-6dcdb57ece56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:04.465014 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6365-f903-43b3-8085-6dcdb57ece56 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:04.465299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6365-f903-43b3-8085-6dcdb57ece56 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:04.465578 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6365-f903-43b3-8085-6dcdb57ece56 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:04.466321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c6365-f903-43b3-8085-6dcdb57ece56 None admin] RBAC: Adding query filter params (type=network) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:04.466761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c6365-f903-43b3-8085-6dcdb57ece56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:04.468275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c6365-f903-43b3-8085-6dcdb57ece56 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:04.476486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 388/778] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 16 16:04:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:04.482605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a3af1-3c1f-42b0-b8db-97aab4d07b9f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:04.517574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:04.620697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a3af1-3c1f-42b0-b8db-97aab4d07b9f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:04.662360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5f26e-d423-4f59-87ec-4552d069a4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:04.663211 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5f26e-d423-4f59-87ec-4552d069a4cc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:04.663499 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5f26e-d423-4f59-87ec-4552d069a4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:04.663776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5f26e-d423-4f59-87ec-4552d069a4cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:04.664588 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5f26e-d423-4f59-87ec-4552d069a4cc None admin] RBAC: Adding query filter params (interface=public, service_id=ef3d7d99284b499c89cde6262bae1753, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:04.664900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5f26e-d423-4f59-87ec-4552d069a4cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:04.666402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5f26e-d423-4f59-87ec-4552d069a4cc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:04.682313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 391/779] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 16 16:04:04 2022] GET /identity/v3/endpoints?service_id=ef3d7d99284b499c89cde6262bae1753&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:04.683724 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c6365-f903-43b3-8085-6dcdb57ece56 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:04.736144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437dfd0-d47c-423f-bf60-0f8707ebf0c5 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:04.736468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437dfd0-d47c-423f-bf60-0f8707ebf0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:04.736702 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437dfd0-d47c-423f-bf60-0f8707ebf0c5 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:04.738335 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 392/780] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:04.748905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03686098-deb4-45a8-889b-9acd1b0e4690 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:04.749194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03686098-deb4-45a8-889b-9acd1b0e4690 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:04.749480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03686098-deb4-45a8-889b-9acd1b0e4690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:04.779736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-03686098-deb4-45a8-889b-9acd1b0e4690 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:04.781068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-03686098-deb4-45a8-889b-9acd1b0e4690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:04.869226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:04.892438 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 393/781] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:04.902284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c6365-f903-43b3-8085-6dcdb57ece56 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:04.915954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03686098-deb4-45a8-889b-9acd1b0e4690 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:04.936990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:04.968766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74296731-e97a-4a32-a6e9-127432b03178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:04.970056 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74296731-e97a-4a32-a6e9-127432b03178 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:04.973123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74296731-e97a-4a32-a6e9-127432b03178 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:04.973694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74296731-e97a-4a32-a6e9-127432b03178 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:04.974795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74296731-e97a-4a32-a6e9-127432b03178 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:04.976659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74296731-e97a-4a32-a6e9-127432b03178 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:04.995230 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 389/782] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 16 16:04:04 2022] GET /identity/v3/services => generated 772 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:05.095519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03686098-deb4-45a8-889b-9acd1b0e4690 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:05.150980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d087722-bb01-4b6e-8df0-1f1912ded28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:05.151794 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d087722-bb01-4b6e-8df0-1f1912ded28a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:05.152076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d087722-bb01-4b6e-8df0-1f1912ded28a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:05.152350 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d087722-bb01-4b6e-8df0-1f1912ded28a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:05.175077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d087722-bb01-4b6e-8df0-1f1912ded28a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-1d087722-bb01-4b6e-8df0-1f1912ded28a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:04:05.187754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:05.188769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:05.189612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:05.189612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:05.189612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:05.189612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:05.189612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:04:05.189612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:04:05.189612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:04:05.189612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:04:05.189612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:04:05.189612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:04:05.189612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:04:05.189612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:05.189612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 394/783] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:04:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:05.196142 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74296731-e97a-4a32-a6e9-127432b03178 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:05.386528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74296731-e97a-4a32-a6e9-127432b03178 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:05.425402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79388eac-3e1d-4267-9f90-a469313c6519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:05.426087 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79388eac-3e1d-4267-9f90-a469313c6519 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:05.426367 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79388eac-3e1d-4267-9f90-a469313c6519 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:05.426672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79388eac-3e1d-4267-9f90-a469313c6519 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:05.427418 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79388eac-3e1d-4267-9f90-a469313c6519 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:05.427721 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79388eac-3e1d-4267-9f90-a469313c6519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:05.429116 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79388eac-3e1d-4267-9f90-a469313c6519 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:05.442217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 390/784] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:04:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:05.450119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d087722-bb01-4b6e-8df0-1f1912ded28a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:05.594479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:05.634691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d087722-bb01-4b6e-8df0-1f1912ded28a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:05.678165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ab102-5898-479e-a70e-a56b91894e54 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:05.678360 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ab102-5898-479e-a70e-a56b91894e54 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:05.678672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ab102-5898-479e-a70e-a56b91894e54 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:05.680321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 391/785] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:05.686123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cfb90-8f31-478b-b276-b48f98dff4a9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:05.686710 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cfb90-8f31-478b-b276-b48f98dff4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:05.686918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cfb90-8f31-478b-b276-b48f98dff4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:05.690640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be833d-d62f-4082-9503-62eb072c05f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:05.691946 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be833d-d62f-4082-9503-62eb072c05f4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:05.692439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be833d-d62f-4082-9503-62eb072c05f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:05.692934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be833d-d62f-4082-9503-62eb072c05f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:05.715748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be833d-d62f-4082-9503-62eb072c05f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:05.718368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be833d-d62f-4082-9503-62eb072c05f4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:05.724616 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-be7cfb90-8f31-478b-b276-b48f98dff4a9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:05.731273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-be7cfb90-8f31-478b-b276-b48f98dff4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:05.737880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:05.755459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-95be833d-d62f-4082-9503-62eb072c05f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:05.755459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:05.755459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:05.755459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:05.755459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:05.755459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:05.755459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:05.755459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:05.755459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:05.755459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:05.755459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:05.755459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:05.755459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:05.755459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:05.755459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:05.756444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:05.757361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:05.757361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:05.757361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:05.757361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:05.764628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 395/786] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:05.780493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be833d-d62f-4082-9503-62eb072c05f4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:05.831808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 392/787] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:05.854873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cfb90-8f31-478b-b276-b48f98dff4a9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:05.933536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be833d-d62f-4082-9503-62eb072c05f4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:05.965745 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:05.979125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52386ff7-6ce2-4912-9d92-84e27353d72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:05.979821 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52386ff7-6ce2-4912-9d92-84e27353d72d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:05.980108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52386ff7-6ce2-4912-9d92-84e27353d72d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:05.980397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52386ff7-6ce2-4912-9d92-84e27353d72d None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:05.981207 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52386ff7-6ce2-4912-9d92-84e27353d72d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:05.981523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52386ff7-6ce2-4912-9d92-84e27353d72d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:05.983787 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52386ff7-6ce2-4912-9d92-84e27353d72d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:05.997583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cfb90-8f31-478b-b276-b48f98dff4a9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:06.018976 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 396/788] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:06.026522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52386ff7-6ce2-4912-9d92-84e27353d72d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:06.073133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe153fb5-b767-4c81-b541-d4af1b287b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:06.073944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe153fb5-b767-4c81-b541-d4af1b287b15 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:06.074227 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe153fb5-b767-4c81-b541-d4af1b287b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:06.074535 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe153fb5-b767-4c81-b541-d4af1b287b15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:06.093792 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:06.095886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe153fb5-b767-4c81-b541-d4af1b287b15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-fe153fb5-b767-4c81-b541-d4af1b287b15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:04:06.113501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:06.114547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:06.115387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:06.115387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:06.115387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:06.115387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:06.115387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:04:06.115387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:04:06.115387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:04:06.115387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:04:06.115387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:04:06.115387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:04:06.115387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:04:06.115387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:06.115387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 393/789] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:04:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:06.121380 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe153fb5-b767-4c81-b541-d4af1b287b15 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:06.235427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52386ff7-6ce2-4912-9d92-84e27353d72d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:06.269555 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe153fb5-b767-4c81-b541-d4af1b287b15 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:06.310958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ba8e8-3cdf-4f21-816a-a8ac53d2f6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:06.312539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ba8e8-3cdf-4f21-816a-a8ac53d2f6be None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:06.313493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ba8e8-3cdf-4f21-816a-a8ac53d2f6be None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:06.314444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ba8e8-3cdf-4f21-816a-a8ac53d2f6be None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:06.318342 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b94a3e-1a65-4cc3-847b-38e37f0b26c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:06.319293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b94a3e-1a65-4cc3-847b-38e37f0b26c7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:06.319788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b94a3e-1a65-4cc3-847b-38e37f0b26c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:06.320258 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b94a3e-1a65-4cc3-847b-38e37f0b26c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:06.321471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b94a3e-1a65-4cc3-847b-38e37f0b26c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:06.322189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b94a3e-1a65-4cc3-847b-38e37f0b26c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:06.324647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b94a3e-1a65-4cc3-847b-38e37f0b26c7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:06.335188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ba8e8-3cdf-4f21-816a-a8ac53d2f6be None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:06.336715 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ba8e8-3cdf-4f21-816a-a8ac53d2f6be None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:06.338372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 394/790] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:04:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:06.344552 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b94a3e-1a65-4cc3-847b-38e37f0b26c7 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f30ba8e8-3cdf-4f21-816a-a8ac53d2f6be None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:04:06.368062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:06.369169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:06.370135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:06.370135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:06.370135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:04:06.370135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:04:06.370135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:04:06.370135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:04:06.370135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:04:06.370135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:04:06.370135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 16:04:06.370135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:06.375970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 397/791] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 16 16:04:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:06.379327 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ba8e8-3cdf-4f21-816a-a8ac53d2f6be None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:06.488943 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:06.496016 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:06.548870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ba8e8-3cdf-4f21-816a-a8ac53d2f6be None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:06.579124 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b94a3e-1a65-4cc3-847b-38e37f0b26c7 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:06.588043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492db36-1f9c-4339-b167-db7e97aa28e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:06.589068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492db36-1f9c-4339-b167-db7e97aa28e1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:06.589577 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492db36-1f9c-4339-b167-db7e97aa28e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:06.590152 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492db36-1f9c-4339-b167-db7e97aa28e1 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:06.591496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492db36-1f9c-4339-b167-db7e97aa28e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:06.592055 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492db36-1f9c-4339-b167-db7e97aa28e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:06.593991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492db36-1f9c-4339-b167-db7e97aa28e1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:06.617093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 398/792] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jun 16 16:04:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:06.619001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4db8d2-3ab4-4a06-ad34-cc9768714ad5 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:06.619349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4db8d2-3ab4-4a06-ad34-cc9768714ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:06.619608 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053931c-7704-466c-bc11-2c79b3f2b646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:06.619799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4db8d2-3ab4-4a06-ad34-cc9768714ad5 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:06.620804 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053931c-7704-466c-bc11-2c79b3f2b646 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:06.621306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053931c-7704-466c-bc11-2c79b3f2b646 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:06.621770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053931c-7704-466c-bc11-2c79b3f2b646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:06.627303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 399/793] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:06.628483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4db8d2-3ab4-4a06-ad34-cc9768714ad5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:06.643016 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053931c-7704-466c-bc11-2c79b3f2b646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:06.644959 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053931c-7704-466c-bc11-2c79b3f2b646 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:06.663930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-d053931c-7704-466c-bc11-2c79b3f2b646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:06.663930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:06.663930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:06.663930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:06.663930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:06.663930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:06.663930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:06.663930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:06.663930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:06.663930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:06.663930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:06.663930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:06.663930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:06.663930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:06.663930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:06.664907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:06.665799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:06.665799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:06.665799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:06.665799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:06.668589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 395/794] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:06.670751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177d983-7a7d-4af8-84a7-e9afb2fa7af4 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:06.671387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177d983-7a7d-4af8-84a7-e9afb2fa7af4 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:06.671922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177d983-7a7d-4af8-84a7-e9afb2fa7af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:06.691846 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2177d983-7a7d-4af8-84a7-e9afb2fa7af4 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:06.693814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2177d983-7a7d-4af8-84a7-e9afb2fa7af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:06.744019 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4db8d2-3ab4-4a06-ad34-cc9768714ad5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:06.752397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:06.789207 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 396/795] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:06.790685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177d983-7a7d-4af8-84a7-e9afb2fa7af4 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:06.793066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dea573-6b07-44c7-9008-a502aade103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:06.794256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dea573-6b07-44c7-9008-a502aade103a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:06.795435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dea573-6b07-44c7-9008-a502aade103a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:06.796431 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dea573-6b07-44c7-9008-a502aade103a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:06.811268 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dea573-6b07-44c7-9008-a502aade103a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:06.812838 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dea573-6b07-44c7-9008-a502aade103a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:06.837487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-95dea573-6b07-44c7-9008-a502aade103a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:06.837487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:06.837487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:06.837487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:06.837487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:06.837487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:06.837487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:06.837487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:06.837487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:06.837487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:06.837487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:06.837487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:06.837487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:06.837487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:06.837487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:06.838495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:06.839419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:06.839419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:06.839419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:06.839419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:06.839419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 400/796] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:06.841166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccedc9e-2683-4d05-8e11-27e19303afdc None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:06.842125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccedc9e-2683-4d05-8e11-27e19303afdc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:06.842775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccedc9e-2683-4d05-8e11-27e19303afdc None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:06.844768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 401/797] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:06.845487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccedc9e-2683-4d05-8e11-27e19303afdc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:06.868791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:06.928695 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177d983-7a7d-4af8-84a7-e9afb2fa7af4 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:06.962686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccedc9e-2683-4d05-8e11-27e19303afdc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:06.965810 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e166e6-d002-458d-bc08-5bfaaaea5c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:06.967060 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e166e6-d002-458d-bc08-5bfaaaea5c49 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:06.967344 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e166e6-d002-458d-bc08-5bfaaaea5c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:06.967622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e166e6-d002-458d-bc08-5bfaaaea5c49 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:06.968376 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e166e6-d002-458d-bc08-5bfaaaea5c49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:06.968681 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e166e6-d002-458d-bc08-5bfaaaea5c49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:06.970055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e166e6-d002-458d-bc08-5bfaaaea5c49 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:06.982834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 397/798] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:06.983795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e166e6-d002-458d-bc08-5bfaaaea5c49 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:07.005649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7b2f-2258-466c-9949-ff840143c549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:07.006760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7b2f-2258-466c-9949-ff840143c549 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:07.007340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7b2f-2258-466c-9949-ff840143c549 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:07.007620 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7b2f-2258-466c-9949-ff840143c549 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:07.019429 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7b2f-2258-466c-9949-ff840143c549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-1dad7b2f-2258-466c-9949-ff840143c549 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:04:07.028446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:07.030105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:07.031039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:07.031039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:07.031039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:07.031039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:07.031039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:04:07.031039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:04:07.031039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:04:07.031039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:04:07.031039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:04:07.031039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:04:07.031039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:04:07.031039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:07.031039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 402/799] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:04:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:07.031749 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215183a-e66a-4989-82ca-1921b6dc97c1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:07.032317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215183a-e66a-4989-82ca-1921b6dc97c1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:07.032317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215183a-e66a-4989-82ca-1921b6dc97c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:07.049234 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e215183a-e66a-4989-82ca-1921b6dc97c1 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:07.050419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e215183a-e66a-4989-82ca-1921b6dc97c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:07.064562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:07.102168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e166e6-d002-458d-bc08-5bfaaaea5c49 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:07.105732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:07.130354 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 403/800] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:07.131490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215183a-e66a-4989-82ca-1921b6dc97c1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:07.152030 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91dc75-fdb0-4ee2-820a-81a6bdfc5414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:07.153371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91dc75-fdb0-4ee2-820a-81a6bdfc5414 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:07.153660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91dc75-fdb0-4ee2-820a-81a6bdfc5414 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:07.160091 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91dc75-fdb0-4ee2-820a-81a6bdfc5414 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:07.165773 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91dc75-fdb0-4ee2-820a-81a6bdfc5414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:07.166326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91dc75-fdb0-4ee2-820a-81a6bdfc5414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:07.169276 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91dc75-fdb0-4ee2-820a-81a6bdfc5414 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:07.195364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 398/801] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:07.195364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91dc75-fdb0-4ee2-820a-81a6bdfc5414 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:07.259357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215183a-e66a-4989-82ca-1921b6dc97c1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:07.297263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6aaa01-88b7-4a61-9a07-244612e0f4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:07.298115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6aaa01-88b7-4a61-9a07-244612e0f4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:07.298401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6aaa01-88b7-4a61-9a07-244612e0f4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:07.298725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6aaa01-88b7-4a61-9a07-244612e0f4c8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:07.306028 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6aaa01-88b7-4a61-9a07-244612e0f4c8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:07.307537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6aaa01-88b7-4a61-9a07-244612e0f4c8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:07.322350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91dc75-fdb0-4ee2-820a-81a6bdfc5414 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5b6aaa01-88b7-4a61-9a07-244612e0f4c8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:04:07.322973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:07.323896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:07.324848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:07.324848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:07.324848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:04:07.324848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:04:07.324848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:04:07.324848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:04:07.324848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:04:07.324848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:04:07.324848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 16:04:07.324848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:07.324848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 404/802] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:04:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:07.326801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6aaa01-88b7-4a61-9a07-244612e0f4c8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:07.339374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:07.370885 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c094f4d-4000-4899-a8ed-30ab9b07a209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:07.371667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c094f4d-4000-4899-a8ed-30ab9b07a209 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:07.372017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c094f4d-4000-4899-a8ed-30ab9b07a209 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:07.372362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c094f4d-4000-4899-a8ed-30ab9b07a209 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:07.373840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c094f4d-4000-4899-a8ed-30ab9b07a209 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:07.374126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c094f4d-4000-4899-a8ed-30ab9b07a209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:07.375632 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c094f4d-4000-4899-a8ed-30ab9b07a209 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:07.384855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 399/803] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:04:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:07.385632 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c094f4d-4000-4899-a8ed-30ab9b07a209 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:07.415607 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:07.451573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6aaa01-88b7-4a61-9a07-244612e0f4c8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:07.487402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afde58e-5c9c-4521-b12f-646742e1e8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:07.488208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afde58e-5c9c-4521-b12f-646742e1e8eb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:07.488498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afde58e-5c9c-4521-b12f-646742e1e8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:07.488807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afde58e-5c9c-4521-b12f-646742e1e8eb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:07.489504 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afde58e-5c9c-4521-b12f-646742e1e8eb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:07.490935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afde58e-5c9c-4521-b12f-646742e1e8eb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:07.501460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c094f4d-4000-4899-a8ed-30ab9b07a209 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-2afde58e-5c9c-4521-b12f-646742e1e8eb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:07.504562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:07.505496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:07.506939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 405/804] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jun 16 16:04:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:07.507822 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afde58e-5c9c-4521-b12f-646742e1e8eb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:07.542860 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf009f-214f-4189-8d01-50b2c9dd1056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:07.543582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf009f-214f-4189-8d01-50b2c9dd1056 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:07.543881 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf009f-214f-4189-8d01-50b2c9dd1056 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:07.544135 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf009f-214f-4189-8d01-50b2c9dd1056 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:07.552834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf009f-214f-4189-8d01-50b2c9dd1056 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:07.554647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf009f-214f-4189-8d01-50b2c9dd1056 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:07.570600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-86cf009f-214f-4189-8d01-50b2c9dd1056 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:07.570600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:07.570600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:07.570600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:07.570600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:07.570600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:07.570600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:07.570600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:07.570600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:07.570600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:07.570600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:07.570600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:07.570600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:04:07.570600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:04:07.570600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:07.571975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:07.573248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:04:07.573248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:04:07.573248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:04:07.573248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:04:07.573248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:04:07.573248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:04:07.573248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:07.573248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:07.573248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 400/805] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:07.573248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf009f-214f-4189-8d01-50b2c9dd1056 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:07.587362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:07.625609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afde58e-5c9c-4521-b12f-646742e1e8eb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:07.665185 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8634c9-b368-4eef-b450-f02dc3b28fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:07.665871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8634c9-b368-4eef-b450-f02dc3b28fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:07.666157 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8634c9-b368-4eef-b450-f02dc3b28fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:07.666455 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8634c9-b368-4eef-b450-f02dc3b28fd1 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:07.667308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8634c9-b368-4eef-b450-f02dc3b28fd1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:07.667612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8634c9-b368-4eef-b450-f02dc3b28fd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:07.669069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8634c9-b368-4eef-b450-f02dc3b28fd1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:07.679295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:07.693867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 406/806] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jun 16 16:04:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:07.695487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8634c9-b368-4eef-b450-f02dc3b28fd1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:07.710172 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf009f-214f-4189-8d01-50b2c9dd1056 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:07.752274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3a3f2-b632-40f5-88b0-d11b2f682574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:07.753072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3a3f2-b632-40f5-88b0-d11b2f682574 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:07.753362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3a3f2-b632-40f5-88b0-d11b2f682574 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:07.753646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3a3f2-b632-40f5-88b0-d11b2f682574 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:07.765403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3a3f2-b632-40f5-88b0-d11b2f682574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:07.766908 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3a3f2-b632-40f5-88b0-d11b2f682574 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:07.786326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-0dc3a3f2-b632-40f5-88b0-d11b2f682574 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:07.786326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:07.786326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:07.786326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:07.786326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:07.786326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:07.786326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:07.786326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:07.786326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:07.786326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:07.786326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:07.786326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:07.786326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:07.786326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:07.786326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:07.789867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:07.791592 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:07.791592 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:07.791592 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:07.791592 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:07.791592 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 401/807] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:07.792748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3a3f2-b632-40f5-88b0-d11b2f682574 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:07.818894 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8634c9-b368-4eef-b450-f02dc3b28fd1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:07.858156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:07.864845 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ccaac-3c97-4e26-bbeb-bb531abe8c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:07.865527 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ccaac-3c97-4e26-bbeb-bb531abe8c95 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:07.865802 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ccaac-3c97-4e26-bbeb-bb531abe8c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:07.866081 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ccaac-3c97-4e26-bbeb-bb531abe8c95 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:07.866841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ccaac-3c97-4e26-bbeb-bb531abe8c95 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:07.867113 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ccaac-3c97-4e26-bbeb-bb531abe8c95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:07.868472 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ccaac-3c97-4e26-bbeb-bb531abe8c95 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:07.873878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 407/808] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jun 16 16:04:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:07.874797 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ccaac-3c97-4e26-bbeb-bb531abe8c95 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:07.920214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3a3f2-b632-40f5-88b0-d11b2f682574 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:07.958712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0608e-53e9-4a0a-843f-f393f7178ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:07.959384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0608e-53e9-4a0a-843f-f393f7178ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:07.959672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0608e-53e9-4a0a-843f-f393f7178ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:07.959954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0608e-53e9-4a0a-843f-f393f7178ae5 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:07.960754 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0608e-53e9-4a0a-843f-f393f7178ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:07.961067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0608e-53e9-4a0a-843f-f393f7178ae5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:07.962549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0608e-53e9-4a0a-843f-f393f7178ae5 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:07.971152 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:07.978886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 402/809] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:04:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:07.980364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0219c-46fe-499f-a9fd-03a472d8a3ef None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:07.980658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0219c-46fe-499f-a9fd-03a472d8a3ef None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:07.980937 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0219c-46fe-499f-a9fd-03a472d8a3ef None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:07.982982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 403/810] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:07.987583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0219c-46fe-499f-a9fd-03a472d8a3ef None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:07.991883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ccaac-3c97-4e26-bbeb-bb531abe8c95 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:08.038586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a03c9-8db4-4356-ab35-a50159b9b674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:08.039388 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a03c9-8db4-4356-ab35-a50159b9b674 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:08.039673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a03c9-8db4-4356-ab35-a50159b9b674 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:08.039949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a03c9-8db4-4356-ab35-a50159b9b674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:08.052392 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a03c9-8db4-4356-ab35-a50159b9b674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:08.053854 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a03c9-8db4-4356-ab35-a50159b9b674 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:08.073997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0c7a03c9-8db4-4356-ab35-a50159b9b674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:08.073997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:08.073997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:08.073997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:08.073997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:08.073997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:08.073997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:08.073997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:08.073997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:08.073997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:08.073997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:08.073997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:08.073997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:08.073997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:08.073997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:08.075103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:08.076058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:08.076058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:08.076058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:08.076058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:08.076058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 408/811] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:08.076058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a03c9-8db4-4356-ab35-a50159b9b674 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:08.119176 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0219c-46fe-499f-a9fd-03a472d8a3ef None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:08.128868 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:08.160570 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bdb70-bdce-4132-8b02-668edf86f817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:08.161241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bdb70-bdce-4132-8b02-668edf86f817 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:08.161528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bdb70-bdce-4132-8b02-668edf86f817 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:08.161811 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bdb70-bdce-4132-8b02-668edf86f817 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:08.162576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bdb70-bdce-4132-8b02-668edf86f817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:08.162889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bdb70-bdce-4132-8b02-668edf86f817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:08.164280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bdb70-bdce-4132-8b02-668edf86f817 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:08.182640 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 404/812] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:08.183496 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bdb70-bdce-4132-8b02-668edf86f817 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:08.202724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a03c9-8db4-4356-ab35-a50159b9b674 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:08.240435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f33aa4-45ba-44cd-a44a-5318cb24601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:08.241114 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33aa4-45ba-44cd-a44a-5318cb24601d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:08.241400 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33aa4-45ba-44cd-a44a-5318cb24601d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:08.241676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33aa4-45ba-44cd-a44a-5318cb24601d None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:08.242388 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f33aa4-45ba-44cd-a44a-5318cb24601d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:08.242734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f33aa4-45ba-44cd-a44a-5318cb24601d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:08.244130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f33aa4-45ba-44cd-a44a-5318cb24601d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:08.251202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 409/813] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jun 16 16:04:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:08.252296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621ae85-9814-4b00-8b44-6db361a152fe None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:08.252587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621ae85-9814-4b00-8b44-6db361a152fe None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:08.252871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621ae85-9814-4b00-8b44-6db361a152fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:08.260973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:08.271075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4621ae85-9814-4b00-8b44-6db361a152fe None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:08.272308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4621ae85-9814-4b00-8b44-6db361a152fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:08.315114 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bdb70-bdce-4132-8b02-668edf86f817 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:08.355687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b442f-f235-4477-8b85-d4fe30fc5133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:08.356701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b442f-f235-4477-8b85-d4fe30fc5133 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:08.357558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b442f-f235-4477-8b85-d4fe30fc5133 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:08.357840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b442f-f235-4477-8b85-d4fe30fc5133 None admin] PATH_INFO: `/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/36f7c6f172424967bb7749180711db07/roles/6da95c91bacf48f9870a114e2ab05472` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:08.375825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b442f-f235-4477-8b85-d4fe30fc5133 None admin] RBAC: Authorizing `identity:create_grant(project_id=227cd348bea64e1f89d77ae2cf63a031, user_id=36f7c6f172424967bb7749180711db07, role_id=6da95c91bacf48f9870a114e2ab05472)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:08.377322 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b442f-f235-4477-8b85-d4fe30fc5133 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:08.393160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 405/814] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:04:08 2022] PUT /identity/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/36f7c6f172424967bb7749180711db07/roles/6da95c91bacf48f9870a114e2ab05472 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:04:08.393825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b442f-f235-4477-8b85-d4fe30fc5133 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:08.522671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 410/815] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:08.524347 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621ae85-9814-4b00-8b44-6db361a152fe None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:08.555285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b442f-f235-4477-8b85-d4fe30fc5133 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:08.566940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:08.601305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:08.614966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf13842-f64d-474c-a213-6a4e047e424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:08.615561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf13842-f64d-474c-a213-6a4e047e424b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:08.615850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf13842-f64d-474c-a213-6a4e047e424b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:08.616132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf13842-f64d-474c-a213-6a4e047e424b None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:08.616869 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf13842-f64d-474c-a213-6a4e047e424b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:08.617181 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf13842-f64d-474c-a213-6a4e047e424b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:08.618631 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf13842-f64d-474c-a213-6a4e047e424b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:08.634466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 406/816] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:08.634466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf13842-f64d-474c-a213-6a4e047e424b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:08.684727 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621ae85-9814-4b00-8b44-6db361a152fe None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:08.731814 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cc1e4-6a52-4d6b-8f12-3ad10c39a8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:08.733177 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cc1e4-6a52-4d6b-8f12-3ad10c39a8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:08.733459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cc1e4-6a52-4d6b-8f12-3ad10c39a8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:08.734102 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cc1e4-6a52-4d6b-8f12-3ad10c39a8f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:08.742400 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cc1e4-6a52-4d6b-8f12-3ad10c39a8f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:08.743909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cc1e4-6a52-4d6b-8f12-3ad10c39a8f8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:08.757894 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf13842-f64d-474c-a213-6a4e047e424b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-da7cc1e4-6a52-4d6b-8f12-3ad10c39a8f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:04:08.759025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:08.759971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:08.760937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:08.760937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:08.760937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:04:08.760937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:04:08.760937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:04:08.760937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:04:08.760937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:04:08.760937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:04:08.760937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:04:08.760937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:08.760937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 411/817] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 16 16:04:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:08.761540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cc1e4-6a52-4d6b-8f12-3ad10c39a8f8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:08.804657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918544e9-db51-4399-8458-cbfb35947cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:08.805442 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918544e9-db51-4399-8458-cbfb35947cdc None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:08.805829 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918544e9-db51-4399-8458-cbfb35947cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:08.806193 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918544e9-db51-4399-8458-cbfb35947cdc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:08.806978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918544e9-db51-4399-8458-cbfb35947cdc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:08.808510 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918544e9-db51-4399-8458-cbfb35947cdc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:08.846468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 407/818] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 16 16:04:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:04:08.846468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918544e9-db51-4399-8458-cbfb35947cdc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:08.874325 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:08.878863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cc1e4-6a52-4d6b-8f12-3ad10c39a8f8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:08.891717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:08.931619 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a906b-46ac-4f61-836b-a63f1142d8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:08.932818 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a906b-46ac-4f61-836b-a63f1142d8ef None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:08.933118 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a906b-46ac-4f61-836b-a63f1142d8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:08.933379 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a906b-46ac-4f61-836b-a63f1142d8ef None admin] PATH_INFO: `/v3/services/network` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:08.934042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a906b-46ac-4f61-836b-a63f1142d8ef None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:08.936337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a906b-46ac-4f61-836b-a63f1142d8ef None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0a2a906b-46ac-4f61-836b-a63f1142d8ef None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:08.953781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:08.955093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:08.956376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:08.956376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:08.956376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:08.956376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:08.956376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:08.956376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:08.956376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:08.956376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:08.956376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:08.956376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:08.956376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:08.956376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:08.956376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 16:04:08.956376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:08.958908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 412/819] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:08 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:08.959491 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a906b-46ac-4f61-836b-a63f1142d8ef None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:08.999603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918544e9-db51-4399-8458-cbfb35947cdc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:09.046852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19b7e3-40bd-436b-8685-3e6366b11095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:09.047760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19b7e3-40bd-436b-8685-3e6366b11095 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:09.048119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19b7e3-40bd-436b-8685-3e6366b11095 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:09.048412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19b7e3-40bd-436b-8685-3e6366b11095 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:09.056575 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19b7e3-40bd-436b-8685-3e6366b11095 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:09.058037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19b7e3-40bd-436b-8685-3e6366b11095 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:09.074402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-7d19b7e3-40bd-436b-8685-3e6366b11095 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:09.074402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:09.074402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:09.074402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:09.074402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:09.074402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:09.074402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:09.074402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:09.074402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:09.074402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:09.074402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:09.074402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:09.074402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:04:09.074402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:04:09.074402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:09.075495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:09.077119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:04:09.077119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:04:09.077119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:04:09.077119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:04:09.077119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:04:09.077119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:04:09.077119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:09.077119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:09.077562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 408/820] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:09.078669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19b7e3-40bd-436b-8685-3e6366b11095 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:09.081444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a906b-46ac-4f61-836b-a63f1142d8ef None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:09.122209 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f650f34-9e1b-48c9-b42d-210586f5a097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:09.123463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f650f34-9e1b-48c9-b42d-210586f5a097 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:09.123747 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f650f34-9e1b-48c9-b42d-210586f5a097 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:09.124044 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f650f34-9e1b-48c9-b42d-210586f5a097 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:09.124926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f650f34-9e1b-48c9-b42d-210586f5a097 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:09.125177 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f650f34-9e1b-48c9-b42d-210586f5a097 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:09.126723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f650f34-9e1b-48c9-b42d-210586f5a097 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:09.152908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 413/821] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 16 16:04:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:09.153909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f650f34-9e1b-48c9-b42d-210586f5a097 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:09.175715 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:09.198246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19b7e3-40bd-436b-8685-3e6366b11095 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:09.201476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:09.237165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4587b25-52f5-435c-b249-d24835308705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:09.238222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4587b25-52f5-435c-b249-d24835308705 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:09.238367 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4587b25-52f5-435c-b249-d24835308705 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:09.238783 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4587b25-52f5-435c-b249-d24835308705 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:09.239593 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4587b25-52f5-435c-b249-d24835308705 None admin] RBAC: Adding query filter params (name=network) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:09.240007 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4587b25-52f5-435c-b249-d24835308705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:09.241505 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4587b25-52f5-435c-b249-d24835308705 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:09.247266 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 409/822] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 16 16:04:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:09.249141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4587b25-52f5-435c-b249-d24835308705 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:09.272975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f650f34-9e1b-48c9-b42d-210586f5a097 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:09.314224 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4df2c-8e1a-48f7-84b0-758bdbd533ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:09.315270 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4df2c-8e1a-48f7-84b0-758bdbd533ec None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:09.315706 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4df2c-8e1a-48f7-84b0-758bdbd533ec None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:09.316130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4df2c-8e1a-48f7-84b0-758bdbd533ec None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:09.317093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4df2c-8e1a-48f7-84b0-758bdbd533ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:09.317655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4df2c-8e1a-48f7-84b0-758bdbd533ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:09.319370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4df2c-8e1a-48f7-84b0-758bdbd533ec None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:09.338526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 414/823] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:04:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:09.339724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4df2c-8e1a-48f7-84b0-758bdbd533ec None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:09.360604 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4587b25-52f5-435c-b249-d24835308705 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:09.399175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418ca0f-99a9-4ad8-b6f4-e10090eb9dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:09.399902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418ca0f-99a9-4ad8-b6f4-e10090eb9dcf None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:09.400287 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418ca0f-99a9-4ad8-b6f4-e10090eb9dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:09.400689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418ca0f-99a9-4ad8-b6f4-e10090eb9dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:09.421918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:09.433570 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:09.459154 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4df2c-8e1a-48f7-84b0-758bdbd533ec None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:09.485136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418ca0f-99a9-4ad8-b6f4-e10090eb9dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:09.487008 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418ca0f-99a9-4ad8-b6f4-e10090eb9dcf None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:09.510318 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a2442-5294-41fd-8901-4546445852cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:09.511168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a2442-5294-41fd-8901-4546445852cb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:09.511459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a2442-5294-41fd-8901-4546445852cb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:09.511736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a2442-5294-41fd-8901-4546445852cb None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:09.512558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a2442-5294-41fd-8901-4546445852cb None admin] RBAC: Adding query filter params (type=network) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:09.512865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a2442-5294-41fd-8901-4546445852cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:09.514380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a2442-5294-41fd-8901-4546445852cb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:09.522582 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 415/824] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 16 16:04:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:09.523299 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a2442-5294-41fd-8901-4546445852cb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:09.653697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a2442-5294-41fd-8901-4546445852cb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:09.692203 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24190adb-0db7-4eb2-8ea1-0cb4a503742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:09.693120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24190adb-0db7-4eb2-8ea1-0cb4a503742b None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:09.693407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24190adb-0db7-4eb2-8ea1-0cb4a503742b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:09.693687 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24190adb-0db7-4eb2-8ea1-0cb4a503742b None admin] PATH_INFO: `/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/a8527cbb8efe43d7bb297d779929a50e/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:09.695973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24190adb-0db7-4eb2-8ea1-0cb4a503742b None admin] RBAC: Authorizing `identity:create_grant(project_id=227cd348bea64e1f89d77ae2cf63a031, user_id=a8527cbb8efe43d7bb297d779929a50e, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:09.697430 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24190adb-0db7-4eb2-8ea1-0cb4a503742b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:09.722459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 416/825] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:04:09 2022] PUT /identity/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/a8527cbb8efe43d7bb297d779929a50e/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:04:09.722459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24190adb-0db7-4eb2-8ea1-0cb4a503742b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:09.722993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:09.743212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 410/826] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:04:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:04:09.750200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418ca0f-99a9-4ad8-b6f4-e10090eb9dcf None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:09.850419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24190adb-0db7-4eb2-8ea1-0cb4a503742b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:09.872492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:09.898650 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da0cdd-4b73-4c87-ae5c-4c82b6406345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:09.899344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da0cdd-4b73-4c87-ae5c-4c82b6406345 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:09.899631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da0cdd-4b73-4c87-ae5c-4c82b6406345 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:09.899907 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da0cdd-4b73-4c87-ae5c-4c82b6406345 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:09.900667 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da0cdd-4b73-4c87-ae5c-4c82b6406345 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:09.902061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da0cdd-4b73-4c87-ae5c-4c82b6406345 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:09.947979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 417/827] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 16 16:04:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:04:09.973656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418ca0f-99a9-4ad8-b6f4-e10090eb9dcf None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:10.021421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba757b-b095-4b64-b5d5-934d6493c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:10.022248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba757b-b095-4b64-b5d5-934d6493c348 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:10.022566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba757b-b095-4b64-b5d5-934d6493c348 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:10.022855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba757b-b095-4b64-b5d5-934d6493c348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:10.035109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba757b-b095-4b64-b5d5-934d6493c348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:10.036580 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba757b-b095-4b64-b5d5-934d6493c348 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:10.055803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-0fba757b-b095-4b64-b5d5-934d6493c348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:10.055803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:10.055803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:10.055803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:10.055803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:10.055803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:10.055803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:10.055803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:10.055803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:10.055803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:10.055803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:10.055803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:10.055803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:10.055803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:10.055803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:10.056776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:10.057947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:10.057947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:10.057947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:10.057947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:10.057947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 411/828] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:10.067619 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da0cdd-4b73-4c87-ae5c-4c82b6406345 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:10.164545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:10.224427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da0cdd-4b73-4c87-ae5c-4c82b6406345 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:10.262138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61ff80-b476-4bf0-9b7b-84065e4ca109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:10.262853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61ff80-b476-4bf0-9b7b-84065e4ca109 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:10.263180 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61ff80-b476-4bf0-9b7b-84065e4ca109 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:10.263459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61ff80-b476-4bf0-9b7b-84065e4ca109 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:10.264379 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61ff80-b476-4bf0-9b7b-84065e4ca109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:10.264689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61ff80-b476-4bf0-9b7b-84065e4ca109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:10.266067 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61ff80-b476-4bf0-9b7b-84065e4ca109 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:10.279618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 418/829] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:10.286829 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba757b-b095-4b64-b5d5-934d6493c348 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:10.398889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:10.407154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba757b-b095-4b64-b5d5-934d6493c348 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:10.447138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7716e-d6d5-4e19-be26-c44783a166e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:10.447955 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7716e-d6d5-4e19-be26-c44783a166e5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:10.448240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7716e-d6d5-4e19-be26-c44783a166e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:10.448521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7716e-d6d5-4e19-be26-c44783a166e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:10.461397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7716e-d6d5-4e19-be26-c44783a166e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:10.464078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7716e-d6d5-4e19-be26-c44783a166e5 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:10.479599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-5de7716e-d6d5-4e19-be26-c44783a166e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:10.479599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:10.479599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:10.479599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:10.479599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:10.479599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:10.479599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:10.479599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:10.479599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:10.479599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:10.479599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:10.479599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:10.479599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:04:10.479599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:04:10.479599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:10.480546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:10.481527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:04:10.481527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:04:10.481527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:04:10.481527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:04:10.481527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:04:10.481527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:04:10.481527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:10.481527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:10.481527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 412/830] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:10.486777 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61ff80-b476-4bf0-9b7b-84065e4ca109 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:10.606237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61ff80-b476-4bf0-9b7b-84065e4ca109 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:10.630137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:10.650745 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd8dfe-4fd7-4f11-a3b9-80ec4c440071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:10.651436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8dfe-4fd7-4f11-a3b9-80ec4c440071 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:10.651719 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8dfe-4fd7-4f11-a3b9-80ec4c440071 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:10.651992 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8dfe-4fd7-4f11-a3b9-80ec4c440071 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:10.652803 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd8dfe-4fd7-4f11-a3b9-80ec4c440071 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:10.653114 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd8dfe-4fd7-4f11-a3b9-80ec4c440071 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:10.655649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd8dfe-4fd7-4f11-a3b9-80ec4c440071 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:10.674689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 419/831] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:04:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:10.676252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7716e-d6d5-4e19-be26-c44783a166e5 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:10.725134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1f786-675f-48a0-b44a-616ec2b2cc00 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:10.725428 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1f786-675f-48a0-b44a-616ec2b2cc00 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:10.725697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1f786-675f-48a0-b44a-616ec2b2cc00 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:10.727965 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 420/832] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:10.734866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d4618-4c48-4e6b-b308-ba7b5457de72 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:10.735090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d4618-4c48-4e6b-b308-ba7b5457de72 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:10.735372 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d4618-4c48-4e6b-b308-ba7b5457de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:10.758422 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b94d4618-4c48-4e6b-b308-ba7b5457de72 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:10.759657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b94d4618-4c48-4e6b-b308-ba7b5457de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:10.795475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7716e-d6d5-4e19-be26-c44783a166e5 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:10.838686 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22808018-a58b-42e4-b681-e417e9618c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:10.839451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22808018-a58b-42e4-b681-e417e9618c14 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:10.839745 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22808018-a58b-42e4-b681-e417e9618c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:10.840125 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22808018-a58b-42e4-b681-e417e9618c14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:10.840972 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22808018-a58b-42e4-b681-e417e9618c14 None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=795c029cb14b42b5b0f3987e218d4239) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:10.842578 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22808018-a58b-42e4-b681-e417e9618c14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:10.844259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22808018-a58b-42e4-b681-e417e9618c14 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:10.851125 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 413/833] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:04:10 2022] GET /identity/v3/role_assignments?user.id=795c029cb14b42b5b0f3987e218d4239&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:10.851373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 421/834] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:10.876694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22808018-a58b-42e4-b681-e417e9618c14 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:10.903371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:10.997605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22808018-a58b-42e4-b681-e417e9618c14 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:11.039956 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec3b39-1f7a-4bbc-848d-e90b265c4567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:11.040757 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec3b39-1f7a-4bbc-848d-e90b265c4567 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:11.041045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec3b39-1f7a-4bbc-848d-e90b265c4567 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:11.041324 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec3b39-1f7a-4bbc-848d-e90b265c4567 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:11.053018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec3b39-1f7a-4bbc-848d-e90b265c4567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-d3ec3b39-1f7a-4bbc-848d-e90b265c4567 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:04:11.062138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:11.063375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:11.064527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:11.064527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:11.064527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:11.064527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:11.064527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:04:11.064527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:04:11.064527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:04:11.064527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:04:11.064527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:04:11.064527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:04:11.064527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:04:11.064527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:11.064527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 414/835] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:04:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:11.069440 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d4618-4c48-4e6b-b308-ba7b5457de72 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:11.197308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d4618-4c48-4e6b-b308-ba7b5457de72 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:11.211162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:11.236515 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc99ccc-08ae-4c25-ab89-4acda2e75f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:11.237188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99ccc-08ae-4c25-ab89-4acda2e75f9f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:11.237466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99ccc-08ae-4c25-ab89-4acda2e75f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:11.237738 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99ccc-08ae-4c25-ab89-4acda2e75f9f None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:11.238503 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc99ccc-08ae-4c25-ab89-4acda2e75f9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:11.238809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc99ccc-08ae-4c25-ab89-4acda2e75f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:11.240167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc99ccc-08ae-4c25-ab89-4acda2e75f9f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:11.249287 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 422/836] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:04:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:11.254660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec3b39-1f7a-4bbc-848d-e90b265c4567 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:11.354932 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:11.371697 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec3b39-1f7a-4bbc-848d-e90b265c4567 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:11.407540 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b20cd-73e7-40c0-aaf0-47ef3c239b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:11.408434 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b20cd-73e7-40c0-aaf0-47ef3c239b96 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:11.408720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b20cd-73e7-40c0-aaf0-47ef3c239b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:11.408997 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b20cd-73e7-40c0-aaf0-47ef3c239b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:11.409830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24007bc8-61d2-4b88-9c89-74da08234e3a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:11.410124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24007bc8-61d2-4b88-9c89-74da08234e3a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:11.410407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24007bc8-61d2-4b88-9c89-74da08234e3a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:11.412066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 423/837] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:11.417138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85905-111e-472d-94af-eebb9c4746fd None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:11.417421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85905-111e-472d-94af-eebb9c4746fd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:11.417697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85905-111e-472d-94af-eebb9c4746fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:11.421558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b20cd-73e7-40c0-aaf0-47ef3c239b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:11.423155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b20cd-73e7-40c0-aaf0-47ef3c239b96 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:11.435846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-97c85905-111e-472d-94af-eebb9c4746fd None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:11.437025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-97c85905-111e-472d-94af-eebb9c4746fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:11.441428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-fd5b20cd-73e7-40c0-aaf0-47ef3c239b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:11.441428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:11.441428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:11.441428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:11.441428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:11.441428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:11.441428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:11.441428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:11.441428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:11.441428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:11.441428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:11.441428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:11.441428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:11.441428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:11.441428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:11.442310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:11.443255 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:11.443255 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:11.443255 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:11.443255 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:11.443255 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 415/838] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:11.451520 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b20cd-73e7-40c0-aaf0-47ef3c239b96 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:11.526611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 424/839] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:11.547911 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85905-111e-472d-94af-eebb9c4746fd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:11.576524 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b20cd-73e7-40c0-aaf0-47ef3c239b96 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:11.609543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:11.616246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2b283-032b-449b-a034-4ac0a46ead18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:11.617166 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2b283-032b-449b-a034-4ac0a46ead18 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:11.617599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2b283-032b-449b-a034-4ac0a46ead18 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:11.618028 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2b283-032b-449b-a034-4ac0a46ead18 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:11.618951 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2b283-032b-449b-a034-4ac0a46ead18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:11.619434 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2b283-032b-449b-a034-4ac0a46ead18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:11.620958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2b283-032b-449b-a034-4ac0a46ead18 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:11.641044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 416/840] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:11.642224 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2b283-032b-449b-a034-4ac0a46ead18 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:11.651534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:11.655691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85905-111e-472d-94af-eebb9c4746fd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:11.694988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb1cd7-e80f-4e5b-bab0-9b0eec006027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:11.696293 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb1cd7-e80f-4e5b-bab0-9b0eec006027 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:11.696722 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb1cd7-e80f-4e5b-bab0-9b0eec006027 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:11.697141 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb1cd7-e80f-4e5b-bab0-9b0eec006027 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:11.697962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb1cd7-e80f-4e5b-bab0-9b0eec006027 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:11.699502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb1cd7-e80f-4e5b-bab0-9b0eec006027 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6afb1cd7-e80f-4e5b-bab0-9b0eec006027 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:11.712104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:11.713348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:11.714386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:11.714386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:11.714386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:11.714386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:11.714386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:11.714386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:11.714386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:11.714386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:11.714386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:11.714386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:11.714386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:11.714386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:11.714386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 16:04:11.714386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:11.721882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 425/841] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:04:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:11.723105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb1cd7-e80f-4e5b-bab0-9b0eec006027 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:11.759525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2b283-032b-449b-a034-4ac0a46ead18 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:11.799015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95d152-ec3e-44d1-a35e-2dfd85d1dc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:11.799757 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95d152-ec3e-44d1-a35e-2dfd85d1dc77 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:11.800042 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95d152-ec3e-44d1-a35e-2dfd85d1dc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:11.800408 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95d152-ec3e-44d1-a35e-2dfd85d1dc77 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:11.808191 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95d152-ec3e-44d1-a35e-2dfd85d1dc77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:11.809650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95d152-ec3e-44d1-a35e-2dfd85d1dc77 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-0d95d152-ec3e-44d1-a35e-2dfd85d1dc77 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:04:11.826242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:11.827455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:11.828594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:11.828594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:11.828594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:04:11.828594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:04:11.828594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:04:11.828594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:04:11.828594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:04:11.828594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:04:11.828594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 16:04:11.828594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:11.832283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 417/842] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 16 16:04:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:11.833279 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95d152-ec3e-44d1-a35e-2dfd85d1dc77 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:11.837563 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb1cd7-e80f-4e5b-bab0-9b0eec006027 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:11.875434 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263add3-0e0a-4b8d-8359-2db13f3fe52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:11.876382 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263add3-0e0a-4b8d-8359-2db13f3fe52b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:11.876813 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263add3-0e0a-4b8d-8359-2db13f3fe52b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:11.877233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263add3-0e0a-4b8d-8359-2db13f3fe52b None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:11.878506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263add3-0e0a-4b8d-8359-2db13f3fe52b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:11.878997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263add3-0e0a-4b8d-8359-2db13f3fe52b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:11.880512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263add3-0e0a-4b8d-8359-2db13f3fe52b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:11.890283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 426/843] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:04:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:11.891361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263add3-0e0a-4b8d-8359-2db13f3fe52b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:11.899374 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:11.923315 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:11.957164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95d152-ec3e-44d1-a35e-2dfd85d1dc77 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:11.998293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c81d66-dee7-48fc-89d6-ed6320251e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:11.999025 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c81d66-dee7-48fc-89d6-ed6320251e58 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:11.999313 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c81d66-dee7-48fc-89d6-ed6320251e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:11.999592 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c81d66-dee7-48fc-89d6-ed6320251e58 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:12.000442 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c81d66-dee7-48fc-89d6-ed6320251e58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:12.000755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c81d66-dee7-48fc-89d6-ed6320251e58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:12.000988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263add3-0e0a-4b8d-8359-2db13f3fe52b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:12.002198 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c81d66-dee7-48fc-89d6-ed6320251e58 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:12.029730 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 418/844] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jun 16 16:04:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:12.031367 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c81d66-dee7-48fc-89d6-ed6320251e58 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:12.038479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f523f9-e9b4-43f5-8897-3b451c101df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:12.039339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f523f9-e9b4-43f5-8897-3b451c101df4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:12.039791 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f523f9-e9b4-43f5-8897-3b451c101df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:12.040226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f523f9-e9b4-43f5-8897-3b451c101df4 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:12.041089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f523f9-e9b4-43f5-8897-3b451c101df4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:12.041538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f523f9-e9b4-43f5-8897-3b451c101df4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:12.043065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f523f9-e9b4-43f5-8897-3b451c101df4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:12.054602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 427/845] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:04:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:12.162218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c81d66-dee7-48fc-89d6-ed6320251e58 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:12.177504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:12.179060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961defd-f9ea-4437-a462-b22425237c0c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:12.179561 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961defd-f9ea-4437-a462-b22425237c0c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:12.179561 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961defd-f9ea-4437-a462-b22425237c0c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:12.181450 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 428/846] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:12.188187 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59f91e-b193-4bd7-85fd-53a548465c3e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:12.189015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59f91e-b193-4bd7-85fd-53a548465c3e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:12.189493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59f91e-b193-4bd7-85fd-53a548465c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:12.207244 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9219-c339-46fa-b736-77f980380623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:12.207923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9219-c339-46fa-b736-77f980380623 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:12.208212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9219-c339-46fa-b736-77f980380623 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:12.208492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9219-c339-46fa-b736-77f980380623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:12.209643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8a59f91e-b193-4bd7-85fd-53a548465c3e None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:12.211149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8a59f91e-b193-4bd7-85fd-53a548465c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:12.295127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed9219-c339-46fa-b736-77f980380623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:12.295623 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 429/847] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:12.302448 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed9219-c339-46fa-b736-77f980380623 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:12.319220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59f91e-b193-4bd7-85fd-53a548465c3e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:12.356446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:12.443125 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 419/848] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:04:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:04:12.445555 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9219-c339-46fa-b736-77f980380623 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:12.458799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:12.464403 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59f91e-b193-4bd7-85fd-53a548465c3e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:12.502961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2cebd-4b5e-4af7-8d90-1afb6d2fb6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:12.504130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2cebd-4b5e-4af7-8d90-1afb6d2fb6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:12.504643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2cebd-4b5e-4af7-8d90-1afb6d2fb6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:12.505137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2cebd-4b5e-4af7-8d90-1afb6d2fb6c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:12.517337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2cebd-4b5e-4af7-8d90-1afb6d2fb6c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-70f2cebd-4b5e-4af7-8d90-1afb6d2fb6c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:04:12.525585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:12.526564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:12.527411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:12.527411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:12.527411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:12.527411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:12.527411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:04:12.527411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:04:12.527411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:04:12.527411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:04:12.527411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:04:12.527411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:04:12.527411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:04:12.527411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:12.536105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 430/849] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:04:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:12.537741 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2cebd-4b5e-4af7-8d90-1afb6d2fb6c3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:12.573667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9219-c339-46fa-b736-77f980380623 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:12.610797 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c99937-f38e-4781-948e-8c3ce3c7ab9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:12.611641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c99937-f38e-4781-948e-8c3ce3c7ab9c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:12.611925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c99937-f38e-4781-948e-8c3ce3c7ab9c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:12.612203 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c99937-f38e-4781-948e-8c3ce3c7ab9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:12.624156 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c99937-f38e-4781-948e-8c3ce3c7ab9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:12.625618 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c99937-f38e-4781-948e-8c3ce3c7ab9c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:12.643915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-b2c99937-f38e-4781-948e-8c3ce3c7ab9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:12.643915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:12.643915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:12.643915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:12.643915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:12.643915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:12.643915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:12.643915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:12.643915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:12.643915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:12.643915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:12.643915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:12.643915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:12.643915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:12.643915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:12.644882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:12.645765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:12.645765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:12.645765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:12.645765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:12.649133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:12.650102 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 420/850] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:12.651108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c99937-f38e-4781-948e-8c3ce3c7ab9c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:12.670878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2cebd-4b5e-4af7-8d90-1afb6d2fb6c3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:12.708521 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf0005-f17e-45f9-8003-1f8d119815f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:12.709568 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf0005-f17e-45f9-8003-1f8d119815f5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:12.710047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf0005-f17e-45f9-8003-1f8d119815f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:12.710559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf0005-f17e-45f9-8003-1f8d119815f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:12.711513 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf0005-f17e-45f9-8003-1f8d119815f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:12.712026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf0005-f17e-45f9-8003-1f8d119815f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:12.713577 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf0005-f17e-45f9-8003-1f8d119815f5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:12.727511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 431/851] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:04:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:12.729027 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf0005-f17e-45f9-8003-1f8d119815f5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:12.730902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:12.759499 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c99937-f38e-4781-948e-8c3ce3c7ab9c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:12.798053 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14d6f3-020c-4e6a-8ba1-9ab2e29bdeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:12.801534 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14d6f3-020c-4e6a-8ba1-9ab2e29bdeb4 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:12.802033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14d6f3-020c-4e6a-8ba1-9ab2e29bdeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:12.802549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14d6f3-020c-4e6a-8ba1-9ab2e29bdeb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:12.803539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14d6f3-020c-4e6a-8ba1-9ab2e29bdeb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:12.804140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14d6f3-020c-4e6a-8ba1-9ab2e29bdeb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:12.805782 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14d6f3-020c-4e6a-8ba1-9ab2e29bdeb4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:12.826623 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 421/852] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:12.831562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14d6f3-020c-4e6a-8ba1-9ab2e29bdeb4 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:12.859742 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf0005-f17e-45f9-8003-1f8d119815f5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:12.906372 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503284ca-2355-4081-aa88-db9d79327d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:12.907753 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503284ca-2355-4081-aa88-db9d79327d42 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:12.908244 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503284ca-2355-4081-aa88-db9d79327d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:12.909080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503284ca-2355-4081-aa88-db9d79327d42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:12.925316 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503284ca-2355-4081-aa88-db9d79327d42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:12.929472 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503284ca-2355-4081-aa88-db9d79327d42 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:12.936174 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:12.963543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14d6f3-020c-4e6a-8ba1-9ab2e29bdeb4 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:12.969015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-503284ca-2355-4081-aa88-db9d79327d42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:12.969015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:12.969015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:12.969015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:12.969015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:12.969015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:12.969015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:12.969015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:12.969015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:12.969015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:12.969015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:12.969015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:12.969015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:12.969015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:12.969015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:12.969939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:12.970874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:12.970874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:12.970874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:12.970874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:12.973270 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 432/853] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:12.980828 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503284ca-2355-4081-aa88-db9d79327d42 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:12.996222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:13.011333 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e943c05-2ea3-434a-928d-d1e967507ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:13.013416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e943c05-2ea3-434a-928d-d1e967507ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:13.013928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e943c05-2ea3-434a-928d-d1e967507ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:13.014651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e943c05-2ea3-434a-928d-d1e967507ce8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:13.024380 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e943c05-2ea3-434a-928d-d1e967507ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:13.026176 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e943c05-2ea3-434a-928d-d1e967507ce8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:13.044762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-0e943c05-2ea3-434a-928d-d1e967507ce8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:13.044762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:13.044762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:13.044762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:13.044762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:13.044762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:13.044762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:13.044762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:13.044762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:13.044762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:13.044762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:13.044762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:13.044762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:04:13.044762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:04:13.044762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:13.045717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:13.046669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:04:13.046669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:04:13.046669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:04:13.046669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:04:13.046669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:04:13.046669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:04:13.046669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:13.046669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:13.050809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 422/854] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:13.052262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e943c05-2ea3-434a-928d-d1e967507ce8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:13.108665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503284ca-2355-4081-aa88-db9d79327d42 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:13.144164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd731710-47c7-432d-b681-6c4d45b34170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:13.145201 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd731710-47c7-432d-b681-6c4d45b34170 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:13.145707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd731710-47c7-432d-b681-6c4d45b34170 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:13.146206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd731710-47c7-432d-b681-6c4d45b34170 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:13.147154 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd731710-47c7-432d-b681-6c4d45b34170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:13.147620 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd731710-47c7-432d-b681-6c4d45b34170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:13.148987 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd731710-47c7-432d-b681-6c4d45b34170 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:13.162281 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 433/855] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:13.166737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed02df-d7c2-46c1-b1f2-6d862b2a3bbc None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:13.166737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed02df-d7c2-46c1-b1f2-6d862b2a3bbc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:13.166737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed02df-d7c2-46c1-b1f2-6d862b2a3bbc None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:13.166737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 434/856] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:13.168079 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed02df-d7c2-46c1-b1f2-6d862b2a3bbc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:13.177507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e943c05-2ea3-434a-928d-d1e967507ce8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:13.214963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42969e94-5e75-437e-9f50-3980228ae0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:13.215743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42969e94-5e75-437e-9f50-3980228ae0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:13.216142 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42969e94-5e75-437e-9f50-3980228ae0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:13.217056 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42969e94-5e75-437e-9f50-3980228ae0a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:13.217860 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42969e94-5e75-437e-9f50-3980228ae0a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:13.218174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42969e94-5e75-437e-9f50-3980228ae0a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:13.219634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42969e94-5e75-437e-9f50-3980228ae0a8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:13.237172 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 423/857] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:04:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:13.237172 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4b53d-cb49-4d91-bb49-af9b61f6eb08 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:13.237172 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4b53d-cb49-4d91-bb49-af9b61f6eb08 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:13.237172 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4b53d-cb49-4d91-bb49-af9b61f6eb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:13.240674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:13.254314 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-10e4b53d-cb49-4d91-bb49-af9b61f6eb08 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:13.255771 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-10e4b53d-cb49-4d91-bb49-af9b61f6eb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:13.296757 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed02df-d7c2-46c1-b1f2-6d862b2a3bbc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:13.301534 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:13.336422 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f785d6-e599-4590-80dc-db2eaf068086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:13.337234 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f785d6-e599-4590-80dc-db2eaf068086 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:13.337507 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f785d6-e599-4590-80dc-db2eaf068086 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:13.337781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f785d6-e599-4590-80dc-db2eaf068086 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:13.342988 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 424/858] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:13.344364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4b53d-cb49-4d91-bb49-af9b61f6eb08 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:13.356507 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f785d6-e599-4590-80dc-db2eaf068086 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:13.360154 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f785d6-e599-4590-80dc-db2eaf068086 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e7f785d6-e599-4590-80dc-db2eaf068086 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:04:13.382004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:13.383138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:13.384165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:13.384165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:13.384165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:04:13.384165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:04:13.384165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:04:13.384165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:04:13.384165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:04:13.384165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:04:13.384165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 16:04:13.384165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:13.384165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 435/859] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:04:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:13.384165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f785d6-e599-4590-80dc-db2eaf068086 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:13.471604 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4b53d-cb49-4d91-bb49-af9b61f6eb08 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:13.491206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f785d6-e599-4590-80dc-db2eaf068086 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:13.507251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfea74-229d-4cee-850f-8d36226f4a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:13.507922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfea74-229d-4cee-850f-8d36226f4a2c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:13.508195 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfea74-229d-4cee-850f-8d36226f4a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:13.508473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfea74-229d-4cee-850f-8d36226f4a2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:13.509300 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfea74-229d-4cee-850f-8d36226f4a2c None admin] RBAC: Adding query filter params (role.id=6da95c91bacf48f9870a114e2ab05472, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=36f7c6f172424967bb7749180711db07) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:13.509611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfea74-229d-4cee-850f-8d36226f4a2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:13.510398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:13.511069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfea74-229d-4cee-850f-8d36226f4a2c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:13.517655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 425/860] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:04:13 2022] GET /identity/v3/role_assignments?user.id=36f7c6f172424967bb7749180711db07&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=6da95c91bacf48f9870a114e2ab05472 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:13.518469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfea74-229d-4cee-850f-8d36226f4a2c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:13.541695 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9823705-90a6-4e70-a991-ab784a8ca9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:13.542904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9823705-90a6-4e70-a991-ab784a8ca9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:13.543384 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9823705-90a6-4e70-a991-ab784a8ca9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:13.543962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9823705-90a6-4e70-a991-ab784a8ca9c9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:13.544748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9823705-90a6-4e70-a991-ab784a8ca9c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:13.546352 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9823705-90a6-4e70-a991-ab784a8ca9c9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e9823705-90a6-4e70-a991-ab784a8ca9c9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:13.560640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:13.562097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:13.563205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:13.563205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:13.563205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:13.563205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:13.563205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:13.563205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:13.563205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:13.563205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:13.563205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:13.563205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:13.563205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:13.563205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:13.563205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:13.563205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 16:04:13.563205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:13.569279 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:13.569648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 436/861] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jun 16 16:04:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:13.571939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9823705-90a6-4e70-a991-ab784a8ca9c9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:13.666894 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfea74-229d-4cee-850f-8d36226f4a2c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:13.712958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9823705-90a6-4e70-a991-ab784a8ca9c9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:13.725121 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4493392-d5ae-4b36-a59e-16e9375f7ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:13.726083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4493392-d5ae-4b36-a59e-16e9375f7ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:13.726569 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4493392-d5ae-4b36-a59e-16e9375f7ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:13.727006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4493392-d5ae-4b36-a59e-16e9375f7ab2 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:13.728133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4493392-d5ae-4b36-a59e-16e9375f7ab2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:13.728612 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4493392-d5ae-4b36-a59e-16e9375f7ab2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:13.730300 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4493392-d5ae-4b36-a59e-16e9375f7ab2 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:13.751135 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 426/862] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jun 16 16:04:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:13.756219 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70472d9e-429e-4563-86a0-e4ddf644f3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:13.756775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4493392-d5ae-4b36-a59e-16e9375f7ab2 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:13.756897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70472d9e-429e-4563-86a0-e4ddf644f3ab None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:13.757158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70472d9e-429e-4563-86a0-e4ddf644f3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:13.757432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70472d9e-429e-4563-86a0-e4ddf644f3ab None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:13.758133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70472d9e-429e-4563-86a0-e4ddf644f3ab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:13.758463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70472d9e-429e-4563-86a0-e4ddf644f3ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:13.760169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70472d9e-429e-4563-86a0-e4ddf644f3ab None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:13.768157 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 437/863] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 16 16:04:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:13.774015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70472d9e-429e-4563-86a0-e4ddf644f3ab None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:13.825594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:13.872078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:13.882520 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4493392-d5ae-4b36-a59e-16e9375f7ab2 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:13.897065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70472d9e-429e-4563-86a0-e4ddf644f3ab None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:13.921480 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d863a60-c464-4fb3-81b0-2e8143790599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:13.922139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d863a60-c464-4fb3-81b0-2e8143790599 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:13.922608 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d863a60-c464-4fb3-81b0-2e8143790599 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:13.922893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d863a60-c464-4fb3-81b0-2e8143790599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:13.941302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0455ab-dd37-49b8-ab85-f3f3c70eaaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:13.942089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0455ab-dd37-49b8-ab85-f3f3c70eaaee None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:13.942738 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0455ab-dd37-49b8-ab85-f3f3c70eaaee None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:13.943019 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0455ab-dd37-49b8-ab85-f3f3c70eaaee None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:13.943741 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0455ab-dd37-49b8-ab85-f3f3c70eaaee None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:13.944192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0455ab-dd37-49b8-ab85-f3f3c70eaaee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:13.946092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0455ab-dd37-49b8-ab85-f3f3c70eaaee None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:13.954553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 438/864] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 16 16:04:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:14.021789 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d863a60-c464-4fb3-81b0-2e8143790599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:14.023612 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d863a60-c464-4fb3-81b0-2e8143790599 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:14.144152 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:14.158279 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 427/865] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:04:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 16:04:14.159673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0455ab-dd37-49b8-ab85-f3f3c70eaaee None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:14.275686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0455ab-dd37-49b8-ab85-f3f3c70eaaee None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:14.285406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:14.312924 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4d8ea-2ce5-44d0-ab68-350f3d55c1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:14.313767 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4d8ea-2ce5-44d0-ab68-350f3d55c1ab None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:14.314054 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4d8ea-2ce5-44d0-ab68-350f3d55c1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:14.314330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4d8ea-2ce5-44d0-ab68-350f3d55c1ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:14.328309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4d8ea-2ce5-44d0-ab68-350f3d55c1ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:14.329807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4d8ea-2ce5-44d0-ab68-350f3d55c1ab None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:14.351192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-d4b4d8ea-2ce5-44d0-ab68-350f3d55c1ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:14.351192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:14.351192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:14.351192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:14.351192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:14.351192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:14.351192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:14.351192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:14.351192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:14.351192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:14.351192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:14.351192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:14.351192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:14.351192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:14.351192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:14.352404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:14.353335 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:14.353335 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:14.353335 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:14.353335 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:14.353335 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 439/866] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:14.359945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d863a60-c464-4fb3-81b0-2e8143790599 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:14.391314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fd6ed-f54a-4548-8cbb-d09b1594d816 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:14.391519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fd6ed-f54a-4548-8cbb-d09b1594d816 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:14.391773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fd6ed-f54a-4548-8cbb-d09b1594d816 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:14.393412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 440/867] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:14.398648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe483e-a1eb-454f-9195-7726005e5b11 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:14.398941 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe483e-a1eb-454f-9195-7726005e5b11 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:14.399221 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe483e-a1eb-454f-9195-7726005e5b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:14.418172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e9fe483e-a1eb-454f-9195-7726005e5b11 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:14.420872 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e9fe483e-a1eb-454f-9195-7726005e5b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:14.477454 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d863a60-c464-4fb3-81b0-2e8143790599 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:14.505236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 441/868] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:14.516275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc710a-62b9-48cc-8003-2289527c5a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:14.517266 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc710a-62b9-48cc-8003-2289527c5a63 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:14.517760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc710a-62b9-48cc-8003-2289527c5a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:14.518254 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc710a-62b9-48cc-8003-2289527c5a63 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:14.519214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc710a-62b9-48cc-8003-2289527c5a63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:14.519718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc710a-62b9-48cc-8003-2289527c5a63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:14.521312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc710a-62b9-48cc-8003-2289527c5a63 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:14.523847 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe483e-a1eb-454f-9195-7726005e5b11 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:14.539017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 428/869] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:14.540736 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc710a-62b9-48cc-8003-2289527c5a63 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:14.604586 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:14.641861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:14.652214 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe483e-a1eb-454f-9195-7726005e5b11 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:14.658851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc710a-62b9-48cc-8003-2289527c5a63 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:14.693680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babfbce-fa53-47d5-a4e9-d9c3fd5a0adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:14.694352 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babfbce-fa53-47d5-a4e9-d9c3fd5a0adf None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:14.694676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babfbce-fa53-47d5-a4e9-d9c3fd5a0adf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:14.694952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babfbce-fa53-47d5-a4e9-d9c3fd5a0adf None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:14.695924 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babfbce-fa53-47d5-a4e9-d9c3fd5a0adf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:14.697306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babfbce-fa53-47d5-a4e9-d9c3fd5a0adf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:14.697716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095bec2-10ac-4c02-9ad6-b6ce0b1d6130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:14.698731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095bec2-10ac-4c02-9ad6-b6ce0b1d6130 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:14.699282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095bec2-10ac-4c02-9ad6-b6ce0b1d6130 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:14.699769 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095bec2-10ac-4c02-9ad6-b6ce0b1d6130 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:14.708641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095bec2-10ac-4c02-9ad6-b6ce0b1d6130 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:14.710498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095bec2-10ac-4c02-9ad6-b6ce0b1d6130 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:14.718858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 442/870] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 16 16:04:14 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:04:14.727384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-8095bec2-10ac-4c02-9ad6-b6ce0b1d6130 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:14.727384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:14.727384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:14.727384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:14.727384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:14.727384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:14.727384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:14.727384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:14.727384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:14.727384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:14.727384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:14.727384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:14.727384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:04:14.727384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:04:14.727384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:14.728636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:14.729762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:04:14.729762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:04:14.729762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:04:14.729762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:04:14.729762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:04:14.729762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:04:14.729762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:14.729762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:14.732227 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 429/871] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:14.738200 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babfbce-fa53-47d5-a4e9-d9c3fd5a0adf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:14.879575 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babfbce-fa53-47d5-a4e9-d9c3fd5a0adf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:14.916674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbc8cb-933e-499e-afdd-47f65abbff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:14.917355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbc8cb-933e-499e-afdd-47f65abbff2f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:14.917639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbc8cb-933e-499e-afdd-47f65abbff2f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:14.917913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbc8cb-933e-499e-afdd-47f65abbff2f None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:14.919916 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbc8cb-933e-499e-afdd-47f65abbff2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:14.919916 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbc8cb-933e-499e-afdd-47f65abbff2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:14.921141 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbc8cb-933e-499e-afdd-47f65abbff2f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:14.934145 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 443/872] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:04:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:14.940772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095bec2-10ac-4c02-9ad6-b6ce0b1d6130 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:15.056959 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095bec2-10ac-4c02-9ad6-b6ce0b1d6130 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:15.073822 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:15.096096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed765c52-07fd-4fcb-a23d-680c6d7a58e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:15.097148 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed765c52-07fd-4fcb-a23d-680c6d7a58e3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:15.097639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed765c52-07fd-4fcb-a23d-680c6d7a58e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:15.098142 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed765c52-07fd-4fcb-a23d-680c6d7a58e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:15.099206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed765c52-07fd-4fcb-a23d-680c6d7a58e3 None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=a8527cbb8efe43d7bb297d779929a50e) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:15.099743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed765c52-07fd-4fcb-a23d-680c6d7a58e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:15.101377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed765c52-07fd-4fcb-a23d-680c6d7a58e3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:15.108315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 430/873] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:04:14 2022] GET /identity/v3/role_assignments?user.id=a8527cbb8efe43d7bb297d779929a50e&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:15.956253 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df88892-d31f-4837-8451-89ea18c4ccd3 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:15.956774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df88892-d31f-4837-8451-89ea18c4ccd3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:15.956884 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df88892-d31f-4837-8451-89ea18c4ccd3 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:15.958472 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 444/874] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:15.963641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1341c7-478e-4173-a2cc-5c2304fe2f8b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:15.963938 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1341c7-478e-4173-a2cc-5c2304fe2f8b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:15.964227 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1341c7-478e-4173-a2cc-5c2304fe2f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:15.982265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-de1341c7-478e-4173-a2cc-5c2304fe2f8b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:15.984163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-de1341c7-478e-4173-a2cc-5c2304fe2f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:16.060949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 431/875] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:16.085007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df88892-d31f-4837-8451-89ea18c4ccd3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:16.095546 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:16.201708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df88892-d31f-4837-8451-89ea18c4ccd3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:16.240574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd650fa-15a7-4287-bcf7-43e8c8ea4c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:16.241538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd650fa-15a7-4287-bcf7-43e8c8ea4c40 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:16.241827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd650fa-15a7-4287-bcf7-43e8c8ea4c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:16.242107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd650fa-15a7-4287-bcf7-43e8c8ea4c40 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:16.255500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd650fa-15a7-4287-bcf7-43e8c8ea4c40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-1cd650fa-15a7-4287-bcf7-43e8c8ea4c40 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:04:16.264046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:16.265008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:16.265877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:16.265877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:16.265877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:16.265877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:16.265877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:04:16.265877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:04:16.265877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:04:16.265877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:04:16.265877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:04:16.265877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:04:16.265877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 16:04:16.265877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:16.265877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 445/876] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jun 16 16:04:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:16.271172 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1341c7-478e-4173-a2cc-5c2304fe2f8b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:16.293404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec048b07-8c06-473a-9ab3-061f3e01bf56 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:16.293720 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec048b07-8c06-473a-9ab3-061f3e01bf56 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:16.294383 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec048b07-8c06-473a-9ab3-061f3e01bf56 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:16.295550 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 446/877] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:16.300355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d32c0-0994-4983-a0a2-1adbe72164a8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:16.300647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d32c0-0994-4983-a0a2-1adbe72164a8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:16.300949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d32c0-0994-4983-a0a2-1adbe72164a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:16.318588 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b81d32c0-0994-4983-a0a2-1adbe72164a8 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:16.319887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b81d32c0-0994-4983-a0a2-1adbe72164a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:16.386940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1341c7-478e-4173-a2cc-5c2304fe2f8b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:16.399287 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:16.413700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:16.426106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 447/878] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:16.432487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498aeb1-8d0e-43e9-843d-bff0748e147b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:16.433172 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498aeb1-8d0e-43e9-843d-bff0748e147b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:16.433456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498aeb1-8d0e-43e9-843d-bff0748e147b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:16.433733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498aeb1-8d0e-43e9-843d-bff0748e147b None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:16.434517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498aeb1-8d0e-43e9-843d-bff0748e147b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:16.435341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498aeb1-8d0e-43e9-843d-bff0748e147b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:16.436710 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498aeb1-8d0e-43e9-843d-bff0748e147b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:16.445914 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 432/879] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jun 16 16:04:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:16.452412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d32c0-0994-4983-a0a2-1adbe72164a8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:16.453776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498aeb1-8d0e-43e9-843d-bff0748e147b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:16.573320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498aeb1-8d0e-43e9-843d-bff0748e147b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:16.582334 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d32c0-0994-4983-a0a2-1adbe72164a8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:16.611914 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad830bf-bdf7-48dc-8705-ddcef42b074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:16.612972 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad830bf-bdf7-48dc-8705-ddcef42b074b None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:16.613515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad830bf-bdf7-48dc-8705-ddcef42b074b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:16.614094 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad830bf-bdf7-48dc-8705-ddcef42b074b None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:16.615034 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad830bf-bdf7-48dc-8705-ddcef42b074b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:16.616748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad830bf-bdf7-48dc-8705-ddcef42b074b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:16.630804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312fbc7-5f24-4b96-af98-57c2a5329316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:16.631798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312fbc7-5f24-4b96-af98-57c2a5329316 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:16.632000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312fbc7-5f24-4b96-af98-57c2a5329316 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:16.632249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312fbc7-5f24-4b96-af98-57c2a5329316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:16.646485 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 433/880] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 16 16:04:16 2022] POST /identity/v3/services => generated 269 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:04:16.652353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312fbc7-5f24-4b96-af98-57c2a5329316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:16.655131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312fbc7-5f24-4b96-af98-57c2a5329316 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:16.677260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8312fbc7-5f24-4b96-af98-57c2a5329316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:16.677260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:16.677260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:16.677260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:16.677260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:16.677260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:16.677260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:16.677260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:16.677260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:16.677260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:16.677260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:16.677260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:16.677260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:16.677260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:16.677260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:16.680733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:16.682083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:16.682083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:16.682083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:16.682083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:16.684127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 448/881] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:16.692404 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad830bf-bdf7-48dc-8705-ddcef42b074b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:16.733879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:16.826937 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad830bf-bdf7-48dc-8705-ddcef42b074b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:16.864127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7524384-0414-4d51-91d3-1fcd63904882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:16.864896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7524384-0414-4d51-91d3-1fcd63904882 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:16.865181 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7524384-0414-4d51-91d3-1fcd63904882 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:16.865451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7524384-0414-4d51-91d3-1fcd63904882 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:16.866172 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7524384-0414-4d51-91d3-1fcd63904882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:16.866494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7524384-0414-4d51-91d3-1fcd63904882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:16.867855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7524384-0414-4d51-91d3-1fcd63904882 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:16.881614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 434/882] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:16.887290 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312fbc7-5f24-4b96-af98-57c2a5329316 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:16.946893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:17.009788 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312fbc7-5f24-4b96-af98-57c2a5329316 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:17.037570 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd39302-31a7-4648-8430-d00c2ae2e132 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:17.037884 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd39302-31a7-4648-8430-d00c2ae2e132 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:17.038133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd39302-31a7-4648-8430-d00c2ae2e132 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:17.040868 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 435/883] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:17.046162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc71454-0df9-49ea-a234-ee5f4cbd4938 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:17.046162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc71454-0df9-49ea-a234-ee5f4cbd4938 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:17.046510 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc71454-0df9-49ea-a234-ee5f4cbd4938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:17.053645 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea45c70-3afe-4be4-91f0-de071e82aeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:17.054864 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea45c70-3afe-4be4-91f0-de071e82aeac None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:17.055371 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea45c70-3afe-4be4-91f0-de071e82aeac None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:17.055862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea45c70-3afe-4be4-91f0-de071e82aeac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:17.064299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3bc71454-0df9-49ea-a234-ee5f4cbd4938 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:17.065454 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3bc71454-0df9-49ea-a234-ee5f4cbd4938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:17.066251 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea45c70-3afe-4be4-91f0-de071e82aeac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:17.068247 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea45c70-3afe-4be4-91f0-de071e82aeac None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-2ea45c70-3afe-4be4-91f0-de071e82aeac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:04:17.090469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:17.092730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:17.093686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:17.093686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:17.093686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:04:17.093686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:04:17.093686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:04:17.093686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:04:17.093686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:04:17.093686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:04:17.093686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 16:04:17.093686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:17.096678 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 449/884] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 16 16:04:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:17.102123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea45c70-3afe-4be4-91f0-de071e82aeac None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:17.149547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 436/885] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:17.173379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc71454-0df9-49ea-a234-ee5f4cbd4938 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:17.191524 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:17.232497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea45c70-3afe-4be4-91f0-de071e82aeac None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:17.243039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:17.271881 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024110ae-7ecd-426a-9107-b0e7edff154f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:17.272757 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024110ae-7ecd-426a-9107-b0e7edff154f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:17.273146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024110ae-7ecd-426a-9107-b0e7edff154f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:17.273518 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024110ae-7ecd-426a-9107-b0e7edff154f None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:17.275049 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024110ae-7ecd-426a-9107-b0e7edff154f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:17.275049 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024110ae-7ecd-426a-9107-b0e7edff154f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:17.276695 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024110ae-7ecd-426a-9107-b0e7edff154f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:17.300832 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 450/886] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jun 16 16:04:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:17.310525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024110ae-7ecd-426a-9107-b0e7edff154f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:17.311253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc71454-0df9-49ea-a234-ee5f4cbd4938 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:17.351997 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8ed74-2c2f-4593-8a70-96d88efe4d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:17.352733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8ed74-2c2f-4593-8a70-96d88efe4d95 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:17.353023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8ed74-2c2f-4593-8a70-96d88efe4d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:17.353299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8ed74-2c2f-4593-8a70-96d88efe4d95 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:17.353951 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8ed74-2c2f-4593-8a70-96d88efe4d95 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:17.355360 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8ed74-2c2f-4593-8a70-96d88efe4d95 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-a5e8ed74-2c2f-4593-8a70-96d88efe4d95 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:17.368140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:17.369129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:17.373917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:17.373917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:17.373917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:17.373917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:17.373917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:17.373917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:17.373917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:17.373917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:17.373917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:17.373917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:17.373917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:17.373917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:17.373917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 16:04:17.373917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:17.373917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 437/887] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:04:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:17.376476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92986f93-c0fb-4fb8-946a-da2498727959 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:17.376476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92986f93-c0fb-4fb8-946a-da2498727959 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:17.376476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92986f93-c0fb-4fb8-946a-da2498727959 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:17.376476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 438/888] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:17.378328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47d233-5cc2-43b8-9c7a-2462402be205 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:17.378657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47d233-5cc2-43b8-9c7a-2462402be205 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:17.378944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47d233-5cc2-43b8-9c7a-2462402be205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:17.396408 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-fc47d233-5cc2-43b8-9c7a-2462402be205 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:17.397611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fc47d233-5cc2-43b8-9c7a-2462402be205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:17.427748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024110ae-7ecd-426a-9107-b0e7edff154f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:17.467197 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9f489-7d49-49c6-835c-9651c2d356c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:17.467652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9f489-7d49-49c6-835c-9651c2d356c6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:17.467963 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9f489-7d49-49c6-835c-9651c2d356c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:17.468246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9f489-7d49-49c6-835c-9651c2d356c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:17.478630 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 439/889] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:17.478630 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47d233-5cc2-43b8-9c7a-2462402be205 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:17.489218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:17.506664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:17.545784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9f489-7d49-49c6-835c-9651c2d356c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:17.547296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9f489-7d49-49c6-835c-9651c2d356c6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:17.593615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47d233-5cc2-43b8-9c7a-2462402be205 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:17.633605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df15b0f-c478-414e-b09f-b592262019fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:17.634197 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df15b0f-c478-414e-b09f-b592262019fe None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:17.634538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df15b0f-c478-414e-b09f-b592262019fe None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:17.634798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df15b0f-c478-414e-b09f-b592262019fe None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:17.635539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df15b0f-c478-414e-b09f-b592262019fe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:17.635821 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df15b0f-c478-414e-b09f-b592262019fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:17.637211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df15b0f-c478-414e-b09f-b592262019fe None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:17.643600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 440/890] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:04:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:17.644184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df15b0f-c478-414e-b09f-b592262019fe None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:17.665294 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 451/891] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:04:17 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:04:17.665294 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9f489-7d49-49c6-835c-9651c2d356c6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:17.729645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:17.735999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:17.757063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df15b0f-c478-414e-b09f-b592262019fe None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:17.779069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9f489-7d49-49c6-835c-9651c2d356c6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:17.793366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d97776-4a2b-4b08-b6b7-178fdcc8e17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:17.794044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d97776-4a2b-4b08-b6b7-178fdcc8e17f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:17.794859 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d97776-4a2b-4b08-b6b7-178fdcc8e17f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:17.795142 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d97776-4a2b-4b08-b6b7-178fdcc8e17f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:17.795909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d97776-4a2b-4b08-b6b7-178fdcc8e17f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:17.797292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d97776-4a2b-4b08-b6b7-178fdcc8e17f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-86d97776-4a2b-4b08-b6b7-178fdcc8e17f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:17.809429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:17.810527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:17.811471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:17.811471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:17.811471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:17.811471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:17.811471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:17.811471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:17.811471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:17.811471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:17.811471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:17.811471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:17.811471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:17.811471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:17.811471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 16:04:17.811471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:17.811471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 441/892] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 16 16:04:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:17.812286 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d97776-4a2b-4b08-b6b7-178fdcc8e17f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:17.824506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ef8c2-b967-4b8d-ad43-6504d465f6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:17.825188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ef8c2-b967-4b8d-ad43-6504d465f6dd None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:17.825535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ef8c2-b967-4b8d-ad43-6504d465f6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:17.826685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ef8c2-b967-4b8d-ad43-6504d465f6dd None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:17.827439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ef8c2-b967-4b8d-ad43-6504d465f6dd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:17.827811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ef8c2-b967-4b8d-ad43-6504d465f6dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:17.829263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ef8c2-b967-4b8d-ad43-6504d465f6dd None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:17.835658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 452/893] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:04:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:17.836571 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ef8c2-b967-4b8d-ad43-6504d465f6dd None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:17.938509 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d97776-4a2b-4b08-b6b7-178fdcc8e17f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:17.963391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ef8c2-b967-4b8d-ad43-6504d465f6dd None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:17.977931 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dad638-187b-4a95-8035-03db138989f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:17.978764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dad638-187b-4a95-8035-03db138989f8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:17.979063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dad638-187b-4a95-8035-03db138989f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:17.979363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dad638-187b-4a95-8035-03db138989f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:17.988919 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:17.995601 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dad638-187b-4a95-8035-03db138989f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:17.998366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dad638-187b-4a95-8035-03db138989f8 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:17.999199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:18.007493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca5a26-1c5c-4835-90b1-49941cb0acb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:18.008364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca5a26-1c5c-4835-90b1-49941cb0acb9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:18.008766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca5a26-1c5c-4835-90b1-49941cb0acb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:18.008766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca5a26-1c5c-4835-90b1-49941cb0acb9 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:18.009431 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca5a26-1c5c-4835-90b1-49941cb0acb9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:18.009744 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca5a26-1c5c-4835-90b1-49941cb0acb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:18.011172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca5a26-1c5c-4835-90b1-49941cb0acb9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:18.016468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 453/894] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 16 16:04:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:18.017289 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca5a26-1c5c-4835-90b1-49941cb0acb9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:18.020791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-79dad638-187b-4a95-8035-03db138989f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:18.020791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:18.020791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:18.020791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:18.020791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:18.020791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:18.020791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:18.020791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:18.020791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:18.020791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:18.020791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:18.020791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:18.020791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:18.020791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:18.020791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:18.021744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:18.022722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:18.022722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:18.022722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:18.022722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:18.022722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 442/895] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:18.023258 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dad638-187b-4a95-8035-03db138989f8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:18.139417 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dad638-187b-4a95-8035-03db138989f8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:18.142850 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca5a26-1c5c-4835-90b1-49941cb0acb9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:18.176381 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41ed6b-f455-43f4-932a-f91919682445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:18.177058 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41ed6b-f455-43f4-932a-f91919682445 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:18.177350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41ed6b-f455-43f4-932a-f91919682445 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:18.177629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41ed6b-f455-43f4-932a-f91919682445 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:18.178345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41ed6b-f455-43f4-932a-f91919682445 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:18.178690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41ed6b-f455-43f4-932a-f91919682445 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:18.180059 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41ed6b-f455-43f4-932a-f91919682445 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:18.184547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 443/896] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 16 16:04:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:18.185353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a199201-8b41-4604-839e-2223a243ddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:18.185966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41ed6b-f455-43f4-932a-f91919682445 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:18.186608 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a199201-8b41-4604-839e-2223a243ddee None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:18.186900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a199201-8b41-4604-839e-2223a243ddee None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:18.187182 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a199201-8b41-4604-839e-2223a243ddee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:18.187997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a199201-8b41-4604-839e-2223a243ddee None admin] RBAC: Adding query filter params (interface=public, service_id=c8c7f760750d41c88e59a5a0b5e2bedd, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:18.188316 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a199201-8b41-4604-839e-2223a243ddee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:18.189800 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a199201-8b41-4604-839e-2223a243ddee None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:18.202818 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 454/897] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 16 16:04:18 2022] GET /identity/v3/endpoints?service_id=c8c7f760750d41c88e59a5a0b5e2bedd&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:18.203960 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a199201-8b41-4604-839e-2223a243ddee None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:18.267912 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:18.297295 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:18.345936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41ed6b-f455-43f4-932a-f91919682445 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:18.353527 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a199201-8b41-4604-839e-2223a243ddee None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:18.402625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebd4ec-20b8-442f-9261-ebd330d2701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:18.405119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebd4ec-20b8-442f-9261-ebd330d2701c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:18.405413 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebd4ec-20b8-442f-9261-ebd330d2701c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:18.406064 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33a0d4-ab8c-46a7-894b-387008bff99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:18.406202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebd4ec-20b8-442f-9261-ebd330d2701c None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:18.406536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebd4ec-20b8-442f-9261-ebd330d2701c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:18.406748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33a0d4-ab8c-46a7-894b-387008bff99c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:18.407125 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33a0d4-ab8c-46a7-894b-387008bff99c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:18.407411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33a0d4-ab8c-46a7-894b-387008bff99c None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:18.407935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebd4ec-20b8-442f-9261-ebd330d2701c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:18.408150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33a0d4-ab8c-46a7-894b-387008bff99c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:18.408463 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33a0d4-ab8c-46a7-894b-387008bff99c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:18.410476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33a0d4-ab8c-46a7-894b-387008bff99c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:18.414682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 455/898] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 16 16:04:18 2022] GET /identity/v3/services => generated 1268 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:04:18.428996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 444/899] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:18.434660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebd4ec-20b8-442f-9261-ebd330d2701c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:18.556841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebd4ec-20b8-442f-9261-ebd330d2701c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:18.586253 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:18.599061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d6937-539a-4748-bbbe-a51759c99319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:18.600178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d6937-539a-4748-bbbe-a51759c99319 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:18.600656 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d6937-539a-4748-bbbe-a51759c99319 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:18.601096 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d6937-539a-4748-bbbe-a51759c99319 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:18.609109 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d6937-539a-4748-bbbe-a51759c99319 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:18.610870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d6937-539a-4748-bbbe-a51759c99319 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:18.625957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-214d6937-539a-4748-bbbe-a51759c99319 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:18.625957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:18.625957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:18.625957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:18.625957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:18.625957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:18.625957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:18.625957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:18.625957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:18.625957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:18.625957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:18.625957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:18.625957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:04:18.625957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:04:18.625957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:18.626905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:18.627816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:04:18.627816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:04:18.627816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:04:18.627816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:04:18.627816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:04:18.627816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:04:18.627816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:18.627816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:18.629961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 456/900] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:18.635425 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33a0d4-ab8c-46a7-894b-387008bff99c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:18.744601 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33a0d4-ab8c-46a7-894b-387008bff99c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:18.760458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:18.786129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779495af-e00b-4602-b129-25609a4ad3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:18.786840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779495af-e00b-4602-b129-25609a4ad3db None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:18.787127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779495af-e00b-4602-b129-25609a4ad3db None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:18.787405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779495af-e00b-4602-b129-25609a4ad3db None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:18.788199 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779495af-e00b-4602-b129-25609a4ad3db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:18.788508 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779495af-e00b-4602-b129-25609a4ad3db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:18.789934 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779495af-e00b-4602-b129-25609a4ad3db None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:18.802666 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 445/901] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:04:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:18.811644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d6937-539a-4748-bbbe-a51759c99319 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:18.932399 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d6937-539a-4748-bbbe-a51759c99319 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:18.951753 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fce2b-6308-4046-a04c-f4c9feedc584 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:18.952069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fce2b-6308-4046-a04c-f4c9feedc584 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:18.952331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fce2b-6308-4046-a04c-f4c9feedc584 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:18.957704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 446/902] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:18.959344 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d512bfd-7c69-4c37-84be-ffaaa69cd8d1 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:18.959639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d512bfd-7c69-4c37-84be-ffaaa69cd8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:18.959925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d512bfd-7c69-4c37-84be-ffaaa69cd8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:18.975225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac689f-5499-4858-a91a-2847aa2aa0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:18.975896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac689f-5499-4858-a91a-2847aa2aa0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:18.976184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac689f-5499-4858-a91a-2847aa2aa0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:18.976461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac689f-5499-4858-a91a-2847aa2aa0a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:18.977300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac689f-5499-4858-a91a-2847aa2aa0a9 None admin] RBAC: Adding query filter params (role.id=74eb0d20197044ea95b7e71c9a8b329c, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=36f7c6f172424967bb7749180711db07) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:18.977617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac689f-5499-4858-a91a-2847aa2aa0a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:18.978357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-8d512bfd-7c69-4c37-84be-ffaaa69cd8d1 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:18.979258 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac689f-5499-4858-a91a-2847aa2aa0a9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:18.979580 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8d512bfd-7c69-4c37-84be-ffaaa69cd8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:18.987423 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 457/903] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:04:18 2022] GET /identity/v3/role_assignments?user.id=36f7c6f172424967bb7749180711db07&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=74eb0d20197044ea95b7e71c9a8b329c => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:19.065229 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 447/904] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:19.087723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac689f-5499-4858-a91a-2847aa2aa0a9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:19.141362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:19.211319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac689f-5499-4858-a91a-2847aa2aa0a9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:19.248905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db14824-4868-4af4-b1ab-7163e0f0d1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:19.250066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db14824-4868-4af4-b1ab-7163e0f0d1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:19.250579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db14824-4868-4af4-b1ab-7163e0f0d1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:19.251071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db14824-4868-4af4-b1ab-7163e0f0d1f9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:19.252080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db14824-4868-4af4-b1ab-7163e0f0d1f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:19.253653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db14824-4868-4af4-b1ab-7163e0f0d1f9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-2db14824-4868-4af4-b1ab-7163e0f0d1f9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:19.267061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:19.268036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:19.268904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:19.268904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:19.268904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:19.268904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:19.268904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:19.268904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:19.268904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:19.268904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:19.268904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:19.268904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:19.268904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:19.268904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:19.268904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:19.268904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 16:04:19.268904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:19.271840 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 458/905] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jun 16 16:04:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:19.278987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d512bfd-7c69-4c37-84be-ffaaa69cd8d1 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:19.389660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d512bfd-7c69-4c37-84be-ffaaa69cd8d1 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:19.392092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:19.426119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76412db-257e-4173-a3a7-9bf9bb259c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:19.426815 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76412db-257e-4173-a3a7-9bf9bb259c64 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:19.427098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76412db-257e-4173-a3a7-9bf9bb259c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:19.427375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76412db-257e-4173-a3a7-9bf9bb259c64 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:19.428075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76412db-257e-4173-a3a7-9bf9bb259c64 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:19.428378 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76412db-257e-4173-a3a7-9bf9bb259c64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:19.429738 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76412db-257e-4173-a3a7-9bf9bb259c64 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:19.434849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 448/906] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 16 16:04:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:19.440406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db14824-4868-4af4-b1ab-7163e0f0d1f9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:19.557795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db14824-4868-4af4-b1ab-7163e0f0d1f9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:19.568749 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:19.595256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cf2c4-ce5b-4339-b9cc-c99ef72a7931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:19.595933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cf2c4-ce5b-4339-b9cc-c99ef72a7931 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:19.596218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cf2c4-ce5b-4339-b9cc-c99ef72a7931 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:19.596495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cf2c4-ce5b-4339-b9cc-c99ef72a7931 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:19.597204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cf2c4-ce5b-4339-b9cc-c99ef72a7931 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:19.597509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cf2c4-ce5b-4339-b9cc-c99ef72a7931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:19.598913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cf2c4-ce5b-4339-b9cc-c99ef72a7931 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:19.604305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 459/907] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 16 16:04:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:19.610582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76412db-257e-4173-a3a7-9bf9bb259c64 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:19.715443 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76412db-257e-4173-a3a7-9bf9bb259c64 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:19.752598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a5223-35e2-419d-8508-90f216eb7f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:19.753328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a5223-35e2-419d-8508-90f216eb7f0b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:19.753609 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a5223-35e2-419d-8508-90f216eb7f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:19.753886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a5223-35e2-419d-8508-90f216eb7f0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:19.754754 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a5223-35e2-419d-8508-90f216eb7f0b None admin] RBAC: Adding query filter params (interface=public, service_id=a445bb6c6c8a49fc9a7bebad1face70f, region_id=RegionOne) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:19.755066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a5223-35e2-419d-8508-90f216eb7f0b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:19.756427 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a5223-35e2-419d-8508-90f216eb7f0b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:19.762029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 449/908] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 16 16:04:19 2022] GET /identity/v3/endpoints?service_id=a445bb6c6c8a49fc9a7bebad1face70f&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:19.767906 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cf2c4-ce5b-4339-b9cc-c99ef72a7931 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:19.875168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cf2c4-ce5b-4339-b9cc-c99ef72a7931 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:19.909872 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545bbc8-7b44-406c-a3c9-90042339fd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:19.910572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545bbc8-7b44-406c-a3c9-90042339fd07 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:19.910861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545bbc8-7b44-406c-a3c9-90042339fd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:19.911142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545bbc8-7b44-406c-a3c9-90042339fd07 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:19.911825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545bbc8-7b44-406c-a3c9-90042339fd07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:19.913193 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545bbc8-7b44-406c-a3c9-90042339fd07 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:19.924050 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 460/909] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 16 16:04:19 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:04:20.564056 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835efaf-7227-40ff-bd50-89db5926bcff None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:20.566168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835efaf-7227-40ff-bd50-89db5926bcff None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:20.566785 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835efaf-7227-40ff-bd50-89db5926bcff None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:20.568678 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 450/910] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:20.574605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36567d3-1a90-4022-b7cd-ec066d94a6b7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:20.577174 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36567d3-1a90-4022-b7cd-ec066d94a6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:20.577690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36567d3-1a90-4022-b7cd-ec066d94a6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:20.595063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e36567d3-1a90-4022-b7cd-ec066d94a6b7 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:20.596570 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e36567d3-1a90-4022-b7cd-ec066d94a6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:20.629405 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:20.668579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 461/911] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:20.692823 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835efaf-7227-40ff-bd50-89db5926bcff None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:20.726902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:20.827483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15398e78-99ab-4ddc-8c58-cefbd6a60021 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:20.827918 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15398e78-99ab-4ddc-8c58-cefbd6a60021 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:20.828074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15398e78-99ab-4ddc-8c58-cefbd6a60021 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:20.829718 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 462/912] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:20.834648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727a451-3ef7-4140-a7e4-51f578386221 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:20.834954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727a451-3ef7-4140-a7e4-51f578386221 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:20.835215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727a451-3ef7-4140-a7e4-51f578386221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:20.852505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c727a451-3ef7-4140-a7e4-51f578386221 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:20.853686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c727a451-3ef7-4140-a7e4-51f578386221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:20.860692 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835efaf-7227-40ff-bd50-89db5926bcff None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:20.920159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766dbba-e119-4706-8dbc-3b22b191abf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:20.921241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766dbba-e119-4706-8dbc-3b22b191abf4 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:20.921728 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766dbba-e119-4706-8dbc-3b22b191abf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:20.922219 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766dbba-e119-4706-8dbc-3b22b191abf4 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:20.923556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766dbba-e119-4706-8dbc-3b22b191abf4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:20.925959 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766dbba-e119-4706-8dbc-3b22b191abf4 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:20.931363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 463/913] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:20.947109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 451/914] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 16 16:04:20 2022] POST /identity/v3/services => generated 241 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:04:20.961622 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727a451-3ef7-4140-a7e4-51f578386221 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:21.080709 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:21.084979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727a451-3ef7-4140-a7e4-51f578386221 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:21.129642 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9e6f1-311b-4dc9-bc04-a642061ca9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:21.130458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9e6f1-311b-4dc9-bc04-a642061ca9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:21.130756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9e6f1-311b-4dc9-bc04-a642061ca9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:21.131026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9e6f1-311b-4dc9-bc04-a642061ca9e9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:21.131678 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9e6f1-311b-4dc9-bc04-a642061ca9e9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:21.133089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9e6f1-311b-4dc9-bc04-a642061ca9e9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-82f9e6f1-311b-4dc9-bc04-a642061ca9e9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:21.144971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:21.146682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:21.148202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:21.148202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:21.148202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:21.148202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:21.148202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:21.148202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:21.148202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:21.148202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:21.148202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:21.148202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:21.148202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:21.148202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:21.148202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 16:04:21.148202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:21.148202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 464/915] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:04:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:21.152567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766dbba-e119-4706-8dbc-3b22b191abf4 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:21.256981 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:21.267497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766dbba-e119-4706-8dbc-3b22b191abf4 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:21.304002 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1a78e-db28-4986-be1f-1c00803f4a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:21.304681 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1a78e-db28-4986-be1f-1c00803f4a32 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:21.304973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1a78e-db28-4986-be1f-1c00803f4a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:21.305259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1a78e-db28-4986-be1f-1c00803f4a32 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:21.305974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1a78e-db28-4986-be1f-1c00803f4a32 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:21.306289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1a78e-db28-4986-be1f-1c00803f4a32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:21.307698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1a78e-db28-4986-be1f-1c00803f4a32 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:21.317799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 452/916] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:04:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:21.319441 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9e6f1-311b-4dc9-bc04-a642061ca9e9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:21.430544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9e6f1-311b-4dc9-bc04-a642061ca9e9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:21.468683 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e3234-b12f-49c0-a6ed-39658233b813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:21.469361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e3234-b12f-49c0-a6ed-39658233b813 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:21.469645 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e3234-b12f-49c0-a6ed-39658233b813 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:21.469921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e3234-b12f-49c0-a6ed-39658233b813 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:21.470725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e3234-b12f-49c0-a6ed-39658233b813 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:21.471030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e3234-b12f-49c0-a6ed-39658233b813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:21.472402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e3234-b12f-49c0-a6ed-39658233b813 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:21.478037 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 465/917] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 16 16:04:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:21.483863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaa4ce-3d4c-46ad-9a36-95ee619f093e None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:21.484154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaa4ce-3d4c-46ad-9a36-95ee619f093e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:21.484439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaa4ce-3d4c-46ad-9a36-95ee619f093e None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:21.485926 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 453/918] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:21.486733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e3234-b12f-49c0-a6ed-39658233b813 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:21.491941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375cfca-b690-4934-a505-ae8efa09261d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:21.492480 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375cfca-b690-4934-a505-ae8efa09261d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:21.492973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375cfca-b690-4934-a505-ae8efa09261d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:21.511514 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f375cfca-b690-4934-a505-ae8efa09261d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:21.513671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f375cfca-b690-4934-a505-ae8efa09261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:21.514245 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:21.593575 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e3234-b12f-49c0-a6ed-39658233b813 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:21.602661 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 454/919] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:21.628515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375cfca-b690-4934-a505-ae8efa09261d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:21.644177 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bd945-4ec5-450f-bf1f-70ea54f661b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:21.645707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd945-4ec5-450f-bf1f-70ea54f661b7 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:21.646283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd945-4ec5-450f-bf1f-70ea54f661b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:21.646765 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd945-4ec5-450f-bf1f-70ea54f661b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:21.647967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bd945-4ec5-450f-bf1f-70ea54f661b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:21.649880 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bd945-4ec5-450f-bf1f-70ea54f661b7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:21.682644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 466/920] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 16 16:04:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:04:21.734678 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:21.753225 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375cfca-b690-4934-a505-ae8efa09261d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:21.802226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb590cc-0f17-40ba-be69-7bca42a5906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:21.803060 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb590cc-0f17-40ba-be69-7bca42a5906f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:21.803349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb590cc-0f17-40ba-be69-7bca42a5906f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:21.803690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb590cc-0f17-40ba-be69-7bca42a5906f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:21.816938 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb590cc-0f17-40ba-be69-7bca42a5906f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-1eb590cc-0f17-40ba-be69-7bca42a5906f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:04:21.826412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:21.827579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:21.828708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:21.828708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:21.828708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:21.828708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:21.828708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:04:21.828708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:04:21.828708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:04:21.828708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:04:21.828708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:04:21.828708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:04:21.828708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 16:04:21.828708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:21.828708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 455/921] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jun 16 16:04:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:21.839682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bd945-4ec5-450f-bf1f-70ea54f661b7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:21.927293 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:21.951557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bd945-4ec5-450f-bf1f-70ea54f661b7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:21.986875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bb64d-60a2-4992-8849-ff7d74b0e55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:21.987551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bb64d-60a2-4992-8849-ff7d74b0e55e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:21.987831 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bb64d-60a2-4992-8849-ff7d74b0e55e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:21.988104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bb64d-60a2-4992-8849-ff7d74b0e55e None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:21.988849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bb64d-60a2-4992-8849-ff7d74b0e55e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:21.989156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bb64d-60a2-4992-8849-ff7d74b0e55e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:21.990541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bb64d-60a2-4992-8849-ff7d74b0e55e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:21.999165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 467/922] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jun 16 16:04:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:22.004555 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb590cc-0f17-40ba-be69-7bca42a5906f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:22.115604 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb590cc-0f17-40ba-be69-7bca42a5906f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:22.154943 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e31a17-eb92-4974-b1b1-709590a9d1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:22.156150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e31a17-eb92-4974-b1b1-709590a9d1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:22.156642 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e31a17-eb92-4974-b1b1-709590a9d1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:22.157126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e31a17-eb92-4974-b1b1-709590a9d1a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:22.169403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e31a17-eb92-4974-b1b1-709590a9d1a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:22.171260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e31a17-eb92-4974-b1b1-709590a9d1a0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:22.173388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:22.191949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-30e31a17-eb92-4974-b1b1-709590a9d1a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:22.191949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:22.191949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:22.191949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:22.191949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:22.191949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:22.191949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:22.191949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:22.191949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:22.191949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:22.191949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:22.191949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:22.191949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:22.191949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:22.191949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:22.192940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:22.193938 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:22.193938 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:22.193938 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:22.193938 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:22.202355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 456/923] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:22.204191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bb64d-60a2-4992-8849-ff7d74b0e55e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:22.268474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c41711-9b5a-4ac2-a986-b150553a14f7 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:22.268755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c41711-9b5a-4ac2-a986-b150553a14f7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:22.269241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c41711-9b5a-4ac2-a986-b150553a14f7 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:22.270905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 457/924] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:22.276012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ac17d-f4d1-4673-be95-d5ffdfd6282c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:22.276300 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ac17d-f4d1-4673-be95-d5ffdfd6282c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:22.276584 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ac17d-f4d1-4673-be95-d5ffdfd6282c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:22.295162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3c4ac17d-f4d1-4673-be95-d5ffdfd6282c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:22.296598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3c4ac17d-f4d1-4673-be95-d5ffdfd6282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:22.313364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bb64d-60a2-4992-8849-ff7d74b0e55e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:22.376714 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8baea-17e6-4ab6-a237-309e2cbd8c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:22.377973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8baea-17e6-4ab6-a237-309e2cbd8c65 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:22.378494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8baea-17e6-4ab6-a237-309e2cbd8c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:22.379111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8baea-17e6-4ab6-a237-309e2cbd8c65 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:22.379806 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 458/925] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:22.380348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8baea-17e6-4ab6-a237-309e2cbd8c65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:22.380843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8baea-17e6-4ab6-a237-309e2cbd8c65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:22.382290 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8baea-17e6-4ab6-a237-309e2cbd8c65 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:22.392709 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:22.401653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 468/926] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:22.404039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ac17d-f4d1-4673-be95-d5ffdfd6282c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:22.405766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8baea-17e6-4ab6-a237-309e2cbd8c65 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:22.531162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ac17d-f4d1-4673-be95-d5ffdfd6282c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:22.532063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8baea-17e6-4ab6-a237-309e2cbd8c65 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:22.560392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:22.579584 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d58f2-4e50-405a-ba10-80cb5912171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:22.580761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d58f2-4e50-405a-ba10-80cb5912171c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:22.581189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d58f2-4e50-405a-ba10-80cb5912171c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:22.581709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d58f2-4e50-405a-ba10-80cb5912171c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:22.584352 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438e65e-d9d3-46f9-b6d7-e28c5fde14ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:22.585859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438e65e-d9d3-46f9-b6d7-e28c5fde14ae None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:22.586151 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438e65e-d9d3-46f9-b6d7-e28c5fde14ae None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:22.586449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438e65e-d9d3-46f9-b6d7-e28c5fde14ae None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:22.587125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438e65e-d9d3-46f9-b6d7-e28c5fde14ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:22.588510 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438e65e-d9d3-46f9-b6d7-e28c5fde14ae None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:22.593246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d58f2-4e50-405a-ba10-80cb5912171c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:22.595603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d58f2-4e50-405a-ba10-80cb5912171c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e438e65e-d9d3-46f9-b6d7-e28c5fde14ae None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:22.605480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:22.606995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:22.607862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 469/927] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jun 16 16:04:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-f31d58f2-4e50-405a-ba10-80cb5912171c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:04:22.615110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:22.616320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:22.617251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:22.617251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:22.617251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:04:22.617251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:04:22.617251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:04:22.617251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:04:22.617251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:04:22.617251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:04:22.617251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 16:04:22.617251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:22.617823 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438e65e-d9d3-46f9-b6d7-e28c5fde14ae None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:22.619574 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 459/928] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 16 16:04:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:22.626138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d58f2-4e50-405a-ba10-80cb5912171c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:22.686596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:22.728485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438e65e-d9d3-46f9-b6d7-e28c5fde14ae None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:22.734173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d58f2-4e50-405a-ba10-80cb5912171c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:22.765916 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d9c58-431f-4c2b-818b-d0d4cd71c066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:22.766856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d9c58-431f-4c2b-818b-d0d4cd71c066 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:22.767284 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d9c58-431f-4c2b-818b-d0d4cd71c066 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:22.767704 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d9c58-431f-4c2b-818b-d0d4cd71c066 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:22.768672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d9c58-431f-4c2b-818b-d0d4cd71c066 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:22.769219 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d9c58-431f-4c2b-818b-d0d4cd71c066 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:22.770891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d9c58-431f-4c2b-818b-d0d4cd71c066 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:22.771947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5baf82-5381-47a8-95ba-1367d8772e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:22.772743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5baf82-5381-47a8-95ba-1367d8772e1e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:22.773126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5baf82-5381-47a8-95ba-1367d8772e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:22.773654 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5baf82-5381-47a8-95ba-1367d8772e1e None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:22.774466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5baf82-5381-47a8-95ba-1367d8772e1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:22.774890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5baf82-5381-47a8-95ba-1367d8772e1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:22.776402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5baf82-5381-47a8-95ba-1367d8772e1e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:22.777655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 470/929] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 16 16:04:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:22.783131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d9c58-431f-4c2b-818b-d0d4cd71c066 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:22.800374 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 460/930] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jun 16 16:04:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:22.801787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5baf82-5381-47a8-95ba-1367d8772e1e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:22.847723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:22.920629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5baf82-5381-47a8-95ba-1367d8772e1e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:22.921352 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d9c58-431f-4c2b-818b-d0d4cd71c066 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:22.951294 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:22.958515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87594b54-0954-4447-ad9e-723f2b3b3ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:22.959546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87594b54-0954-4447-ad9e-723f2b3b3ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:22.960014 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87594b54-0954-4447-ad9e-723f2b3b3ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:22.960423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87594b54-0954-4447-ad9e-723f2b3b3ea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:22.962238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fe201-8a1a-4a48-9d59-c2eea9cc148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:22.963186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fe201-8a1a-4a48-9d59-c2eea9cc148d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:22.963708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fe201-8a1a-4a48-9d59-c2eea9cc148d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:22.964180 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fe201-8a1a-4a48-9d59-c2eea9cc148d None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:22.965074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fe201-8a1a-4a48-9d59-c2eea9cc148d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:22.965553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fe201-8a1a-4a48-9d59-c2eea9cc148d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:22.967166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fe201-8a1a-4a48-9d59-c2eea9cc148d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:22.972297 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87594b54-0954-4447-ad9e-723f2b3b3ea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:22.973436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 471/931] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 16 16:04:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:22.973988 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87594b54-0954-4447-ad9e-723f2b3b3ea1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:22.982218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fe201-8a1a-4a48-9d59-c2eea9cc148d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:22.999886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-87594b54-0954-4447-ad9e-723f2b3b3ea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:22.999886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:22.999886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:22.999886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:22.999886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:22.999886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:22.999886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:22.999886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:22.999886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:22.999886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:22.999886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:22.999886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:22.999886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:22.999886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:22.999886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:23.000831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:23.001732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:23.001732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:23.001732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:23.001732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:23.001732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 461/932] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:23.006600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87594b54-0954-4447-ad9e-723f2b3b3ea1 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:23.105141 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fe201-8a1a-4a48-9d59-c2eea9cc148d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:23.121146 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:23.131574 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87594b54-0954-4447-ad9e-723f2b3b3ea1 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:23.142213 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff39c28-a4ff-408e-ac86-e0c00ee44a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:23.142936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff39c28-a4ff-408e-ac86-e0c00ee44a6a None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:23.143219 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff39c28-a4ff-408e-ac86-e0c00ee44a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:23.143498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff39c28-a4ff-408e-ac86-e0c00ee44a6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:23.144241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff39c28-a4ff-408e-ac86-e0c00ee44a6a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:23.145739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff39c28-a4ff-408e-ac86-e0c00ee44a6a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:23.170471 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 472/933] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 16 16:04:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:04:23.193511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5389f4-8b85-4f4b-8f43-041ce9e09f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:23.194620 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5389f4-8b85-4f4b-8f43-041ce9e09f58 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:23.195110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5389f4-8b85-4f4b-8f43-041ce9e09f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:23.195862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5389f4-8b85-4f4b-8f43-041ce9e09f58 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:23.196848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5389f4-8b85-4f4b-8f43-041ce9e09f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:23.197517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5389f4-8b85-4f4b-8f43-041ce9e09f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:23.199325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5389f4-8b85-4f4b-8f43-041ce9e09f58 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:23.216196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 462/934] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:23.222212 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff39c28-a4ff-408e-ac86-e0c00ee44a6a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:23.262680 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501e444-eb33-4d9f-ac2b-1c9745017915 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:23.264445 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501e444-eb33-4d9f-ac2b-1c9745017915 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:23.265271 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501e444-eb33-4d9f-ac2b-1c9745017915 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:23.267583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 463/935] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:23.272909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eb2ed-5203-418e-8613-cb73b6ce2c51 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:23.273545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eb2ed-5203-418e-8613-cb73b6ce2c51 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:23.274056 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eb2ed-5203-418e-8613-cb73b6ce2c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:23.290343 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:23.293651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-461eb2ed-5203-418e-8613-cb73b6ce2c51 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:23.296364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-461eb2ed-5203-418e-8613-cb73b6ce2c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:23.348813 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff39c28-a4ff-408e-ac86-e0c00ee44a6a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:23.389933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f42dd8-6d52-4f14-bd1e-85e460f7186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:23.390810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f42dd8-6d52-4f14-bd1e-85e460f7186d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:23.391091 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f42dd8-6d52-4f14-bd1e-85e460f7186d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:23.391360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f42dd8-6d52-4f14-bd1e-85e460f7186d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:23.392037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 464/936] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:23.400257 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f42dd8-6d52-4f14-bd1e-85e460f7186d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:23.401670 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f42dd8-6d52-4f14-bd1e-85e460f7186d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:23.421070 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eb2ed-5203-418e-8613-cb73b6ce2c51 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:23.421296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c3f42dd8-6d52-4f14-bd1e-85e460f7186d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:23.421296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:23.421296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:23.421296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:23.421296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:23.421296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:23.421296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:23.421296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:23.421296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:23.421296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:23.421296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:23.421296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:23.421296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:04:23.421296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:04:23.421296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:23.422130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:23.423075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:04:23.423075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:04:23.423075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:04:23.423075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:04:23.423075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:04:23.423075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:04:23.423075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:23.423075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:23.424339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 473/937] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:23.429145 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f42dd8-6d52-4f14-bd1e-85e460f7186d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:23.522299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:23.536428 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f42dd8-6d52-4f14-bd1e-85e460f7186d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:23.545698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eb2ed-5203-418e-8613-cb73b6ce2c51 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:23.546614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:23.574128 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5386faf-0ca8-428b-9439-19b47add4c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:23.574684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5386faf-0ca8-428b-9439-19b47add4c70 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:23.574980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5386faf-0ca8-428b-9439-19b47add4c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:23.575896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5386faf-0ca8-428b-9439-19b47add4c70 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:23.576709 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5386faf-0ca8-428b-9439-19b47add4c70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:23.577020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5386faf-0ca8-428b-9439-19b47add4c70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:23.578485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5386faf-0ca8-428b-9439-19b47add4c70 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:23.587626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715adde-d981-41f8-b2c5-5b03fd3009d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:23.588752 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715adde-d981-41f8-b2c5-5b03fd3009d9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:23.589218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715adde-d981-41f8-b2c5-5b03fd3009d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:23.589696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715adde-d981-41f8-b2c5-5b03fd3009d9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:23.590563 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715adde-d981-41f8-b2c5-5b03fd3009d9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:23.593143 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715adde-d981-41f8-b2c5-5b03fd3009d9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:23.596983 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 474/938] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:04:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:23.597886 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5386faf-0ca8-428b-9439-19b47add4c70 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-f715adde-d981-41f8-b2c5-5b03fd3009d9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:23.608178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:23.609206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:23.610095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:23.610095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:23.610095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:23.610095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:23.610095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:23.610095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:23.610095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:23.610095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:23.610095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:23.610095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:23.610095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:23.610095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:23.610095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 16:04:23.610095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:23.617335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 465/939] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 16 16:04:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:23.619270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715adde-d981-41f8-b2c5-5b03fd3009d9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:23.703937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5386faf-0ca8-428b-9439-19b47add4c70 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:23.728626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715adde-d981-41f8-b2c5-5b03fd3009d9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:23.739983 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac587b21-9d99-41ec-8dd7-ac817954d5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:23.740836 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac587b21-9d99-41ec-8dd7-ac817954d5d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:23.741125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac587b21-9d99-41ec-8dd7-ac817954d5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:23.741404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac587b21-9d99-41ec-8dd7-ac817954d5d0 None admin] PATH_INFO: `/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/36f7c6f172424967bb7749180711db07/roles/74eb0d20197044ea95b7e71c9a8b329c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:23.743702 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac587b21-9d99-41ec-8dd7-ac817954d5d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=227cd348bea64e1f89d77ae2cf63a031, user_id=36f7c6f172424967bb7749180711db07, role_id=74eb0d20197044ea95b7e71c9a8b329c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:23.745164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac587b21-9d99-41ec-8dd7-ac817954d5d0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:23.765685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 475/940] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:04:23 2022] PUT /identity/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/36f7c6f172424967bb7749180711db07/roles/74eb0d20197044ea95b7e71c9a8b329c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:04:23.769526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43492c34-85a6-4d6d-8765-70727156ec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:23.770473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43492c34-85a6-4d6d-8765-70727156ec1e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:23.770964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43492c34-85a6-4d6d-8765-70727156ec1e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:23.771406 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43492c34-85a6-4d6d-8765-70727156ec1e None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:23.772458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43492c34-85a6-4d6d-8765-70727156ec1e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:23.772973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43492c34-85a6-4d6d-8765-70727156ec1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:23.774690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43492c34-85a6-4d6d-8765-70727156ec1e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:23.786325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 466/941] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 16 16:04:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:23.788086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac587b21-9d99-41ec-8dd7-ac817954d5d0 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:23.823905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:23.909948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac587b21-9d99-41ec-8dd7-ac817954d5d0 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:23.949291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd782d6d-536e-40ea-abe0-2272544a77b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:23.950814 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd782d6d-536e-40ea-abe0-2272544a77b7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:23.951321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd782d6d-536e-40ea-abe0-2272544a77b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:23.951761 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd782d6d-536e-40ea-abe0-2272544a77b7 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:23.952688 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd782d6d-536e-40ea-abe0-2272544a77b7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:23.953168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd782d6d-536e-40ea-abe0-2272544a77b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:23.954851 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd782d6d-536e-40ea-abe0-2272544a77b7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:23.962153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 476/942] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 16 16:04:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:23.970920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43492c34-85a6-4d6d-8765-70727156ec1e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:23.986138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:24.029896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b539f3a-daf3-45b0-8770-3088b9472372 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:24.030199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b539f3a-daf3-45b0-8770-3088b9472372 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:24.030511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b539f3a-daf3-45b0-8770-3088b9472372 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:24.032436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 477/943] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:24.037673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f216381-c8e5-4f40-9317-ef8343c024cd None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:24.037961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f216381-c8e5-4f40-9317-ef8343c024cd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:24.038246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f216381-c8e5-4f40-9317-ef8343c024cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:24.059748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0f216381-c8e5-4f40-9317-ef8343c024cd None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:24.063791 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0f216381-c8e5-4f40-9317-ef8343c024cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:24.096305 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43492c34-85a6-4d6d-8765-70727156ec1e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:24.136408 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f43ad-6c61-4cc2-b8ca-992cd6032153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:24.137555 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f43ad-6c61-4cc2-b8ca-992cd6032153 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:24.137981 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f43ad-6c61-4cc2-b8ca-992cd6032153 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:24.138621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f43ad-6c61-4cc2-b8ca-992cd6032153 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:24.139556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f43ad-6c61-4cc2-b8ca-992cd6032153 None admin] RBAC: Adding query filter params (interface=public, service_id=07fe3b58f9014774b381088fc1269406, region_id=RegionOne) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:24.140010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f43ad-6c61-4cc2-b8ca-992cd6032153 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:24.141787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f43ad-6c61-4cc2-b8ca-992cd6032153 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:24.146539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 478/944] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:24.147934 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 467/945] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 16 16:04:23 2022] GET /identity/v3/endpoints?service_id=07fe3b58f9014774b381088fc1269406&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:24.155833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f216381-c8e5-4f40-9317-ef8343c024cd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:24.179951 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f43ad-6c61-4cc2-b8ca-992cd6032153 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:24.182190 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:24.260583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:24.290150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f216381-c8e5-4f40-9317-ef8343c024cd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:24.293546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f43ad-6c61-4cc2-b8ca-992cd6032153 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:24.329719 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b23057-9747-42d8-affd-6481df32f35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:24.330793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b23057-9747-42d8-affd-6481df32f35e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:24.330997 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2af889-9457-486f-b0e5-d66afbf115c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:24.331523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b23057-9747-42d8-affd-6481df32f35e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:24.331640 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2af889-9457-486f-b0e5-d66afbf115c9 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:24.331940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2af889-9457-486f-b0e5-d66afbf115c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:24.332215 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2af889-9457-486f-b0e5-d66afbf115c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:24.332506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b23057-9747-42d8-affd-6481df32f35e None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:24.332911 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2af889-9457-486f-b0e5-d66afbf115c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:24.333661 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b23057-9747-42d8-affd-6481df32f35e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:24.334323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2af889-9457-486f-b0e5-d66afbf115c9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:24.335452 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b23057-9747-42d8-affd-6481df32f35e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:24.335705 dv-cinder-837355-2-smb devstack@keystone.service[80324]: WARNING keystone.server.flask.common [None req-ea2af889-9457-486f-b0e5-d66afbf115c9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 16:04:24.354773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 479/946] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 16 16:04:24 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:04:24.358269 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.sql.core [None req-ea2af889-9457-486f-b0e5-d66afbf115c9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 16:04:24.358269 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 16:04:24.358269 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [parameters: {'id': '39b8c958c0f449fe815b2cb4d0896c4e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 16:04:24.358269 dv-cinder-837355-2-smb devstack@keystone.service[80324]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80324) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 16:04:24.366576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-ea2af889-9457-486f-b0e5-d66afbf115c9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39b8c958c0f449fe815b2cb4d0896c4e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39b8c958c0f449fe815b2cb4d0896c4e. Jun 16 16:04:24.366576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:24.366576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 16:04:24.366576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 16:04:24.366576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 16:04:24.366576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 16:04:24.366576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 16:04:24.366576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 16:04:24.366576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 16:04:24.366576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application conn.query(q) Jun 16 16:04:24.366576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 16:04:24.366576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 16:04:24.366576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result.read() Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 16:04:24.367460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application next(self.gen) Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application yield resource Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application next(self.gen) Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise self.value Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application session.commit() Jun 16 16:04:24.368440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.session.flush() Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application compat.raise_( Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 16:04:24.369336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 16:04:24.370273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 16:04:24.370273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 16:04:24.370273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 16:04:24.370273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 16:04:24.370273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 16:04:24.370273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 16:04:24.370273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 16:04:24.370273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 16:04:24.370273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 16:04:24.370273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 16:04:24.370273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 16:04:24.370273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 16:04:24.370273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 16:04:24.370273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 16:04:24.370273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application conn.query(q) Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result.read() Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 16:04:24.371141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 16:04:24.372202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 16:04:24.372202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 16:04:24.372202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 16:04:24.372202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 16:04:24.372202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 16:04:24.372202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 16:04:24.372202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 16:04:24.372202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 16:04:24.372202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [parameters: {'id': '39b8c958c0f449fe815b2cb4d0896c4e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 16:04:24.372202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 16:04:24.372202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:24.372202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:24.372202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:24.372202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:24.372202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:24.373545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:24.374528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:24.374528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 16:04:24.374528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 16:04:24.374528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:24.374528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:24.374528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 16:04:24.374528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 16:04:24.374528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39b8c958c0f449fe815b2cb4d0896c4e. Jun 16 16:04:24.374528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:24.374528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 468/947] 10.222.0.48 () {60 vars in 1140 bytes} [Thu Jun 16 16:04:24 2022] POST /identity/v3/projects => generated 262 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:24.380466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b23057-9747-42d8-affd-6481df32f35e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:24.490673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:24.508031 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b23057-9747-42d8-affd-6481df32f35e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:24.548618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc2a63-dd2d-4200-ac5d-9ae7aa388426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:24.549359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc2a63-dd2d-4200-ac5d-9ae7aa388426 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:24.549645 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc2a63-dd2d-4200-ac5d-9ae7aa388426 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:24.549921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc2a63-dd2d-4200-ac5d-9ae7aa388426 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:24.557611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc2a63-dd2d-4200-ac5d-9ae7aa388426 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:24.559124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc2a63-dd2d-4200-ac5d-9ae7aa388426 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:24.574860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8adc2a63-dd2d-4200-ac5d-9ae7aa388426 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:24.574860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:24.574860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:24.574860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:24.574860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:24.574860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:24.574860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:24.574860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:24.574860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:24.574860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:24.574860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:24.574860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:24.574860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:04:24.574860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:04:24.574860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:24.576380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:24.577277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:04:24.577277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:04:24.577277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:04:24.577277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:04:24.577277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:04:24.577277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:04:24.577277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:24.577277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:24.577277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 480/948] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:24.582993 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2af889-9457-486f-b0e5-d66afbf115c9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:24.701189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2af889-9457-486f-b0e5-d66afbf115c9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:24.729183 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:24.738490 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd559f-cff2-4515-968c-d2028a30de91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:24.739165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd559f-cff2-4515-968c-d2028a30de91 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:24.739487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd559f-cff2-4515-968c-d2028a30de91 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:24.739765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd559f-cff2-4515-968c-d2028a30de91 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:24.740524 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd559f-cff2-4515-968c-d2028a30de91 None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:24.740829 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd559f-cff2-4515-968c-d2028a30de91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:24.742488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd559f-cff2-4515-968c-d2028a30de91 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:24.763488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 469/949] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 16 16:04:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:25.504592 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90416ace-d299-4aa5-baff-51f22ec25d1d None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:25.505104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90416ace-d299-4aa5-baff-51f22ec25d1d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:25.505210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90416ace-d299-4aa5-baff-51f22ec25d1d None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:25.506809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 481/950] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:25.512190 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e00a-ccf9-4a45-b1b3-dd372da4a158 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:25.512491 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e00a-ccf9-4a45-b1b3-dd372da4a158 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:25.513431 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e00a-ccf9-4a45-b1b3-dd372da4a158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:25.531625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-fd17e00a-ccf9-4a45-b1b3-dd372da4a158 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:25.533229 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fd17e00a-ccf9-4a45-b1b3-dd372da4a158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:25.611150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 470/951] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:25.646015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90416ace-d299-4aa5-baff-51f22ec25d1d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:25.768271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90416ace-d299-4aa5-baff-51f22ec25d1d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:25.804077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb60fc-d0d3-4b09-b6e6-fcecbe5b9545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:25.805237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb60fc-d0d3-4b09-b6e6-fcecbe5b9545 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:25.805712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb60fc-d0d3-4b09-b6e6-fcecbe5b9545 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:25.806323 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb60fc-d0d3-4b09-b6e6-fcecbe5b9545 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:25.807211 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb60fc-d0d3-4b09-b6e6-fcecbe5b9545 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:25.808780 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb60fc-d0d3-4b09-b6e6-fcecbe5b9545 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-75fb60fc-d0d3-4b09-b6e6-fcecbe5b9545 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:25.821671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:25.822717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:25.823572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:25.823572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:25.823572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:25.823572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:25.823572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:25.823572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:25.823572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:25.823572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:25.823572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:25.823572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:25.823572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:25.823572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:25.823572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 16:04:25.823572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:25.827382 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 482/952] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:25.838451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17e00a-ccf9-4a45-b1b3-dd372da4a158 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:25.975353 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17e00a-ccf9-4a45-b1b3-dd372da4a158 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:25.994871 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:26.017271 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12ebf7-9aed-4db9-849c-210f0026c42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:26.018132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12ebf7-9aed-4db9-849c-210f0026c42c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:26.018442 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12ebf7-9aed-4db9-849c-210f0026c42c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:26.018728 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12ebf7-9aed-4db9-849c-210f0026c42c None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:26.019450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12ebf7-9aed-4db9-849c-210f0026c42c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:26.019760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12ebf7-9aed-4db9-849c-210f0026c42c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:26.021147 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12ebf7-9aed-4db9-849c-210f0026c42c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:26.035293 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb60fc-d0d3-4b09-b6e6-fcecbe5b9545 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:26.040557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 471/953] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 16 16:04:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:26.055668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:26.117982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddd115-df40-4dbe-aec8-176c230e8866 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:26.118334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddd115-df40-4dbe-aec8-176c230e8866 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:26.118578 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddd115-df40-4dbe-aec8-176c230e8866 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:26.120126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 472/954] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:26.127132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53072dd4-af3a-43c7-9a91-dcb1c64feb23 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:26.127132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53072dd4-af3a-43c7-9a91-dcb1c64feb23 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:26.127132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53072dd4-af3a-43c7-9a91-dcb1c64feb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:26.146757 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-53072dd4-af3a-43c7-9a91-dcb1c64feb23 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:26.148305 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-53072dd4-af3a-43c7-9a91-dcb1c64feb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:26.232114 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb60fc-d0d3-4b09-b6e6-fcecbe5b9545 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:26.286074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe9273-c510-4f0f-9125-5981a141f2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:26.286074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe9273-c510-4f0f-9125-5981a141f2eb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:26.286074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe9273-c510-4f0f-9125-5981a141f2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:26.286074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe9273-c510-4f0f-9125-5981a141f2eb None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:26.286519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe9273-c510-4f0f-9125-5981a141f2eb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:26.286519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe9273-c510-4f0f-9125-5981a141f2eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:26.286519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe9273-c510-4f0f-9125-5981a141f2eb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:26.293148 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 473/956] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jun 16 16:04:26.294708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 483/956] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 16 16:04:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:26.345233 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53072dd4-af3a-43c7-9a91-dcb1c64feb23 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:26.471405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53072dd4-af3a-43c7-9a91-dcb1c64feb23 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:26.489320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:26.512555 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585b6ab-b089-4ea5-889d-55665d466d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:26.513579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585b6ab-b089-4ea5-889d-55665d466d28 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:26.513864 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585b6ab-b089-4ea5-889d-55665d466d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:26.514140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585b6ab-b089-4ea5-889d-55665d466d28 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:26.525002 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585b6ab-b089-4ea5-889d-55665d466d28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-2585b6ab-b089-4ea5-889d-55665d466d28 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:04:26.533272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:26.534283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:26.535433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:26.535433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:26.535433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:26.535433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:26.535433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:04:26.535433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:04:26.535433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:04:26.535433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:04:26.535433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:04:26.535433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:04:26.535433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 16:04:26.535433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:26.535433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 474/957] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jun 16 16:04:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:26.542568 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe9273-c510-4f0f-9125-5981a141f2eb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:26.633986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:26.665156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe9273-c510-4f0f-9125-5981a141f2eb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:26.703188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1acb1-92c7-44d5-8f3a-c76691b97ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:26.703876 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1acb1-92c7-44d5-8f3a-c76691b97ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:26.704159 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1acb1-92c7-44d5-8f3a-c76691b97ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:26.704437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1acb1-92c7-44d5-8f3a-c76691b97ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:26.705200 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1acb1-92c7-44d5-8f3a-c76691b97ca4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:26.705509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1acb1-92c7-44d5-8f3a-c76691b97ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:26.706926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1acb1-92c7-44d5-8f3a-c76691b97ca4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:26.716731 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 484/958] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jun 16 16:04:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:26.722529 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585b6ab-b089-4ea5-889d-55665d466d28 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:26.729345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c087a6-c628-4573-a756-4541f65cece2 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:26.729643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c087a6-c628-4573-a756-4541f65cece2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:26.729930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c087a6-c628-4573-a756-4541f65cece2 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:26.732478 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 485/959] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:26.737679 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f666173-caef-4234-80e0-5718d24fa99f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:26.737979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f666173-caef-4234-80e0-5718d24fa99f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:26.738263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f666173-caef-4234-80e0-5718d24fa99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:26.757131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0f666173-caef-4234-80e0-5718d24fa99f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:26.758752 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0f666173-caef-4234-80e0-5718d24fa99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:26.829892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 486/960] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:26.844267 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585b6ab-b089-4ea5-889d-55665d466d28 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:26.854867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f666173-caef-4234-80e0-5718d24fa99f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:26.894234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968fb28-9ecd-4abe-a4af-7e6247d9eccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:26.895083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968fb28-9ecd-4abe-a4af-7e6247d9eccd None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:26.895411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968fb28-9ecd-4abe-a4af-7e6247d9eccd None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:26.895902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968fb28-9ecd-4abe-a4af-7e6247d9eccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:26.915580 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968fb28-9ecd-4abe-a4af-7e6247d9eccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:26.917991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968fb28-9ecd-4abe-a4af-7e6247d9eccd None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:26.937235 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:26.953603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-5968fb28-9ecd-4abe-a4af-7e6247d9eccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:26.953603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:26.953603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:26.953603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:26.953603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:26.953603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:26.953603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:26.953603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:26.953603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:26.953603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:26.953603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:26.953603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:26.953603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:26.953603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:26.953603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:26.954644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:26.955647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:26.955647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:26.955647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:26.955647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:26.955647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 475/961] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:26.960945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968fb28-9ecd-4abe-a4af-7e6247d9eccd None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:26.991581 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f666173-caef-4234-80e0-5718d24fa99f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:26.994599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:27.037613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fab67-4b9c-4474-95ce-76c4b79da377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:27.038631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fab67-4b9c-4474-95ce-76c4b79da377 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:27.039199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fab67-4b9c-4474-95ce-76c4b79da377 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:27.039419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fab67-4b9c-4474-95ce-76c4b79da377 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:27.040202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fab67-4b9c-4474-95ce-76c4b79da377 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:27.041713 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fab67-4b9c-4474-95ce-76c4b79da377 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f96fab67-4b9c-4474-95ce-76c4b79da377 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:27.054391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:27.055734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:27.056804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:27.056804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:27.056804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:27.056804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:27.056804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:27.056804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:27.056804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:27.056804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:27.056804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:27.056804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:27.056804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:27.056804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:27.056804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 16:04:27.056804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:27.064017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 487/962] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 16 16:04:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:27.066373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fab67-4b9c-4474-95ce-76c4b79da377 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:27.102750 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968fb28-9ecd-4abe-a4af-7e6247d9eccd None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:27.146506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0e9ae-a222-4991-95ab-4b70438d726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:27.147182 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0e9ae-a222-4991-95ab-4b70438d726e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:27.147468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0e9ae-a222-4991-95ab-4b70438d726e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:27.147747 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0e9ae-a222-4991-95ab-4b70438d726e None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:27.148469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0e9ae-a222-4991-95ab-4b70438d726e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:27.148783 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0e9ae-a222-4991-95ab-4b70438d726e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:27.150147 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0e9ae-a222-4991-95ab-4b70438d726e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:27.164160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 476/963] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:27.165832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4226091-41c9-4a1f-b05f-b8bb6e065936 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:27.166961 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4226091-41c9-4a1f-b05f-b8bb6e065936 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:27.167450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4226091-41c9-4a1f-b05f-b8bb6e065936 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:27.170107 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 477/964] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:27.171751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4226091-41c9-4a1f-b05f-b8bb6e065936 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:27.193678 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fab67-4b9c-4474-95ce-76c4b79da377 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:27.225629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:27.233142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fd1cf-2e70-4a97-952b-45517fb9d380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:27.233824 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fd1cf-2e70-4a97-952b-45517fb9d380 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:27.234109 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fd1cf-2e70-4a97-952b-45517fb9d380 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:27.234386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fd1cf-2e70-4a97-952b-45517fb9d380 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:27.235131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fd1cf-2e70-4a97-952b-45517fb9d380 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:27.235439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fd1cf-2e70-4a97-952b-45517fb9d380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:27.236810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fd1cf-2e70-4a97-952b-45517fb9d380 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:27.242413 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 488/965] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 16 16:04:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:27.243662 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab326-f09c-4e8a-ba2d-588752e9b977 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:27.243959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab326-f09c-4e8a-ba2d-588752e9b977 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:27.244243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab326-f09c-4e8a-ba2d-588752e9b977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:27.262153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2a3ab326-f09c-4e8a-ba2d-588752e9b977 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:27.264153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2a3ab326-f09c-4e8a-ba2d-588752e9b977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:27.283443 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:27.310383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4226091-41c9-4a1f-b05f-b8bb6e065936 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:27.350559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116263d-1eba-4864-a4ce-b886b20c6fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:27.351391 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116263d-1eba-4864-a4ce-b886b20c6fde None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:27.351671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116263d-1eba-4864-a4ce-b886b20c6fde None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:27.351949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116263d-1eba-4864-a4ce-b886b20c6fde None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:27.355986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 489/966] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:27.358451 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ab326-f09c-4e8a-ba2d-588752e9b977 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:27.366321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116263d-1eba-4864-a4ce-b886b20c6fde None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:27.366321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116263d-1eba-4864-a4ce-b886b20c6fde None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-b116263d-1eba-4864-a4ce-b886b20c6fde None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:04:27.383831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:27.384847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:27.386029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:27.386029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:27.386029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:04:27.386029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:04:27.386029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:04:27.386029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:04:27.386029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:04:27.386029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:04:27.386029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 16:04:27.386029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:27.386029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 478/967] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 16 16:04:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:27.386029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116263d-1eba-4864-a4ce-b886b20c6fde None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:27.483546 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ab326-f09c-4e8a-ba2d-588752e9b977 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:27.505277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116263d-1eba-4864-a4ce-b886b20c6fde None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:27.510498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:27.525153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aac251-9cea-4f0e-af7c-ace7e0303200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:27.525984 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aac251-9cea-4f0e-af7c-ace7e0303200 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:27.526271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aac251-9cea-4f0e-af7c-ace7e0303200 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:27.526587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aac251-9cea-4f0e-af7c-ace7e0303200 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:27.527571 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aac251-9cea-4f0e-af7c-ace7e0303200 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:27.527889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aac251-9cea-4f0e-af7c-ace7e0303200 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:27.530092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aac251-9cea-4f0e-af7c-ace7e0303200 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:27.536998 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 490/968] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 16 16:04:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:27.537936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aac251-9cea-4f0e-af7c-ace7e0303200 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:27.548266 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba697fc-60ee-4301-ab02-962b0650930e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:27.549566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba697fc-60ee-4301-ab02-962b0650930e None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:27.549851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba697fc-60ee-4301-ab02-962b0650930e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:27.550466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba697fc-60ee-4301-ab02-962b0650930e None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:27.551167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba697fc-60ee-4301-ab02-962b0650930e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:27.552598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba697fc-60ee-4301-ab02-962b0650930e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:27.567395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.sql.core [None req-2ba697fc-60ee-4301-ab02-962b0650930e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 16:04:27.567395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 16:04:27.567395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [parameters: {'user_id': 'dc1d61a86fa7443b84baff662083a7e1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 16:04:27.567395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80324) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 16:04:27.576281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-2ba697fc-60ee-4301-ab02-962b0650930e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 16:04:27.576281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:27.576281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 16:04:27.576281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 16:04:27.576281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 16:04:27.576281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 16:04:27.576281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 16:04:27.576281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 16:04:27.576281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 16:04:27.576281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application conn.query(q) Jun 16 16:04:27.576281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 16:04:27.576281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 16:04:27.576281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 16:04:27.576281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result.read() Jun 16 16:04:27.576281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 16:04:27.577474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application next(self.gen) Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application yield resource Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application next(self.gen) Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise self.value Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application session.commit() Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 16:04:27.578720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.session.flush() Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application compat.raise_( Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 16:04:27.579873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 16:04:27.581010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application conn.query(q) Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application result.read() Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 16:04:27.582092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 16:04:27.583175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 16:04:27.583175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 16:04:27.583175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 16:04:27.583175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 16:04:27.583175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 16:04:27.583175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 16:04:27.583175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [parameters: {'user_id': 'dc1d61a86fa7443b84baff662083a7e1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 16:04:27.583175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 16:04:27.583175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:27.583175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:27.583175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:27.583175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:27.583175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:27.583175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:27.583175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 16:04:27.584159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 16:04:27.585348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 16:04:27.585348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 16:04:27.585348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 16:04:27.585348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 16:04:27.585348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 16:04:27.585348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:27.588721 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 479/969] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jun 16 16:04:27 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:27.588721 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba697fc-60ee-4301-ab02-962b0650930e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:27.600005 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:27.669421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aac251-9cea-4f0e-af7c-ace7e0303200 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:27.707505 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba697fc-60ee-4301-ab02-962b0650930e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:27.709252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec01681-d1f1-4769-9273-ae186e56fd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:27.709925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec01681-d1f1-4769-9273-ae186e56fd3c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:27.710209 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec01681-d1f1-4769-9273-ae186e56fd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:27.710509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec01681-d1f1-4769-9273-ae186e56fd3c None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:27.711349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec01681-d1f1-4769-9273-ae186e56fd3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:27.711656 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec01681-d1f1-4769-9273-ae186e56fd3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:27.713070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec01681-d1f1-4769-9273-ae186e56fd3c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:27.735690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 491/970] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jun 16 16:04:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:27.735690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec01681-d1f1-4769-9273-ae186e56fd3c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:27.750144 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a8531-f974-4442-914b-a29875af6ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:27.750849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a8531-f974-4442-914b-a29875af6ec1 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:27.751139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a8531-f974-4442-914b-a29875af6ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:27.751423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a8531-f974-4442-914b-a29875af6ec1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:27.752168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a8531-f974-4442-914b-a29875af6ec1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:27.753748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a8531-f974-4442-914b-a29875af6ec1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:27.780302 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 480/971] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 16 16:04:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:04:27.781719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a8531-f974-4442-914b-a29875af6ec1 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:27.784002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:27.851868 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec01681-d1f1-4769-9273-ae186e56fd3c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:27.860494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:27.904266 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db764e2-41bb-4083-97bb-db1e3e7cf2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:27.906688 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db764e2-41bb-4083-97bb-db1e3e7cf2bf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:27.907189 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db764e2-41bb-4083-97bb-db1e3e7cf2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:27.907774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db764e2-41bb-4083-97bb-db1e3e7cf2bf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:27.911674 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a8531-f974-4442-914b-a29875af6ec1 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:27.917022 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db764e2-41bb-4083-97bb-db1e3e7cf2bf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:27.919436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db764e2-41bb-4083-97bb-db1e3e7cf2bf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9db764e2-41bb-4083-97bb-db1e3e7cf2bf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:04:27.936935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:27.937978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:27.939000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:27.939000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:27.939000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:04:27.939000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:04:27.939000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:04:27.939000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:04:27.939000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:04:27.939000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:04:27.939000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 16:04:27.939000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:27.941844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 492/972] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:04:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:27.950519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db764e2-41bb-4083-97bb-db1e3e7cf2bf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:27.953766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad218811-d0c7-4c3d-9cab-05dd3c4fc7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:27.954552 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad218811-d0c7-4c3d-9cab-05dd3c4fc7ff None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:27.954843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad218811-d0c7-4c3d-9cab-05dd3c4fc7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:27.955127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad218811-d0c7-4c3d-9cab-05dd3c4fc7ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:28.037421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad218811-d0c7-4c3d-9cab-05dd3c4fc7ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:28.038922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad218811-d0c7-4c3d-9cab-05dd3c4fc7ff None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:28.076124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db764e2-41bb-4083-97bb-db1e3e7cf2bf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:28.077940 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:28.115765 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb73f7-eb1d-453c-ac35-1324fc6e5692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:28.116388 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb73f7-eb1d-453c-ac35-1324fc6e5692 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:28.116674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb73f7-eb1d-453c-ac35-1324fc6e5692 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:28.116952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb73f7-eb1d-453c-ac35-1324fc6e5692 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:28.117755 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb73f7-eb1d-453c-ac35-1324fc6e5692 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:28.118066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb73f7-eb1d-453c-ac35-1324fc6e5692 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:28.119565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb73f7-eb1d-453c-ac35-1324fc6e5692 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:28.122662 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:28.160177 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 493/973] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 16 16:04:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:28.179609 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 481/974] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:04:27 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:04:28.185930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb73f7-eb1d-453c-ac35-1324fc6e5692 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:28.307514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb73f7-eb1d-453c-ac35-1324fc6e5692 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:28.347302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc909e2-49ab-4bc8-99f0-ba20bd76d7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:28.348122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc909e2-49ab-4bc8-99f0-ba20bd76d7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:28.348406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc909e2-49ab-4bc8-99f0-ba20bd76d7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:28.348684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc909e2-49ab-4bc8-99f0-ba20bd76d7c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:28.359787 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc909e2-49ab-4bc8-99f0-ba20bd76d7c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:28.361264 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc909e2-49ab-4bc8-99f0-ba20bd76d7c9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:28.380360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0cc909e2-49ab-4bc8-99f0-ba20bd76d7c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:28.380360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:28.380360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:28.380360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:28.380360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:28.380360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:28.380360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:28.380360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:28.380360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:28.380360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:28.380360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:28.380360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:28.380360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:28.380360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:28.380360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:28.381308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:28.382222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:28.382222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:28.382222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:28.382222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:28.382222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 494/975] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:28.389585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad218811-d0c7-4c3d-9cab-05dd3c4fc7ff None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:28.501011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad218811-d0c7-4c3d-9cab-05dd3c4fc7ff None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:28.539182 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69c7a8-18bf-4d75-8c47-c9d114af36f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:28.539917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69c7a8-18bf-4d75-8c47-c9d114af36f1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:28.540208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69c7a8-18bf-4d75-8c47-c9d114af36f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:28.540490 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69c7a8-18bf-4d75-8c47-c9d114af36f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:28.541238 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69c7a8-18bf-4d75-8c47-c9d114af36f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:28.541551 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69c7a8-18bf-4d75-8c47-c9d114af36f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:28.543126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69c7a8-18bf-4d75-8c47-c9d114af36f1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:28.561787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 482/976] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:28.563082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc909e2-49ab-4bc8-99f0-ba20bd76d7c9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:28.579145 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:28.590760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374816e-4dcb-42a2-939a-cc60afd4f5d5 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:28.591748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374816e-4dcb-42a2-939a-cc60afd4f5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:28.592044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374816e-4dcb-42a2-939a-cc60afd4f5d5 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:28.593444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 483/977] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:28.602267 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112ee3-269c-40a1-98ca-78cd4fb3ea8d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:28.602752 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112ee3-269c-40a1-98ca-78cd4fb3ea8d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:28.603047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112ee3-269c-40a1-98ca-78cd4fb3ea8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:28.621451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-05112ee3-269c-40a1-98ca-78cd4fb3ea8d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:28.624235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-05112ee3-269c-40a1-98ca-78cd4fb3ea8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:28.647016 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:28.682617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc909e2-49ab-4bc8-99f0-ba20bd76d7c9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:28.714483 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 484/978] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:28.725077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a81756-03cf-4203-8d4d-cc59a2bd51ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:28.725880 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a81756-03cf-4203-8d4d-cc59a2bd51ea None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:28.726167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a81756-03cf-4203-8d4d-cc59a2bd51ea None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:28.726470 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a81756-03cf-4203-8d4d-cc59a2bd51ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:28.734316 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a81756-03cf-4203-8d4d-cc59a2bd51ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:28.735797 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a81756-03cf-4203-8d4d-cc59a2bd51ea None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:28.746013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05112ee3-269c-40a1-98ca-78cd4fb3ea8d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:28.751029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-81a81756-03cf-4203-8d4d-cc59a2bd51ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:28.751029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:28.751029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:28.751029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:28.751029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:28.751029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:28.751029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:28.751029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:28.751029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:28.751029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:28.751029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:28.751029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:28.751029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:04:28.751029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:04:28.751029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:28.752078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:28.753001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:04:28.753001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:04:28.753001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:04:28.753001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:04:28.753001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:04:28.753001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:04:28.753001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:28.753001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:28.753001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 495/979] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:28.757960 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a81756-03cf-4203-8d4d-cc59a2bd51ea None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:28.833963 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:28.863907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05112ee3-269c-40a1-98ca-78cd4fb3ea8d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:28.867904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a81756-03cf-4203-8d4d-cc59a2bd51ea None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:28.906039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b7396-fd96-470b-a20d-ff9cb52f9b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:28.906661 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b7396-fd96-470b-a20d-ff9cb52f9b3c None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:28.906953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b7396-fd96-470b-a20d-ff9cb52f9b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:28.907237 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b7396-fd96-470b-a20d-ff9cb52f9b3c None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:28.907975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b7396-fd96-470b-a20d-ff9cb52f9b3c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:28.908945 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04804cfb-a06d-4eb4-b0d8-5cd270a3a65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:28.909351 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b7396-fd96-470b-a20d-ff9cb52f9b3c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:28.909610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04804cfb-a06d-4eb4-b0d8-5cd270a3a65d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:28.909896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04804cfb-a06d-4eb4-b0d8-5cd270a3a65d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:28.910171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04804cfb-a06d-4eb4-b0d8-5cd270a3a65d None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:28.910985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04804cfb-a06d-4eb4-b0d8-5cd270a3a65d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:28.911294 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04804cfb-a06d-4eb4-b0d8-5cd270a3a65d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:28.912750 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04804cfb-a06d-4eb4-b0d8-5cd270a3a65d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:28.926369 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 485/980] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 16 16:04:28 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:04:28.927804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 496/981] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:28.933717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b7396-fd96-470b-a20d-ff9cb52f9b3c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:28.951789 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:29.063300 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b7396-fd96-470b-a20d-ff9cb52f9b3c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:29.112564 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8159a76-00cb-42c8-be5b-a2c5f843a187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:29.113231 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8159a76-00cb-42c8-be5b-a2c5f843a187 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:29.113516 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8159a76-00cb-42c8-be5b-a2c5f843a187 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:29.114319 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8159a76-00cb-42c8-be5b-a2c5f843a187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:29.114656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8159a76-00cb-42c8-be5b-a2c5f843a187 None admin] RBAC: Adding query filter params (role.id=74eb0d20197044ea95b7e71c9a8b329c, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=36f7c6f172424967bb7749180711db07) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:29.114967 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8159a76-00cb-42c8-be5b-a2c5f843a187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:29.116448 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8159a76-00cb-42c8-be5b-a2c5f843a187 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:29.124469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 486/982] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:04:28 2022] GET /identity/v3/role_assignments?user.id=36f7c6f172424967bb7749180711db07&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=74eb0d20197044ea95b7e71c9a8b329c => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:30.140017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0cf1-57f0-4ee8-b733-41273e2a6dde None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:30.140579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0cf1-57f0-4ee8-b733-41273e2a6dde None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:30.140579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0cf1-57f0-4ee8-b733-41273e2a6dde None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:30.142106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 497/983] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:30.147257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab8448-7cb4-4525-b4d2-a514b595c6f4 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:30.147664 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab8448-7cb4-4525-b4d2-a514b595c6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:30.147830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab8448-7cb4-4525-b4d2-a514b595c6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:30.165862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-97ab8448-7cb4-4525-b4d2-a514b595c6f4 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:30.167103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-97ab8448-7cb4-4525-b4d2-a514b595c6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:30.241219 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 487/984] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:30.266920 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d0cf1-57f0-4ee8-b733-41273e2a6dde None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:30.391145 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d0cf1-57f0-4ee8-b733-41273e2a6dde None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:30.421618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:30.427941 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c6505-aa3c-44ca-b84c-c71f4430fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:30.428751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c6505-aa3c-44ca-b84c-c71f4430fd88 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:30.429034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c6505-aa3c-44ca-b84c-c71f4430fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:30.429310 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c6505-aa3c-44ca-b84c-c71f4430fd88 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:30.429964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c6505-aa3c-44ca-b84c-c71f4430fd88 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:30.431354 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c6505-aa3c-44ca-b84c-c71f4430fd88 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-8e0c6505-aa3c-44ca-b84c-c71f4430fd88 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:30.444008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:30.445030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:30.446142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:30.446142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:30.446142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:30.446142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:30.446142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:30.446142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:30.446142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:30.446142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:30.446142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:30.446142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:30.446142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:30.446142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:30.446142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 16:04:30.446142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:30.446142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 498/985] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 16 16:04:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:30.451622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab8448-7cb4-4525-b4d2-a514b595c6f4 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:30.453998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:30.556819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab8448-7cb4-4525-b4d2-a514b595c6f4 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:30.591499 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b5a42-7357-45f9-879e-5fd23dc9023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:30.592084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b5a42-7357-45f9-879e-5fd23dc9023b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:30.592368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b5a42-7357-45f9-879e-5fd23dc9023b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:30.592644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b5a42-7357-45f9-879e-5fd23dc9023b None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:30.593349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b5a42-7357-45f9-879e-5fd23dc9023b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:30.593659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b5a42-7357-45f9-879e-5fd23dc9023b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:30.595054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b5a42-7357-45f9-879e-5fd23dc9023b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:30.604667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 488/986] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 16 16:04:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:30.605899 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c6505-aa3c-44ca-b84c-c71f4430fd88 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:30.717086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c6505-aa3c-44ca-b84c-c71f4430fd88 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:30.752653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480610eb-d944-49fa-9f4f-c2d05495165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:30.753318 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480610eb-d944-49fa-9f4f-c2d05495165a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:30.753597 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480610eb-d944-49fa-9f4f-c2d05495165a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:30.753876 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480610eb-d944-49fa-9f4f-c2d05495165a None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:30.754609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480610eb-d944-49fa-9f4f-c2d05495165a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:30.754918 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480610eb-d944-49fa-9f4f-c2d05495165a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:30.756276 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480610eb-d944-49fa-9f4f-c2d05495165a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:30.766277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 499/987] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 16 16:04:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:30.767736 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b5a42-7357-45f9-879e-5fd23dc9023b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:30.837903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:30.875687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b5a42-7357-45f9-879e-5fd23dc9023b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:30.912767 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447fddc-d5af-4f20-b749-59dbae1c7a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:30.913434 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447fddc-d5af-4f20-b749-59dbae1c7a31 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:30.913718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447fddc-d5af-4f20-b749-59dbae1c7a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:30.913993 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447fddc-d5af-4f20-b749-59dbae1c7a31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:30.914834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447fddc-d5af-4f20-b749-59dbae1c7a31 None admin] RBAC: Adding query filter params (interface=admin, service_id=07fe3b58f9014774b381088fc1269406, region_id=RegionOne) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:30.915145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447fddc-d5af-4f20-b749-59dbae1c7a31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:30.916558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447fddc-d5af-4f20-b749-59dbae1c7a31 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:30.927256 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 489/988] 10.222.0.48 () {56 vars in 1249 bytes} [Thu Jun 16 16:04:30 2022] GET /identity/v3/endpoints?service_id=07fe3b58f9014774b381088fc1269406&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:30.928179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480610eb-d944-49fa-9f4f-c2d05495165a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:30.990624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:31.035054 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480610eb-d944-49fa-9f4f-c2d05495165a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:31.068617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620bb1d-8bb5-4821-b305-764c7f195521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:31.069280 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620bb1d-8bb5-4821-b305-764c7f195521 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:31.069561 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620bb1d-8bb5-4821-b305-764c7f195521 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:31.069837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620bb1d-8bb5-4821-b305-764c7f195521 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:31.070811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620bb1d-8bb5-4821-b305-764c7f195521 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:31.072167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620bb1d-8bb5-4821-b305-764c7f195521 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:31.086465 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 500/989] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 16 16:04:30 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:04:31.272717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca42c1-5ebf-4b1c-bce4-168c138d701f None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:31.273241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca42c1-5ebf-4b1c-bce4-168c138d701f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:31.273241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca42c1-5ebf-4b1c-bce4-168c138d701f None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:31.274805 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 490/990] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:31.281362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735330b1-866d-4124-84d8-7496c5f71298 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:31.281888 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735330b1-866d-4124-84d8-7496c5f71298 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:31.281981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735330b1-866d-4124-84d8-7496c5f71298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:31.298994 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-735330b1-866d-4124-84d8-7496c5f71298 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:31.300169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-735330b1-866d-4124-84d8-7496c5f71298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:31.320034 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baec467-1fbf-45c9-903a-ac5ed486d70b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:31.320593 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baec467-1fbf-45c9-903a-ac5ed486d70b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:31.320863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baec467-1fbf-45c9-903a-ac5ed486d70b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:31.322356 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 491/991] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:31.327775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f55fe8-5b18-4cdf-be1b-a33c2ba35581 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:31.328064 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f55fe8-5b18-4cdf-be1b-a33c2ba35581 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:31.328343 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f55fe8-5b18-4cdf-be1b-a33c2ba35581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:31.345203 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b5f55fe8-5b18-4cdf-be1b-a33c2ba35581 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:31.346405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b5f55fe8-5b18-4cdf-be1b-a33c2ba35581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:31.381020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 501/992] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:31.404060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735330b1-866d-4124-84d8-7496c5f71298 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:31.424062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 492/993] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:31.447960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f55fe8-5b18-4cdf-be1b-a33c2ba35581 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:31.464921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:31.511117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:31.518909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735330b1-866d-4124-84d8-7496c5f71298 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:31.558963 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e024c-ea23-4837-93ef-d775563dcdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:31.560256 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f55fe8-5b18-4cdf-be1b-a33c2ba35581 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:31.560914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e024c-ea23-4837-93ef-d775563dcdb3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:31.561409 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e024c-ea23-4837-93ef-d775563dcdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:31.561992 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e024c-ea23-4837-93ef-d775563dcdb3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:31.562995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e024c-ea23-4837-93ef-d775563dcdb3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:31.564460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e024c-ea23-4837-93ef-d775563dcdb3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-b82e024c-ea23-4837-93ef-d775563dcdb3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:31.578707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:31.579843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:31.580726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:31.580726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:31.580726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:31.580726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:31.580726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:31.580726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:31.580726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:31.580726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:31.580726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:31.580726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:31.580726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:31.580726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:31.580726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 16:04:31.580726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:31.580726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 502/994] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:31.585826 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e024c-ea23-4837-93ef-d775563dcdb3 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:31.600388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76e01d-cc9c-4d7e-80ef-dec991c14ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:31.601193 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76e01d-cc9c-4d7e-80ef-dec991c14ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:31.601489 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76e01d-cc9c-4d7e-80ef-dec991c14ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:31.601765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76e01d-cc9c-4d7e-80ef-dec991c14ca9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:31.602447 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76e01d-cc9c-4d7e-80ef-dec991c14ca9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:31.603835 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76e01d-cc9c-4d7e-80ef-dec991c14ca9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-ea76e01d-cc9c-4d7e-80ef-dec991c14ca9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:31.616074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:31.618473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:31.619405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:31.619405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:31.619405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:31.619405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:31.619405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:31.619405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:31.619405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:31.619405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:31.619405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:31.619405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:31.619405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:31.619405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:31.619405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 16:04:31.619405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:31.619405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 493/995] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Jun 16 16:04:31 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:31.623813 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76e01d-cc9c-4d7e-80ef-dec991c14ca9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:31.699065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e024c-ea23-4837-93ef-d775563dcdb3 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:31.718912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:31.736642 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76e01d-cc9c-4d7e-80ef-dec991c14ca9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:31.744535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f34215-cb14-43a9-8135-6898ef0b4d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:31.745205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f34215-cb14-43a9-8135-6898ef0b4d63 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:31.745489 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f34215-cb14-43a9-8135-6898ef0b4d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:31.745765 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f34215-cb14-43a9-8135-6898ef0b4d63 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:31.746493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f34215-cb14-43a9-8135-6898ef0b4d63 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:31.747756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f34215-cb14-43a9-8135-6898ef0b4d63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:31.748874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f34215-cb14-43a9-8135-6898ef0b4d63 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:31.758560 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 503/996] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 16 16:04:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:31.759505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f34215-cb14-43a9-8135-6898ef0b4d63 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:31.767822 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:31.781467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58a250-0319-4d9d-acbb-c399693d95fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:31.782219 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58a250-0319-4d9d-acbb-c399693d95fe None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:31.782534 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58a250-0319-4d9d-acbb-c399693d95fe None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:31.783240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58a250-0319-4d9d-acbb-c399693d95fe None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:31.783626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58a250-0319-4d9d-acbb-c399693d95fe None admin] RBAC: Adding query filter params (name=image) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:31.783932 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58a250-0319-4d9d-acbb-c399693d95fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:31.785289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58a250-0319-4d9d-acbb-c399693d95fe None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:31.791239 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 494/997] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:31.797708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58a250-0319-4d9d-acbb-c399693d95fe None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:31.871054 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f34215-cb14-43a9-8135-6898ef0b4d63 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:31.909774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501a533-3cae-444a-8f58-fcdc803245bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:31.910469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501a533-3cae-444a-8f58-fcdc803245bf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:31.910758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501a533-3cae-444a-8f58-fcdc803245bf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:31.911042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501a533-3cae-444a-8f58-fcdc803245bf None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:31.911748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501a533-3cae-444a-8f58-fcdc803245bf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:31.912056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501a533-3cae-444a-8f58-fcdc803245bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:31.913427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501a533-3cae-444a-8f58-fcdc803245bf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:31.923622 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 504/998] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 16 16:04:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:31.924651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501a533-3cae-444a-8f58-fcdc803245bf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:31.929310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58a250-0319-4d9d-acbb-c399693d95fe None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:31.968052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60859f33-93a7-459b-9539-8ced89fcf786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:31.968746 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60859f33-93a7-459b-9539-8ced89fcf786 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:31.969036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60859f33-93a7-459b-9539-8ced89fcf786 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:31.969635 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60859f33-93a7-459b-9539-8ced89fcf786 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:31.970346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60859f33-93a7-459b-9539-8ced89fcf786 None admin] RBAC: Adding query filter params (type=image) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:31.970688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60859f33-93a7-459b-9539-8ced89fcf786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:31.972054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60859f33-93a7-459b-9539-8ced89fcf786 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:31.973069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:31.978377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 495/999] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:32.039915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501a533-3cae-444a-8f58-fcdc803245bf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:32.080399 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e0fc2-6c5d-4a6e-a9a6-cbb0428da1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:32.081089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0fc2-6c5d-4a6e-a9a6-cbb0428da1af None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:32.081376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0fc2-6c5d-4a6e-a9a6-cbb0428da1af None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:32.081655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0fc2-6c5d-4a6e-a9a6-cbb0428da1af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:32.082495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e0fc2-6c5d-4a6e-a9a6-cbb0428da1af None admin] RBAC: Adding query filter params (interface=public, service_id=73474a4c55064b9c9b67dd9ccd50ed39, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:32.082820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e0fc2-6c5d-4a6e-a9a6-cbb0428da1af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:32.084220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e0fc2-6c5d-4a6e-a9a6-cbb0428da1af None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:32.095344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 505/1000] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 16 16:04:31 2022] GET /identity/v3/endpoints?service_id=73474a4c55064b9c9b67dd9ccd50ed39&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:32.096567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60859f33-93a7-459b-9539-8ced89fcf786 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:32.157913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:32.212804 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60859f33-93a7-459b-9539-8ced89fcf786 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:32.249259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab7520-6c16-4fc9-983f-14468bac0bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:32.249951 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7520-6c16-4fc9-983f-14468bac0bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:32.250236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7520-6c16-4fc9-983f-14468bac0bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:32.250553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7520-6c16-4fc9-983f-14468bac0bb5 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:32.251245 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab7520-6c16-4fc9-983f-14468bac0bb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:32.252619 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab7520-6c16-4fc9-983f-14468bac0bb5 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:32.266460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 496/1001] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 16 16:04:32 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:04:33.242660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c279ab2-1124-40b3-8477-89edbf2f48d8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:33.243186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c279ab2-1124-40b3-8477-89edbf2f48d8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:33.243266 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c279ab2-1124-40b3-8477-89edbf2f48d8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:33.244712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 506/1002] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:33.250450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33c225-b98f-4535-a078-7e5b16536e3f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:33.250860 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33c225-b98f-4535-a078-7e5b16536e3f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:33.251024 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33c225-b98f-4535-a078-7e5b16536e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:33.268265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ad33c225-b98f-4535-a078-7e5b16536e3f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:33.269445 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ad33c225-b98f-4535-a078-7e5b16536e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:33.347957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 497/1003] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:33.375424 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c279ab2-1124-40b3-8477-89edbf2f48d8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:33.481521 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c279ab2-1124-40b3-8477-89edbf2f48d8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:33.492539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:33.517968 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e5ce4-7142-469e-8d1f-562f0087eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:33.518724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e5ce4-7142-469e-8d1f-562f0087eafa None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:33.519006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e5ce4-7142-469e-8d1f-562f0087eafa None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:33.519280 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e5ce4-7142-469e-8d1f-562f0087eafa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:33.519929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e5ce4-7142-469e-8d1f-562f0087eafa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:33.521296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e5ce4-7142-469e-8d1f-562f0087eafa None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6b4e5ce4-7142-469e-8d1f-562f0087eafa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:33.534551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:33.535611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:33.536485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:33.536485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:33.536485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:33.536485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:33.536485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:33.536485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:33.536485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:33.536485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:33.536485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:33.536485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:33.536485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:33.536485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:33.536485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 16:04:33.536485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:33.538499 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 507/1004] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 16 16:04:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:33.542024 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33c225-b98f-4535-a078-7e5b16536e3f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:33.591960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:33.647378 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33c225-b98f-4535-a078-7e5b16536e3f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:33.682978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bbd8e-3508-43e1-93e9-4b8e069dead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:33.683680 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bbd8e-3508-43e1-93e9-4b8e069dead7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:33.683966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bbd8e-3508-43e1-93e9-4b8e069dead7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:33.684328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bbd8e-3508-43e1-93e9-4b8e069dead7 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:33.685231 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bbd8e-3508-43e1-93e9-4b8e069dead7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:33.685409 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bbd8e-3508-43e1-93e9-4b8e069dead7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:33.686876 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bbd8e-3508-43e1-93e9-4b8e069dead7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:33.697259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 498/1005] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 16 16:04:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:33.698819 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e5ce4-7142-469e-8d1f-562f0087eafa None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:33.805920 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e5ce4-7142-469e-8d1f-562f0087eafa None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:33.841526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bdd7b-111d-484a-a404-d316c96911de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:33.842239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bdd7b-111d-484a-a404-d316c96911de None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:33.842546 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bdd7b-111d-484a-a404-d316c96911de None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:33.842824 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bdd7b-111d-484a-a404-d316c96911de None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:33.843533 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bdd7b-111d-484a-a404-d316c96911de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:33.843841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bdd7b-111d-484a-a404-d316c96911de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:33.845222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bdd7b-111d-484a-a404-d316c96911de None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:33.850530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 508/1006] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 16 16:04:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:33.856902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bbd8e-3508-43e1-93e9-4b8e069dead7 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:33.961511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bbd8e-3508-43e1-93e9-4b8e069dead7 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:33.973279 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:33.999486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c797a-a63a-4a66-8a19-978219fcd542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:34.000162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c797a-a63a-4a66-8a19-978219fcd542 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:34.000453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c797a-a63a-4a66-8a19-978219fcd542 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:34.000814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c797a-a63a-4a66-8a19-978219fcd542 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:34.001556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c797a-a63a-4a66-8a19-978219fcd542 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:34.002968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c797a-a63a-4a66-8a19-978219fcd542 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:34.019513 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 499/1007] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 16 16:04:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:04:34.196183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a66205-c305-45fd-bcb0-a1b42aff0f47 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:34.196466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a66205-c305-45fd-bcb0-a1b42aff0f47 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:34.196742 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a66205-c305-45fd-bcb0-a1b42aff0f47 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:34.198126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 509/1008] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:34.203851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcc5b7-2676-46bc-951b-c145211398ca None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:34.204144 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcc5b7-2676-46bc-951b-c145211398ca None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:34.204429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcc5b7-2676-46bc-951b-c145211398ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:34.221811 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-25dcc5b7-2676-46bc-951b-c145211398ca None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:34.223051 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-25dcc5b7-2676-46bc-951b-c145211398ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:34.301451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 500/1009] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:34.324091 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a66205-c305-45fd-bcb0-a1b42aff0f47 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:34.377337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:34.446613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a66205-c305-45fd-bcb0-a1b42aff0f47 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:34.457076 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e4da6-0b99-47e1-b38f-c713b535c246 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:34.457373 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e4da6-0b99-47e1-b38f-c713b535c246 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:34.457663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e4da6-0b99-47e1-b38f-c713b535c246 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:34.459208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 501/1010] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:34.463829 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c81a5d-832e-4a08-aeb1-ae86ef935254 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:34.464124 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c81a5d-832e-4a08-aeb1-ae86ef935254 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:34.464410 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c81a5d-832e-4a08-aeb1-ae86ef935254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:34.482400 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e0c81a5d-832e-4a08-aeb1-ae86ef935254 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:34.483643 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e0c81a5d-832e-4a08-aeb1-ae86ef935254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:34.483947 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd625c-1b29-482e-8107-06372aa209f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:34.484613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd625c-1b29-482e-8107-06372aa209f4 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:34.484894 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd625c-1b29-482e-8107-06372aa209f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:34.485169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd625c-1b29-482e-8107-06372aa209f4 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:34.485899 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd625c-1b29-482e-8107-06372aa209f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:34.487305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd625c-1b29-482e-8107-06372aa209f4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:34.502484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 510/1011] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 16 16:04:34 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:04:34.567342 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 502/1012] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:34 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:34.592670 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd625c-1b29-482e-8107-06372aa209f4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:34.711378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:34.717961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd625c-1b29-482e-8107-06372aa209f4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:34.757328 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91821853-6d2b-43ab-8199-eb5ff4c08f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:34.758483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91821853-6d2b-43ab-8199-eb5ff4c08f21 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:34.758939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91821853-6d2b-43ab-8199-eb5ff4c08f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:34.759382 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91821853-6d2b-43ab-8199-eb5ff4c08f21 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:34.760202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91821853-6d2b-43ab-8199-eb5ff4c08f21 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:34.761728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91821853-6d2b-43ab-8199-eb5ff4c08f21 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-91821853-6d2b-43ab-8199-eb5ff4c08f21 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:34.774760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:34.775781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:34.776651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:34.776651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:34.776651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:34.776651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:34.776651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:34.776651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:34.776651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:34.776651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:34.776651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:34.776651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:34.776651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:34.776651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:34.776651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 16:04:34.776651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:34.779830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 511/1013] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:34.785625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c81a5d-832e-4a08-aeb1-ae86ef935254 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:34.810120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:34.891003 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c81a5d-832e-4a08-aeb1-ae86ef935254 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:34.927261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9fad3-69fa-40ce-9900-0175e806ddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:34.927933 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9fad3-69fa-40ce-9900-0175e806ddae None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:34.928216 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9fad3-69fa-40ce-9900-0175e806ddae None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:34.928492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9fad3-69fa-40ce-9900-0175e806ddae None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:34.929191 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9fad3-69fa-40ce-9900-0175e806ddae None admin] RBAC: Adding query filter params (name=compute) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:34.929494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9fad3-69fa-40ce-9900-0175e806ddae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:34.930885 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9fad3-69fa-40ce-9900-0175e806ddae None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:34.941140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 503/1014] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 16 16:04:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:34.942396 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91821853-6d2b-43ab-8199-eb5ff4c08f21 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:35.055690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91821853-6d2b-43ab-8199-eb5ff4c08f21 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:35.090690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baac3e-30e7-44b8-8d81-72c3e4f83c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:35.091360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baac3e-30e7-44b8-8d81-72c3e4f83c7b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:35.091641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baac3e-30e7-44b8-8d81-72c3e4f83c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:35.091915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baac3e-30e7-44b8-8d81-72c3e4f83c7b None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:35.092613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baac3e-30e7-44b8-8d81-72c3e4f83c7b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:35.092914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baac3e-30e7-44b8-8d81-72c3e4f83c7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:35.094280 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baac3e-30e7-44b8-8d81-72c3e4f83c7b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:35.099543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 512/1015] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 16 16:04:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:35.106769 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9fad3-69fa-40ce-9900-0175e806ddae None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:35.200299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:35.216966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9fad3-69fa-40ce-9900-0175e806ddae None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:35.253991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26548a66-244f-425c-bf96-7153d5cff385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:35.254684 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26548a66-244f-425c-bf96-7153d5cff385 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:35.254966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26548a66-244f-425c-bf96-7153d5cff385 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:35.255240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26548a66-244f-425c-bf96-7153d5cff385 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:35.255978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26548a66-244f-425c-bf96-7153d5cff385 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:35.257336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26548a66-244f-425c-bf96-7153d5cff385 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:35.279072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 504/1016] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 16 16:04:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:04:36.192557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823ed4f-cf4e-4375-a12c-1b914831a4fc None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:36.193125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823ed4f-cf4e-4375-a12c-1b914831a4fc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:36.193125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823ed4f-cf4e-4375-a12c-1b914831a4fc None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:36.194667 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 513/1017] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:36.200380 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbfe7e-e011-4721-9a1e-9f9664df5d2b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:36.200902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbfe7e-e011-4721-9a1e-9f9664df5d2b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:36.200992 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbfe7e-e011-4721-9a1e-9f9664df5d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:36.218018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-00dbfe7e-e011-4721-9a1e-9f9664df5d2b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:36.219220 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-00dbfe7e-e011-4721-9a1e-9f9664df5d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:36.296352 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 505/1018] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:36.319215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823ed4f-cf4e-4375-a12c-1b914831a4fc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:36.352204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:36.434449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823ed4f-cf4e-4375-a12c-1b914831a4fc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:36.469515 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fa53a-61d2-45c1-aaa4-f1afb783e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:36.470247 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fa53a-61d2-45c1-aaa4-f1afb783e7ca None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:36.470559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fa53a-61d2-45c1-aaa4-f1afb783e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:36.470838 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fa53a-61d2-45c1-aaa4-f1afb783e7ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:36.472106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fa53a-61d2-45c1-aaa4-f1afb783e7ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:36.473576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fa53a-61d2-45c1-aaa4-f1afb783e7ca None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:36.475501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 514/1019] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:36.481055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbfe7e-e011-4721-9a1e-9f9664df5d2b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:36.550934 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:36.588845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbfe7e-e011-4721-9a1e-9f9664df5d2b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:36.624048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353d778-fc56-414c-a2ba-5706669058fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:36.624717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353d778-fc56-414c-a2ba-5706669058fe None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:36.625002 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353d778-fc56-414c-a2ba-5706669058fe None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:36.625281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353d778-fc56-414c-a2ba-5706669058fe None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:36.625997 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353d778-fc56-414c-a2ba-5706669058fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:36.627450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353d778-fc56-414c-a2ba-5706669058fe None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:36.658482 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 506/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 16 16:04:36 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:04:36.801251 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35efd3b-9659-48f0-aa78-8e5ab9791aa9 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:36.801555 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35efd3b-9659-48f0-aa78-8e5ab9791aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:36.801741 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35efd3b-9659-48f0-aa78-8e5ab9791aa9 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:36.803367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 515/1021] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:36.808761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b188579-aa8f-4045-96e1-dbd9cc1c5e49 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:36.809630 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b188579-aa8f-4045-96e1-dbd9cc1c5e49 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:36.809923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b188579-aa8f-4045-96e1-dbd9cc1c5e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:36.829650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9b188579-aa8f-4045-96e1-dbd9cc1c5e49 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:36.830894 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9b188579-aa8f-4045-96e1-dbd9cc1c5e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:36.904063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 507/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:36.926976 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35efd3b-9659-48f0-aa78-8e5ab9791aa9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:37.029333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:37.039229 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35efd3b-9659-48f0-aa78-8e5ab9791aa9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:37.073589 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a103cc-1575-46db-888d-4dfb40c255ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:37.074407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a103cc-1575-46db-888d-4dfb40c255ca None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:37.075310 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a103cc-1575-46db-888d-4dfb40c255ca None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:37.075589 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a103cc-1575-46db-888d-4dfb40c255ca None admin] PATH_INFO: `/v3/services/image` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:37.076245 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a103cc-1575-46db-888d-4dfb40c255ca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:37.077599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a103cc-1575-46db-888d-4dfb40c255ca None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f2a103cc-1575-46db-888d-4dfb40c255ca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:37.089572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:37.092092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:37.092950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:37.092950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:37.092950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:37.092950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:37.092950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:37.092950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:37.092950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:37.092950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:37.092950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:37.092950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:37.092950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:37.092950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:37.092950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 16:04:37.092950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:37.092950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 516/1023] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Jun 16 16:04:36 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:37.100112 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b188579-aa8f-4045-96e1-dbd9cc1c5e49 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:37.154624 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:37.209779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b188579-aa8f-4045-96e1-dbd9cc1c5e49 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:37.244715 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7973e-c832-4854-b2fe-9c0aaadb130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:37.245395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7973e-c832-4854-b2fe-9c0aaadb130a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:37.245689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7973e-c832-4854-b2fe-9c0aaadb130a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:37.245979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7973e-c832-4854-b2fe-9c0aaadb130a None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:37.247185 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7973e-c832-4854-b2fe-9c0aaadb130a None admin] RBAC: Adding query filter params (name=image) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:37.247185 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7973e-c832-4854-b2fe-9c0aaadb130a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:37.248546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7973e-c832-4854-b2fe-9c0aaadb130a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:37.258545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 508/1024] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:37.260202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a103cc-1575-46db-888d-4dfb40c255ca None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:37.391121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a103cc-1575-46db-888d-4dfb40c255ca None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:37.428281 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31977221-12d7-43ad-8518-80420cca0db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:37.428955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31977221-12d7-43ad-8518-80420cca0db1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:37.429239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31977221-12d7-43ad-8518-80420cca0db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:37.429514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31977221-12d7-43ad-8518-80420cca0db1 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:37.430227 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31977221-12d7-43ad-8518-80420cca0db1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:37.430565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31977221-12d7-43ad-8518-80420cca0db1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:37.431933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31977221-12d7-43ad-8518-80420cca0db1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:37.442734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 517/1025] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:37.443745 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7973e-c832-4854-b2fe-9c0aaadb130a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:37.539429 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c06454-e296-43e7-8a5a-6204b11e3244 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:37.539752 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c06454-e296-43e7-8a5a-6204b11e3244 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:37.540002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c06454-e296-43e7-8a5a-6204b11e3244 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:37.541511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 518/1026] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:37.546934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39e610-6aed-4eea-af10-878706de8f43 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:37.547221 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39e610-6aed-4eea-af10-878706de8f43 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:37.547498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39e610-6aed-4eea-af10-878706de8f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:37.561327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7973e-c832-4854-b2fe-9c0aaadb130a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:37.565232 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3e39e610-6aed-4eea-af10-878706de8f43 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:37.566470 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3e39e610-6aed-4eea-af10-878706de8f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:37.577172 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:37.586967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:37.600365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c66df-0f53-44d5-878e-faa56824ece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:37.601084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c66df-0f53-44d5-878e-faa56824ece7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:37.601372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c66df-0f53-44d5-878e-faa56824ece7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:37.601654 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c66df-0f53-44d5-878e-faa56824ece7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:37.602535 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c66df-0f53-44d5-878e-faa56824ece7 None admin] RBAC: Adding query filter params (interface=public, service_id=b7ef84955bbe40d2884a7b9c8af0a6aa, region_id=RegionOne) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:37.602857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c66df-0f53-44d5-878e-faa56824ece7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:37.604286 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c66df-0f53-44d5-878e-faa56824ece7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:37.610959 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 509/1027] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 16 16:04:37 2022] GET /identity/v3/endpoints?service_id=b7ef84955bbe40d2884a7b9c8af0a6aa&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:37.616528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c66df-0f53-44d5-878e-faa56824ece7 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:37.645710 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 519/1028] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:37.669742 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39e610-6aed-4eea-af10-878706de8f43 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:37.730233 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c66df-0f53-44d5-878e-faa56824ece7 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:37.769645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4d54c-4ae7-492c-8c6f-bf9ee8ca5c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:37.770324 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4d54c-4ae7-492c-8c6f-bf9ee8ca5c9f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:37.770646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4d54c-4ae7-492c-8c6f-bf9ee8ca5c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:37.770929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4d54c-4ae7-492c-8c6f-bf9ee8ca5c9f None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:37.771623 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4d54c-4ae7-492c-8c6f-bf9ee8ca5c9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:37.772983 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4d54c-4ae7-492c-8c6f-bf9ee8ca5c9f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:37.779142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39e610-6aed-4eea-af10-878706de8f43 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:37.790458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 510/1029] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 16 16:04:37 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:04:37.819051 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00ecd6-7bc4-4e7d-886e-4a1eb3ce2908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:37.819907 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00ecd6-7bc4-4e7d-886e-4a1eb3ce2908 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:37.820446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00ecd6-7bc4-4e7d-886e-4a1eb3ce2908 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:37.820730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00ecd6-7bc4-4e7d-886e-4a1eb3ce2908 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:37.833864 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00ecd6-7bc4-4e7d-886e-4a1eb3ce2908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6f00ecd6-7bc4-4e7d-886e-4a1eb3ce2908 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:04:37.843042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:37.844106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:37.845002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:37.845002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:37.845002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:37.845002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:37.845002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:04:37.845002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:04:37.845002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:04:37.845002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:04:37.845002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:04:37.845002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:04:37.845002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 16:04:37.845002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:37.846775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 520/1030] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jun 16 16:04:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:37.850340 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4d54c-4ae7-492c-8c6f-bf9ee8ca5c9f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:37.899669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:37.964313 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4d54c-4ae7-492c-8c6f-bf9ee8ca5c9f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:38.001310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ba44b-c6fb-4579-a5e3-7757218d0ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:38.001992 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ba44b-c6fb-4579-a5e3-7757218d0ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:38.002278 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ba44b-c6fb-4579-a5e3-7757218d0ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:38.002594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ba44b-c6fb-4579-a5e3-7757218d0ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:38.003343 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ba44b-c6fb-4579-a5e3-7757218d0ed3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:38.003652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ba44b-c6fb-4579-a5e3-7757218d0ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:38.005011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ba44b-c6fb-4579-a5e3-7757218d0ed3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:38.014258 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 511/1031] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jun 16 16:04:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:38.019670 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00ecd6-7bc4-4e7d-886e-4a1eb3ce2908 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:38.037414 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:38.132803 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00ecd6-7bc4-4e7d-886e-4a1eb3ce2908 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:38.167133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73fcf6-65f0-45c2-b5d1-137055f99c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:38.167999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73fcf6-65f0-45c2-b5d1-137055f99c1b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:38.169117 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73fcf6-65f0-45c2-b5d1-137055f99c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:38.169455 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73fcf6-65f0-45c2-b5d1-137055f99c1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:38.180242 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73fcf6-65f0-45c2-b5d1-137055f99c1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:38.181690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73fcf6-65f0-45c2-b5d1-137055f99c1b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:38.199137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-4a73fcf6-65f0-45c2-b5d1-137055f99c1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:38.199137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:38.199137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:38.199137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:38.199137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:38.199137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:38.199137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:38.199137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:38.199137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:38.199137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:38.199137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:38.199137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:38.199137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:38.199137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:38.199137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:38.200057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:38.201144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:38.201144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:38.201144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:38.201144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:38.206481 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 521/1032] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:38.206622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ba44b-c6fb-4579-a5e3-7757218d0ed3 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:38.311368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ba44b-c6fb-4579-a5e3-7757218d0ed3 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:38.313814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:38.353041 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b95d8-2f6f-41ce-9ec3-2ed32a536b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:38.353722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b95d8-2f6f-41ce-9ec3-2ed32a536b3e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:38.354009 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b95d8-2f6f-41ce-9ec3-2ed32a536b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:38.354287 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b95d8-2f6f-41ce-9ec3-2ed32a536b3e None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:38.355052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b95d8-2f6f-41ce-9ec3-2ed32a536b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:38.355361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b95d8-2f6f-41ce-9ec3-2ed32a536b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:38.357512 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b95d8-2f6f-41ce-9ec3-2ed32a536b3e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:38.376234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 512/1033] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:38.377482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73fcf6-65f0-45c2-b5d1-137055f99c1b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:38.443669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:38.485015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73fcf6-65f0-45c2-b5d1-137055f99c1b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:38.520187 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213ebbc-88bf-4e40-8f28-cb0a868e6abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:38.520992 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213ebbc-88bf-4e40-8f28-cb0a868e6abb None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:38.521279 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213ebbc-88bf-4e40-8f28-cb0a868e6abb None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:38.521558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213ebbc-88bf-4e40-8f28-cb0a868e6abb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:38.530310 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213ebbc-88bf-4e40-8f28-cb0a868e6abb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:38.531819 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213ebbc-88bf-4e40-8f28-cb0a868e6abb None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e213ebbc-88bf-4e40-8f28-cb0a868e6abb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:04:38.546493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:38.547505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:38.553306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:38.553306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:38.553306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:04:38.553306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:04:38.553306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:04:38.553306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:04:38.553306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:04:38.553306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:04:38.553306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:04:38.553306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:38.553306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 522/1034] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 16 16:04:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:38.553924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b95d8-2f6f-41ce-9ec3-2ed32a536b3e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:38.658531 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b95d8-2f6f-41ce-9ec3-2ed32a536b3e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:38.692516 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c79aed-2ed4-4a75-ab9d-21af1cbca124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:38.693206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c79aed-2ed4-4a75-ab9d-21af1cbca124 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:38.693494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c79aed-2ed4-4a75-ab9d-21af1cbca124 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:38.693830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c79aed-2ed4-4a75-ab9d-21af1cbca124 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:38.694641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c79aed-2ed4-4a75-ab9d-21af1cbca124 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:38.694960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c79aed-2ed4-4a75-ab9d-21af1cbca124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:38.696656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c79aed-2ed4-4a75-ab9d-21af1cbca124 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:38.721010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 513/1035] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 16 16:04:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:38.722697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213ebbc-88bf-4e40-8f28-cb0a868e6abb None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:38.835087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213ebbc-88bf-4e40-8f28-cb0a868e6abb None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:38.862905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:38.874951 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d3ae0-c6e6-47a9-b6b1-22af011f05f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:38.875609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d3ae0-c6e6-47a9-b6b1-22af011f05f9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:38.875892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d3ae0-c6e6-47a9-b6b1-22af011f05f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:38.876248 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d3ae0-c6e6-47a9-b6b1-22af011f05f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:38.906299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26735b82-d761-4f6e-91ef-2a99bac54f46 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:38.906299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26735b82-d761-4f6e-91ef-2a99bac54f46 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:38.906299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26735b82-d761-4f6e-91ef-2a99bac54f46 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:38.908011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 514/1036] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:38.912610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780da18-5bfe-40ad-ac49-7a373f6186de None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:38.912903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780da18-5bfe-40ad-ac49-7a373f6186de None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:38.913187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780da18-5bfe-40ad-ac49-7a373f6186de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:38.931348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a780da18-5bfe-40ad-ac49-7a373f6186de None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:38.932649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a780da18-5bfe-40ad-ac49-7a373f6186de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:38.953945 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d3ae0-c6e6-47a9-b6b1-22af011f05f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:38.954744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:38.955359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d3ae0-c6e6-47a9-b6b1-22af011f05f9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:39.011135 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 515/1037] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:39.037721 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780da18-5bfe-40ad-ac49-7a373f6186de None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:39.068677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 523/1038] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:04:38 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 16:04:39.074906 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d3ae0-c6e6-47a9-b6b1-22af011f05f9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:39.102081 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:39.144818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780da18-5bfe-40ad-ac49-7a373f6186de None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:39.182525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf461e17-033b-414c-bf27-54faad38f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:39.183328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf461e17-033b-414c-bf27-54faad38f074 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:39.183611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf461e17-033b-414c-bf27-54faad38f074 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:39.183912 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf461e17-033b-414c-bf27-54faad38f074 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:39.185222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf461e17-033b-414c-bf27-54faad38f074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:39.186694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf461e17-033b-414c-bf27-54faad38f074 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:39.188482 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 516/1039] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:39.190847 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d3ae0-c6e6-47a9-b6b1-22af011f05f9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:39.193864 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf461e17-033b-414c-bf27-54faad38f074 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:39.216801 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:39.232830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad05697-283c-4d26-af95-e117a06907d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:39.233628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad05697-283c-4d26-af95-e117a06907d4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:39.233915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad05697-283c-4d26-af95-e117a06907d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:39.234191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad05697-283c-4d26-af95-e117a06907d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:39.245295 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad05697-283c-4d26-af95-e117a06907d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:39.246719 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad05697-283c-4d26-af95-e117a06907d4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:39.265506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-fad05697-283c-4d26-af95-e117a06907d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:39.265506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:39.265506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:39.265506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:39.265506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:39.265506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:39.265506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:39.265506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:39.265506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:39.265506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:39.265506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:39.265506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:39.265506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:39.265506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:39.265506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:39.266493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:39.267432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:39.267432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:39.267432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:39.267432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:39.267432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 524/1040] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:39.272699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad05697-283c-4d26-af95-e117a06907d4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:39.307529 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf461e17-033b-414c-bf27-54faad38f074 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:39.348443 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56a4d3-4538-41a3-aa0c-760f0034abdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:39.349128 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56a4d3-4538-41a3-aa0c-760f0034abdc None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:39.349448 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56a4d3-4538-41a3-aa0c-760f0034abdc None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:39.349687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56a4d3-4538-41a3-aa0c-760f0034abdc None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:39.350398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56a4d3-4538-41a3-aa0c-760f0034abdc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:39.352285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56a4d3-4538-41a3-aa0c-760f0034abdc None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:39.360029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:39.382602 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 517/1041] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:04:39 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:04:39.398980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad05697-283c-4d26-af95-e117a06907d4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:39.438985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08d682-5633-40d7-afea-701b5f8842e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:39.439681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08d682-5633-40d7-afea-701b5f8842e7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:39.439964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08d682-5633-40d7-afea-701b5f8842e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:39.440239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08d682-5633-40d7-afea-701b5f8842e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:39.440995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08d682-5633-40d7-afea-701b5f8842e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:39.441382 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08d682-5633-40d7-afea-701b5f8842e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:39.443183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08d682-5633-40d7-afea-701b5f8842e7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:39.461713 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 525/1042] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:39.463006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56a4d3-4538-41a3-aa0c-760f0034abdc None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:39.550650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:39.576718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56a4d3-4538-41a3-aa0c-760f0034abdc None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:39.614363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19469f06-f36c-422f-bb4e-70fa6f4ff4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:39.615217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19469f06-f36c-422f-bb4e-70fa6f4ff4ed None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:39.615504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19469f06-f36c-422f-bb4e-70fa6f4ff4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:39.615852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19469f06-f36c-422f-bb4e-70fa6f4ff4ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:39.623013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19469f06-f36c-422f-bb4e-70fa6f4ff4ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:39.624466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19469f06-f36c-422f-bb4e-70fa6f4ff4ed None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:39.639573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-19469f06-f36c-422f-bb4e-70fa6f4ff4ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:39.639573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:39.639573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:39.639573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:39.639573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:39.639573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:39.639573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:39.639573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:39.639573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:39.639573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:39.639573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:39.639573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:39.639573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:04:39.639573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:04:39.639573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:39.640557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:39.641467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:04:39.641467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:04:39.641467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:04:39.641467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:04:39.641467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:04:39.641467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:04:39.641467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:39.641467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:39.641467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 518/1043] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:39.646918 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08d682-5633-40d7-afea-701b5f8842e7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:39.752713 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08d682-5633-40d7-afea-701b5f8842e7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:39.788681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a0dfb-d383-4b98-aac0-9c4e8126bac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:39.789349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a0dfb-d383-4b98-aac0-9c4e8126bac0 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:39.789632 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a0dfb-d383-4b98-aac0-9c4e8126bac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:39.789908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a0dfb-d383-4b98-aac0-9c4e8126bac0 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:39.790726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a0dfb-d383-4b98-aac0-9c4e8126bac0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:39.791047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a0dfb-d383-4b98-aac0-9c4e8126bac0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:39.792475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a0dfb-d383-4b98-aac0-9c4e8126bac0 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:39.795699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:39.806610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 526/1044] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:04:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:39.813475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19469f06-f36c-422f-bb4e-70fa6f4ff4ed None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:39.913494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19469f06-f36c-422f-bb4e-70fa6f4ff4ed None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:39.953120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d578996-2515-4528-9bde-89f660a2cc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:39.953818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578996-2515-4528-9bde-89f660a2cc6d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:39.954107 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578996-2515-4528-9bde-89f660a2cc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:39.954389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578996-2515-4528-9bde-89f660a2cc6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:39.955291 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d578996-2515-4528-9bde-89f660a2cc6d None admin] RBAC: Adding query filter params (role.id=74eb0d20197044ea95b7e71c9a8b329c, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=795c029cb14b42b5b0f3987e218d4239) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:39.955615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d578996-2515-4528-9bde-89f660a2cc6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:39.957113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d578996-2515-4528-9bde-89f660a2cc6d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:39.961226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:39.970476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 519/1045] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:04:39 2022] GET /identity/v3/role_assignments?user.id=795c029cb14b42b5b0f3987e218d4239&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=74eb0d20197044ea95b7e71c9a8b329c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:40.029593 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f89b4-5326-4b24-a552-fda0cf63cdee None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:40.029964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f89b4-5326-4b24-a552-fda0cf63cdee None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:40.030162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f89b4-5326-4b24-a552-fda0cf63cdee None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:40.032327 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 527/1046] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:40.038098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5a70f-7d1d-4fa2-99f0-d2638fa94f1c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:40.038390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5a70f-7d1d-4fa2-99f0-d2638fa94f1c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:40.038729 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5a70f-7d1d-4fa2-99f0-d2638fa94f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:40.057628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-52c5a70f-7d1d-4fa2-99f0-d2638fa94f1c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:40.058952 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-52c5a70f-7d1d-4fa2-99f0-d2638fa94f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:40.140539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 520/1047] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:40.164612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f89b4-5326-4b24-a552-fda0cf63cdee None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:40.272790 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f89b4-5326-4b24-a552-fda0cf63cdee None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:40.306947 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e368c-7e98-4190-886f-d2a98b0a1b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:40.308010 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e368c-7e98-4190-886f-d2a98b0a1b71 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:40.308235 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e368c-7e98-4190-886f-d2a98b0a1b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:40.308510 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e368c-7e98-4190-886f-d2a98b0a1b71 None admin] PATH_INFO: `/v3/services/image` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:40.309814 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e368c-7e98-4190-886f-d2a98b0a1b71 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:40.311225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e368c-7e98-4190-886f-d2a98b0a1b71 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-da1e368c-7e98-4190-886f-d2a98b0a1b71 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:40.323134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:40.324198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:40.330865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:40.330865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:40.330865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:40.330865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:40.330865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:40.330865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:40.330865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:40.330865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:40.330865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:40.330865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:40.330865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:04:40.330865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:04:40.330865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 16:04:40.330865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:40.330865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 528/1048] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Jun 16 16:04:40 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:40.333492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5a70f-7d1d-4fa2-99f0-d2638fa94f1c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:40.445011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5a70f-7d1d-4fa2-99f0-d2638fa94f1c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:40.476153 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:40.483457 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcb305-4f1c-41f0-bc27-8a0ecf28275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:40.484137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcb305-4f1c-41f0-bc27-8a0ecf28275f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:40.484422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcb305-4f1c-41f0-bc27-8a0ecf28275f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:40.484701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcb305-4f1c-41f0-bc27-8a0ecf28275f None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:40.485410 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcb305-4f1c-41f0-bc27-8a0ecf28275f None admin] RBAC: Adding query filter params (name=image) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:40.485719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcb305-4f1c-41f0-bc27-8a0ecf28275f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:40.487112 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcb305-4f1c-41f0-bc27-8a0ecf28275f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:40.492335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 521/1049] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:40.498692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e368c-7e98-4190-886f-d2a98b0a1b71 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:40.561814 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:40.605344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e368c-7e98-4190-886f-d2a98b0a1b71 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:40.640032 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3c50b-9ebb-4268-af74-dd4713d60f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:40.640703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3c50b-9ebb-4268-af74-dd4713d60f22 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:40.640988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3c50b-9ebb-4268-af74-dd4713d60f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:40.641267 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3c50b-9ebb-4268-af74-dd4713d60f22 None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:40.641970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3c50b-9ebb-4268-af74-dd4713d60f22 None admin] RBAC: Adding query filter params (type=image) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:40.642276 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3c50b-9ebb-4268-af74-dd4713d60f22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:40.643676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3c50b-9ebb-4268-af74-dd4713d60f22 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:40.653749 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 529/1050] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:40.655088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcb305-4f1c-41f0-bc27-8a0ecf28275f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:40.762104 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcb305-4f1c-41f0-bc27-8a0ecf28275f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:40.797764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b92de-5261-498b-bd63-7cb5b89f5ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:40.799880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b92de-5261-498b-bd63-7cb5b89f5ec7 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:40.800173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b92de-5261-498b-bd63-7cb5b89f5ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:40.800453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b92de-5261-498b-bd63-7cb5b89f5ec7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:40.801978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b92de-5261-498b-bd63-7cb5b89f5ec7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:40.803402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b92de-5261-498b-bd63-7cb5b89f5ec7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:40.824525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 522/1051] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 16 16:04:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:04:41.617290 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d37e7-f8f3-4729-8b1c-5eb0e4a1d733 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:41.617869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d37e7-f8f3-4729-8b1c-5eb0e4a1d733 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:41.617869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d37e7-f8f3-4729-8b1c-5eb0e4a1d733 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:41.619444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 530/1052] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:41.624855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d982cfe-a776-428c-8212-5f175c84ea8d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:41.625321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d982cfe-a776-428c-8212-5f175c84ea8d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:41.625423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d982cfe-a776-428c-8212-5f175c84ea8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:41.644191 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1d982cfe-a776-428c-8212-5f175c84ea8d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:41.645397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1d982cfe-a776-428c-8212-5f175c84ea8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:41.695606 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:41.726715 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 523/1053] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:41.749979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d37e7-f8f3-4729-8b1c-5eb0e4a1d733 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:41.857160 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d37e7-f8f3-4729-8b1c-5eb0e4a1d733 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:41.881799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:41.894581 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58374903-8661-4e2d-acd8-efb08574b0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:41.895380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58374903-8661-4e2d-acd8-efb08574b0da None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:41.895664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58374903-8661-4e2d-acd8-efb08574b0da None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:41.895944 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58374903-8661-4e2d-acd8-efb08574b0da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:41.906862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58374903-8661-4e2d-acd8-efb08574b0da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-58374903-8661-4e2d-acd8-efb08574b0da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:04:41.914490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:41.915435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:41.916401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:41.916401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:41.916401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:41.916401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:41.916401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:04:41.916401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:04:41.916401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:04:41.916401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:04:41.916401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:04:41.916401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:04:41.916401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:04:41.916401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:41.918981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 531/1054] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:04:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:41.921873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d982cfe-a776-428c-8212-5f175c84ea8d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:42.030032 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d982cfe-a776-428c-8212-5f175c84ea8d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:42.067671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec743f20-de88-47d3-b561-f5ab5b20125b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:42.068375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec743f20-de88-47d3-b561-f5ab5b20125b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:42.068657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec743f20-de88-47d3-b561-f5ab5b20125b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:42.068933 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec743f20-de88-47d3-b561-f5ab5b20125b None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:42.069702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec743f20-de88-47d3-b561-f5ab5b20125b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:42.070011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec743f20-de88-47d3-b561-f5ab5b20125b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:42.071719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec743f20-de88-47d3-b561-f5ab5b20125b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:42.086924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 524/1055] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:04:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:42.088651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58374903-8661-4e2d-acd8-efb08574b0da None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:42.132343 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5541b-869b-4a8d-a14a-fe5737effcd3 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:42.132544 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5541b-869b-4a8d-a14a-fe5737effcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:42.132827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5541b-869b-4a8d-a14a-fe5737effcd3 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:42.134207 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 525/1056] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:42.140253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a00c5-32b3-4f0d-84bd-bc6d6f0cf31c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:42.140546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a00c5-32b3-4f0d-84bd-bc6d6f0cf31c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:42.140830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a00c5-32b3-4f0d-84bd-bc6d6f0cf31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:42.158100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ed0a00c5-32b3-4f0d-84bd-bc6d6f0cf31c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:42.159331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ed0a00c5-32b3-4f0d-84bd-bc6d6f0cf31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:42.192174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:42.201610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58374903-8661-4e2d-acd8-efb08574b0da None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:42.233562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 526/1057] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:42.238408 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e9399-79d5-4b48-9b8a-048edda47fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:42.239479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e9399-79d5-4b48-9b8a-048edda47fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:42.239837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e9399-79d5-4b48-9b8a-048edda47fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:42.240125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e9399-79d5-4b48-9b8a-048edda47fa7 None admin] PATH_INFO: `/v3/users/2f5109b5ffd644b2bff67adee5b92257` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:42.254629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e9399-79d5-4b48-9b8a-048edda47fa7 None admin] RBAC: Authorizing `identity:get_user(user_id=2f5109b5ffd644b2bff67adee5b92257)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:42.256231 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e9399-79d5-4b48-9b8a-048edda47fa7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:42.256743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a00c5-32b3-4f0d-84bd-bc6d6f0cf31c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:42.262798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 532/1058] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:04:42 2022] GET /identity/v3/users/2f5109b5ffd644b2bff67adee5b92257 => generated 285 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:42.264121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e9399-79d5-4b48-9b8a-048edda47fa7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:42.310774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:42.362341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a00c5-32b3-4f0d-84bd-bc6d6f0cf31c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:42.380162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e9399-79d5-4b48-9b8a-048edda47fa7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:42.407062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3d0f7-ed81-43df-991d-11df836cb838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:42.408391 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3d0f7-ed81-43df-991d-11df836cb838 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:42.408683 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3d0f7-ed81-43df-991d-11df836cb838 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:42.408967 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3d0f7-ed81-43df-991d-11df836cb838 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:42.414699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fa3d8-c588-4c63-8dcb-646867ad6223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:42.415350 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fa3d8-c588-4c63-8dcb-646867ad6223 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:42.415634 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fa3d8-c588-4c63-8dcb-646867ad6223 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:42.415911 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fa3d8-c588-4c63-8dcb-646867ad6223 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:42.422074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3d0f7-ed81-43df-991d-11df836cb838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-2ac3d0f7-ed81-43df-991d-11df836cb838 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:04:42.430285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:42.431479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:42.432913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:42.432913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:42.432913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:42.432913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:42.432913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:04:42.432913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:04:42.432913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:04:42.432913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:04:42.432913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:04:42.432913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:04:42.432913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 16:04:42.432913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:42.432913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 527/1059] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jun 16 16:04:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:42.438341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3d0f7-ed81-43df-991d-11df836cb838 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:42.469175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:42.501253 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fa3d8-c588-4c63-8dcb-646867ad6223 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:42.502755 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fa3d8-c588-4c63-8dcb-646867ad6223 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:42.545454 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:42.552953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3d0f7-ed81-43df-991d-11df836cb838 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:42.596637 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca182e-1606-45a3-83c0-25ddb76ca11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:42.597621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca182e-1606-45a3-83c0-25ddb76ca11e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:42.598046 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca182e-1606-45a3-83c0-25ddb76ca11e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:42.598467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca182e-1606-45a3-83c0-25ddb76ca11e None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:42.599367 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca182e-1606-45a3-83c0-25ddb76ca11e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:42.599681 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca182e-1606-45a3-83c0-25ddb76ca11e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:42.601615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca182e-1606-45a3-83c0-25ddb76ca11e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:42.608657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 533/1060] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:04:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 16:04:42.610375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fa3d8-c588-4c63-8dcb-646867ad6223 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:42.610868 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 528/1061] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jun 16 16:04:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:42.615909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca182e-1606-45a3-83c0-25ddb76ca11e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:42.718366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:42.728445 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca182e-1606-45a3-83c0-25ddb76ca11e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:42.744487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fa3d8-c588-4c63-8dcb-646867ad6223 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:42.765534 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a60b5-6af0-4cc9-9e42-362fdfd73c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:42.766341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a60b5-6af0-4cc9-9e42-362fdfd73c43 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:42.766672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a60b5-6af0-4cc9-9e42-362fdfd73c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:42.766956 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a60b5-6af0-4cc9-9e42-362fdfd73c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:42.778899 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a60b5-6af0-4cc9-9e42-362fdfd73c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:42.780362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a60b5-6af0-4cc9-9e42-362fdfd73c43 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:42.780743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60802d-118b-4ea0-b457-86bfa64d3c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:42.781609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60802d-118b-4ea0-b457-86bfa64d3c6a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:42.781893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60802d-118b-4ea0-b457-86bfa64d3c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:42.782169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60802d-118b-4ea0-b457-86bfa64d3c6a None admin] PATH_INFO: `/v3/projects/e684f0363b674ab3aad0e4909c034d9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:42.783383 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60802d-118b-4ea0-b457-86bfa64d3c6a None admin] RBAC: Authorizing `identity:get_project(project_id=e684f0363b674ab3aad0e4909c034d9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:42.784826 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60802d-118b-4ea0-b457-86bfa64d3c6a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:42.786686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 534/1062] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:04:42 2022] GET /identity/v3/projects/e684f0363b674ab3aad0e4909c034d9c => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:42.792856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60802d-118b-4ea0-b457-86bfa64d3c6a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:42.803439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-0e5a60b5-6af0-4cc9-9e42-362fdfd73c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:42.803439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:42.803439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:42.803439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:42.803439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:42.803439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:42.803439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:42.803439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:42.803439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:42.803439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:42.803439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:42.803439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:42.803439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:42.803439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:42.803439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:42.804384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:42.805293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:42.805293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:42.805293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:42.805293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:42.806076 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 529/1063] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:42.806613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:42.812314 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a60b5-6af0-4cc9-9e42-362fdfd73c43 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:42.910578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60802d-118b-4ea0-b457-86bfa64d3c6a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:42.927177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a60b5-6af0-4cc9-9e42-362fdfd73c43 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:42.951393 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2479c4-5310-48d0-8995-79b7364b21bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:42.952358 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2479c4-5310-48d0-8995-79b7364b21bf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:42.952796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2479c4-5310-48d0-8995-79b7364b21bf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:42.953243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2479c4-5310-48d0-8995-79b7364b21bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:42.954287 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2479c4-5310-48d0-8995-79b7364b21bf None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=e684f0363b674ab3aad0e4909c034d9c, user.id=2f5109b5ffd644b2bff67adee5b92257) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:42.954812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2479c4-5310-48d0-8995-79b7364b21bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:42.956325 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2479c4-5310-48d0-8995-79b7364b21bf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:42.968008 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707e7aa-5102-428c-afa1-87b8830d93a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:42.968788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707e7aa-5102-428c-afa1-87b8830d93a0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:42.969013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707e7aa-5102-428c-afa1-87b8830d93a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:42.969297 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707e7aa-5102-428c-afa1-87b8830d93a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:42.970105 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707e7aa-5102-428c-afa1-87b8830d93a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:42.970421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707e7aa-5102-428c-afa1-87b8830d93a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:42.971958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707e7aa-5102-428c-afa1-87b8830d93a0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:42.975480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 535/1064] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:04:42 2022] GET /identity/v3/role_assignments?user.id=2f5109b5ffd644b2bff67adee5b92257&scope.project.id=e684f0363b674ab3aad0e4909c034d9c&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:42.990204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 530/1065] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:42.993870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2479c4-5310-48d0-8995-79b7364b21bf None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:43.040288 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c02171-81e7-46aa-8b9f-0bb5b1e09f9b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:43.040616 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c02171-81e7-46aa-8b9f-0bb5b1e09f9b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:43.040863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c02171-81e7-46aa-8b9f-0bb5b1e09f9b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:43.042476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 531/1066] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:43.048139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2833f-acfb-41c1-b7c1-e57d51c89843 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:43.048459 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2833f-acfb-41c1-b7c1-e57d51c89843 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:43.048708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2833f-acfb-41c1-b7c1-e57d51c89843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:43.054126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:43.068282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f9c2833f-acfb-41c1-b7c1-e57d51c89843 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:43.069522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f9c2833f-acfb-41c1-b7c1-e57d51c89843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:43.097461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:43.131261 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2479c4-5310-48d0-8995-79b7364b21bf None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:43.150388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 532/1067] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:04:43.172965 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2833f-acfb-41c1-b7c1-e57d51c89843 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:43.173410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dd288-4fe9-4fc6-8db8-aa008ec0518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:43.174220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dd288-4fe9-4fc6-8db8-aa008ec0518e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:43.174532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dd288-4fe9-4fc6-8db8-aa008ec0518e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:43.174812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dd288-4fe9-4fc6-8db8-aa008ec0518e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:43.182467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dd288-4fe9-4fc6-8db8-aa008ec0518e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:43.184124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dd288-4fe9-4fc6-8db8-aa008ec0518e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-5a2dd288-4fe9-4fc6-8db8-aa008ec0518e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:04:43.198950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:43.200700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:43.201660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:43.201660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:43.201660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:04:43.201660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:04:43.201660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:04:43.201660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:04:43.201660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:04:43.201660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:04:43.201660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:04:43.201660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:43.201660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 536/1068] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 16 16:04:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:43.206490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dd288-4fe9-4fc6-8db8-aa008ec0518e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:43.292299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2833f-acfb-41c1-b7c1-e57d51c89843 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:43.317914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dd288-4fe9-4fc6-8db8-aa008ec0518e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:43.333424 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:43.341146 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601ec32-6479-4a47-bc8b-6fe44b7a58ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:43.342222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601ec32-6479-4a47-bc8b-6fe44b7a58ef None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:43.342766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601ec32-6479-4a47-bc8b-6fe44b7a58ef None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:43.345978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601ec32-6479-4a47-bc8b-6fe44b7a58ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:43.367808 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebd0df-ca48-44cd-b3f7-1248ef21f14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:43.369321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebd0df-ca48-44cd-b3f7-1248ef21f14b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:43.369321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebd0df-ca48-44cd-b3f7-1248ef21f14b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:43.369710 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebd0df-ca48-44cd-b3f7-1248ef21f14b None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:43.370798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebd0df-ca48-44cd-b3f7-1248ef21f14b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:43.371180 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebd0df-ca48-44cd-b3f7-1248ef21f14b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:43.372730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebd0df-ca48-44cd-b3f7-1248ef21f14b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:43.374769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:43.393593 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 537/1069] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 16 16:04:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:43.403354 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebd0df-ca48-44cd-b3f7-1248ef21f14b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:43.437544 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601ec32-6479-4a47-bc8b-6fe44b7a58ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:43.439039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601ec32-6479-4a47-bc8b-6fe44b7a58ef None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:43.544967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebd0df-ca48-44cd-b3f7-1248ef21f14b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:43.576213 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 533/1070] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:04:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 16:04:43.584430 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601ec32-6479-4a47-bc8b-6fe44b7a58ef None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:43.585407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ccacc-9a32-463f-9b92-4f854eb2fa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:43.586208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ccacc-9a32-463f-9b92-4f854eb2fa53 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:43.586634 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ccacc-9a32-463f-9b92-4f854eb2fa53 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:43.586910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ccacc-9a32-463f-9b92-4f854eb2fa53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:43.600446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ccacc-9a32-463f-9b92-4f854eb2fa53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:43.602058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ccacc-9a32-463f-9b92-4f854eb2fa53 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:43.621040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-503ccacc-9a32-463f-9b92-4f854eb2fa53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:43.621040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:43.621040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:43.621040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:43.621040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:43.621040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:43.621040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:43.621040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:43.621040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:43.621040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:43.621040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:43.621040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:43.621040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:43.621040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:43.621040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:43.622194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:43.623598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:43.623598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:43.623598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:43.623598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:43.623850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:43.623933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 538/1071] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:43.629677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ccacc-9a32-463f-9b92-4f854eb2fa53 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:43.677263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:43.703858 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601ec32-6479-4a47-bc8b-6fe44b7a58ef None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:43.734208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ccacc-9a32-463f-9b92-4f854eb2fa53 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:43.740274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66906217-5fa9-4e74-bc8a-5e83dd08d7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:43.741084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66906217-5fa9-4e74-bc8a-5e83dd08d7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:43.741490 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66906217-5fa9-4e74-bc8a-5e83dd08d7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:43.741773 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66906217-5fa9-4e74-bc8a-5e83dd08d7b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:43.753788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66906217-5fa9-4e74-bc8a-5e83dd08d7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:43.755392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66906217-5fa9-4e74-bc8a-5e83dd08d7b6 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:43.769098 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40072abc-3f5b-4c70-8040-82eb6aab87e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:43.769763 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40072abc-3f5b-4c70-8040-82eb6aab87e6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:43.770043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40072abc-3f5b-4c70-8040-82eb6aab87e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:43.770318 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40072abc-3f5b-4c70-8040-82eb6aab87e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:43.771071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40072abc-3f5b-4c70-8040-82eb6aab87e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:43.771376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40072abc-3f5b-4c70-8040-82eb6aab87e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:43.772866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40072abc-3f5b-4c70-8040-82eb6aab87e6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:43.774241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-66906217-5fa9-4e74-bc8a-5e83dd08d7b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:43.774241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:43.774241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:43.774241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:43.774241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:43.774241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:43.774241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:43.774241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:43.774241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:43.774241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:43.774241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:43.774241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:43.774241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:43.774241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:43.774241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:43.775127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:43.776035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:43.776035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:43.776035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:43.776035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:43.776035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 534/1072] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:43.781654 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66906217-5fa9-4e74-bc8a-5e83dd08d7b6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:43.791671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 539/1073] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:43.792722 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40072abc-3f5b-4c70-8040-82eb6aab87e6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:43.876747 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:43.896646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66906217-5fa9-4e74-bc8a-5e83dd08d7b6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:43.914897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40072abc-3f5b-4c70-8040-82eb6aab87e6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:43.918656 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:43.944763 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84aa0c1-dfcf-453a-bbfb-094cfcf20c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:43.945698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84aa0c1-dfcf-453a-bbfb-094cfcf20c80 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:43.946115 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84aa0c1-dfcf-453a-bbfb-094cfcf20c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:43.946281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84aa0c1-dfcf-453a-bbfb-094cfcf20c80 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:43.947018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84aa0c1-dfcf-453a-bbfb-094cfcf20c80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:43.947331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84aa0c1-dfcf-453a-bbfb-094cfcf20c80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:43.948701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84aa0c1-dfcf-453a-bbfb-094cfcf20c80 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:43.954954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd07a47-f422-4842-9aa6-52d9006e939b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:43.955751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd07a47-f422-4842-9aa6-52d9006e939b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:43.956033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd07a47-f422-4842-9aa6-52d9006e939b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:43.956305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd07a47-f422-4842-9aa6-52d9006e939b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:43.961730 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 535/1074] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:43.965381 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd07a47-f422-4842-9aa6-52d9006e939b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:43.967205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd07a47-f422-4842-9aa6-52d9006e939b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:43.984198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0fd07a47-f422-4842-9aa6-52d9006e939b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:43.984198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:43.984198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:43.984198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:43.984198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:43.984198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:43.984198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:43.984198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:43.984198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:43.984198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:43.984198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:43.984198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:43.984198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:04:43.984198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:04:43.984198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:43.985274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:43.991398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:04:43.991398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:04:43.991398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:04:43.991398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:04:43.991398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:04:43.991398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:04:43.991398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:43.991398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:43.991398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 540/1075] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:43.992017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84aa0c1-dfcf-453a-bbfb-094cfcf20c80 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:44.106142 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84aa0c1-dfcf-453a-bbfb-094cfcf20c80 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:44.143855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c20b7-bdd8-403f-a724-9a9c41a30696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:44.144465 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c20b7-bdd8-403f-a724-9a9c41a30696 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:44.144751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c20b7-bdd8-403f-a724-9a9c41a30696 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:44.145029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c20b7-bdd8-403f-a724-9a9c41a30696 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:44.145837 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c20b7-bdd8-403f-a724-9a9c41a30696 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:44.146151 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c20b7-bdd8-403f-a724-9a9c41a30696 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:44.147677 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c20b7-bdd8-403f-a724-9a9c41a30696 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:44.162514 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 536/1076] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:04:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:44.168139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd07a47-f422-4842-9aa6-52d9006e939b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:44.283693 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd07a47-f422-4842-9aa6-52d9006e939b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:44.318100 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044e2f0-1c7b-4973-ae09-96d042e20263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:44.319028 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044e2f0-1c7b-4973-ae09-96d042e20263 None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:44.319312 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044e2f0-1c7b-4973-ae09-96d042e20263 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:44.319586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044e2f0-1c7b-4973-ae09-96d042e20263 None admin] PATH_INFO: `/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/795c029cb14b42b5b0f3987e218d4239/roles/74eb0d20197044ea95b7e71c9a8b329c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:44.322016 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044e2f0-1c7b-4973-ae09-96d042e20263 None admin] RBAC: Authorizing `identity:create_grant(project_id=227cd348bea64e1f89d77ae2cf63a031, user_id=795c029cb14b42b5b0f3987e218d4239, role_id=74eb0d20197044ea95b7e71c9a8b329c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:44.323485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044e2f0-1c7b-4973-ae09-96d042e20263 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:44.336725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 541/1077] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:04:44 2022] PUT /identity/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/795c029cb14b42b5b0f3987e218d4239/roles/74eb0d20197044ea95b7e71c9a8b329c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:04:45.225923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdac53-e35a-4a9d-a51b-e49c56e6fd2f None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:45.226594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdac53-e35a-4a9d-a51b-e49c56e6fd2f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:45.226594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdac53-e35a-4a9d-a51b-e49c56e6fd2f None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:45.227988 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 537/1078] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:45.233773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8c467-4dbc-4119-9942-33d5fead5d0e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:45.234228 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8c467-4dbc-4119-9942-33d5fead5d0e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:45.234327 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8c467-4dbc-4119-9942-33d5fead5d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:45.251429 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c9d8c467-4dbc-4119-9942-33d5fead5d0e None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:45.252597 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c9d8c467-4dbc-4119-9942-33d5fead5d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:45.269475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:45.319743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 542/1079] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:45.342753 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdac53-e35a-4a9d-a51b-e49c56e6fd2f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:45.346646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:45.467134 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdac53-e35a-4a9d-a51b-e49c56e6fd2f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:45.509765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421be21f-3c62-4381-bb2c-84f2fb60179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:45.510552 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421be21f-3c62-4381-bb2c-84f2fb60179c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:45.510793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421be21f-3c62-4381-bb2c-84f2fb60179c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:45.511068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421be21f-3c62-4381-bb2c-84f2fb60179c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:45.521708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421be21f-3c62-4381-bb2c-84f2fb60179c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-421be21f-3c62-4381-bb2c-84f2fb60179c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:04:45.530298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:45.531504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:45.532423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:45.532423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:45.532423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:45.532423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:45.532423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:04:45.532423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:04:45.532423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:04:45.532423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:04:45.532423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:04:45.532423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:04:45.532423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:04:45.532423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:45.532423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 538/1080] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:04:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:45.537634 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8c467-4dbc-4119-9942-33d5fead5d0e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:45.635183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8c467-4dbc-4119-9942-33d5fead5d0e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:45.668781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c57fc1-0496-4155-bfae-4bba60f7d1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:45.669440 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c57fc1-0496-4155-bfae-4bba60f7d1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:45.669721 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c57fc1-0496-4155-bfae-4bba60f7d1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:45.669996 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c57fc1-0496-4155-bfae-4bba60f7d1f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:45.670780 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c57fc1-0496-4155-bfae-4bba60f7d1f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:45.671082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c57fc1-0496-4155-bfae-4bba60f7d1f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:45.672454 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c57fc1-0496-4155-bfae-4bba60f7d1f2 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:45.680504 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 543/1081] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:04:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:45.686385 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421be21f-3c62-4381-bb2c-84f2fb60179c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:45.748453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:45.789153 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421be21f-3c62-4381-bb2c-84f2fb60179c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:45.833252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17973d2d-5138-46f4-b06b-bc8e7d2718ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:45.834136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17973d2d-5138-46f4-b06b-bc8e7d2718ac None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:45.834415 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17973d2d-5138-46f4-b06b-bc8e7d2718ac None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:45.834716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17973d2d-5138-46f4-b06b-bc8e7d2718ac None admin] PATH_INFO: `/v3/users/2f5109b5ffd644b2bff67adee5b92257` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:45.835886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17973d2d-5138-46f4-b06b-bc8e7d2718ac None admin] RBAC: Authorizing `identity:get_user(user_id=2f5109b5ffd644b2bff67adee5b92257)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:45.837316 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17973d2d-5138-46f4-b06b-bc8e7d2718ac None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:45.839181 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 539/1082] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:04:45 2022] GET /identity/v3/users/2f5109b5ffd644b2bff67adee5b92257 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:45.844651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c57fc1-0496-4155-bfae-4bba60f7d1f2 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:45.863180 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:45.945860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c57fc1-0496-4155-bfae-4bba60f7d1f2 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:45.978281 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f08c83-ae15-489a-accb-073a351bcb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:45.979170 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f08c83-ae15-489a-accb-073a351bcb13 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:45.979450 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f08c83-ae15-489a-accb-073a351bcb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:45.979721 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f08c83-ae15-489a-accb-073a351bcb13 None admin] PATH_INFO: `/v3/projects/e684f0363b674ab3aad0e4909c034d9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:45.981431 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f08c83-ae15-489a-accb-073a351bcb13 None admin] RBAC: Authorizing `identity:get_project(project_id=e684f0363b674ab3aad0e4909c034d9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:45.982895 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f08c83-ae15-489a-accb-073a351bcb13 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:45.984589 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 544/1083] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:04:45 2022] GET /identity/v3/projects/e684f0363b674ab3aad0e4909c034d9c => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:45.990469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17973d2d-5138-46f4-b06b-bc8e7d2718ac None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:46.090805 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17973d2d-5138-46f4-b06b-bc8e7d2718ac None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:46.119314 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:46.125292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b34e60-c126-4a1a-b8fa-c96b4006341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:46.126195 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b34e60-c126-4a1a-b8fa-c96b4006341a None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:46.126511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b34e60-c126-4a1a-b8fa-c96b4006341a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:46.126787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b34e60-c126-4a1a-b8fa-c96b4006341a None admin] PATH_INFO: `/v3/projects/e684f0363b674ab3aad0e4909c034d9c/users/2f5109b5ffd644b2bff67adee5b92257/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:46.128795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b34e60-c126-4a1a-b8fa-c96b4006341a None admin] RBAC: Authorizing `identity:create_grant(project_id=e684f0363b674ab3aad0e4909c034d9c, user_id=2f5109b5ffd644b2bff67adee5b92257, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:46.130228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b34e60-c126-4a1a-b8fa-c96b4006341a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:46.144051 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 540/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:04:45 2022] PUT /identity/v3/projects/e684f0363b674ab3aad0e4909c034d9c/users/2f5109b5ffd644b2bff67adee5b92257/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:04:46.517432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2656903-1563-4e90-9424-e8f4931165a2 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:46.517992 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2656903-1563-4e90-9424-e8f4931165a2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:46.518094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2656903-1563-4e90-9424-e8f4931165a2 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:46.519441 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 545/1085] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:46.524618 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0af96-4522-4b60-b25d-4d9c842dc9c9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:46.525026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0af96-4522-4b60-b25d-4d9c842dc9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:46.525185 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0af96-4522-4b60-b25d-4d9c842dc9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:46.542476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a3d0af96-4522-4b60-b25d-4d9c842dc9c9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:46.544471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a3d0af96-4522-4b60-b25d-4d9c842dc9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:46.612917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 541/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:46.636259 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2656903-1563-4e90-9424-e8f4931165a2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:46.731861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:46.749753 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2656903-1563-4e90-9424-e8f4931165a2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:46.786916 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae0576-7672-4dc3-93f0-dc9c65cf2f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:46.787737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0576-7672-4dc3-93f0-dc9c65cf2f7e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:46.788023 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0576-7672-4dc3-93f0-dc9c65cf2f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:46.788302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0576-7672-4dc3-93f0-dc9c65cf2f7e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:46.799540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae0576-7672-4dc3-93f0-dc9c65cf2f7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6eae0576-7672-4dc3-93f0-dc9c65cf2f7e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:04:46.807566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:46.808669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:46.809537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:46.809537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:46.809537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:46.809537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:46.809537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:04:46.809537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:04:46.809537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:04:46.809537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:04:46.809537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:04:46.809537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:04:46.809537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 16:04:46.809537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:46.809537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 546/1087] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jun 16 16:04:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:46.815411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0af96-4522-4b60-b25d-4d9c842dc9c9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:46.923893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0af96-4522-4b60-b25d-4d9c842dc9c9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:46.946672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:46.959818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e7de0-1689-4644-93a4-4b1fc7558b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:46.960489 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e7de0-1689-4644-93a4-4b1fc7558b78 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:46.960772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e7de0-1689-4644-93a4-4b1fc7558b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:46.961047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e7de0-1689-4644-93a4-4b1fc7558b78 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:46.961786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e7de0-1689-4644-93a4-4b1fc7558b78 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:46.962090 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e7de0-1689-4644-93a4-4b1fc7558b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:46.963478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e7de0-1689-4644-93a4-4b1fc7558b78 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:46.972107 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 542/1088] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jun 16 16:04:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:46.978005 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae0576-7672-4dc3-93f0-dc9c65cf2f7e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:47.080726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae0576-7672-4dc3-93f0-dc9c65cf2f7e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:47.114135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b307d17-d3a5-4db4-b30c-0c5f86d4a181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:47.114955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b307d17-d3a5-4db4-b30c-0c5f86d4a181 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:47.115239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b307d17-d3a5-4db4-b30c-0c5f86d4a181 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:47.115511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b307d17-d3a5-4db4-b30c-0c5f86d4a181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:47.126300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b307d17-d3a5-4db4-b30c-0c5f86d4a181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:47.127782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b307d17-d3a5-4db4-b30c-0c5f86d4a181 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:47.130306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:47.146882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-3b307d17-d3a5-4db4-b30c-0c5f86d4a181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:47.146882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:47.146882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:47.146882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:47.146882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:47.146882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:47.146882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:47.146882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:47.146882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:47.146882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:47.146882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:47.146882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:47.146882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:47.146882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:47.146882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:47.147923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:47.149378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:47.149378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:47.149378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:47.149378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:47.149378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 547/1089] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:47.153807 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e7de0-1689-4644-93a4-4b1fc7558b78 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:47.254992 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e7de0-1689-4644-93a4-4b1fc7558b78 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:47.288489 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba76b3-9cbb-4bb9-9f60-f525c7cf050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:47.289155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba76b3-9cbb-4bb9-9f60-f525c7cf050f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:47.289436 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba76b3-9cbb-4bb9-9f60-f525c7cf050f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:47.289709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba76b3-9cbb-4bb9-9f60-f525c7cf050f None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:47.290420 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba76b3-9cbb-4bb9-9f60-f525c7cf050f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:47.290755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba76b3-9cbb-4bb9-9f60-f525c7cf050f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:47.292118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba76b3-9cbb-4bb9-9f60-f525c7cf050f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:47.304364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 543/1090] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:47.310029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b307d17-d3a5-4db4-b30c-0c5f86d4a181 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:47.417018 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b307d17-d3a5-4db4-b30c-0c5f86d4a181 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:47.453223 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1af3-593d-4ad9-84d9-f28620935a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:47.454073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1af3-593d-4ad9-84d9-f28620935a6b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:47.454363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1af3-593d-4ad9-84d9-f28620935a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:47.454671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1af3-593d-4ad9-84d9-f28620935a6b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:47.462123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a1af3-593d-4ad9-84d9-f28620935a6b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:47.463589 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a1af3-593d-4ad9-84d9-f28620935a6b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-297a1af3-593d-4ad9-84d9-f28620935a6b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:04:47.478583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:47.479730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:47.480861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:47.480861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:47.480861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:04:47.480861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:04:47.480861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:04:47.480861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:04:47.480861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:04:47.480861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:04:47.480861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 16:04:47.480861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:47.480861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 548/1091] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 16 16:04:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:47.485556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba76b3-9cbb-4bb9-9f60-f525c7cf050f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:47.532877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:47.586072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba76b3-9cbb-4bb9-9f60-f525c7cf050f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:47.619869 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d81588-2ad9-4f4b-b658-1a906f45794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:47.620541 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d81588-2ad9-4f4b-b658-1a906f45794f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:47.620823 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d81588-2ad9-4f4b-b658-1a906f45794f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:47.621098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d81588-2ad9-4f4b-b658-1a906f45794f None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:47.621930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d81588-2ad9-4f4b-b658-1a906f45794f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:47.622234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d81588-2ad9-4f4b-b658-1a906f45794f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:47.623684 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d81588-2ad9-4f4b-b658-1a906f45794f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:47.641271 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 544/1092] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 16 16:04:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:47.647002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1af3-593d-4ad9-84d9-f28620935a6b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:47.703751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:47.749517 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1af3-593d-4ad9-84d9-f28620935a6b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:47.783987 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad544022-f633-4c4f-8363-00cfc6e9ad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:47.784572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad544022-f633-4c4f-8363-00cfc6e9ad58 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:47.784853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad544022-f633-4c4f-8363-00cfc6e9ad58 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:47.785127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad544022-f633-4c4f-8363-00cfc6e9ad58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:47.852544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad544022-f633-4c4f-8363-00cfc6e9ad58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:47.854038 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad544022-f633-4c4f-8363-00cfc6e9ad58 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:47.908603 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:47.953316 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 549/1093] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:04:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 16:04:47.959067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d81588-2ad9-4f4b-b658-1a906f45794f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:48.057619 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d81588-2ad9-4f4b-b658-1a906f45794f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:48.059696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:48.093819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e1234-58d6-4e31-a63d-35e8f09337c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:48.094667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e1234-58d6-4e31-a63d-35e8f09337c9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:48.094955 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e1234-58d6-4e31-a63d-35e8f09337c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:48.095234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e1234-58d6-4e31-a63d-35e8f09337c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:48.105607 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e1234-58d6-4e31-a63d-35e8f09337c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:48.107433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e1234-58d6-4e31-a63d-35e8f09337c9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:48.125689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-c94e1234-58d6-4e31-a63d-35e8f09337c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:48.125689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:48.125689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:48.125689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:48.125689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:48.125689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:48.125689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:48.125689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:48.125689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:48.125689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:48.125689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:48.125689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:48.125689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:04:48.125689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:04:48.125689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:48.126802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:48.128015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:04:48.128015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:04:48.128015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:04:48.128015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:48.130742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 545/1094] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:04:48.132493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad544022-f633-4c4f-8363-00cfc6e9ad58 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:48.233471 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad544022-f633-4c4f-8363-00cfc6e9ad58 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:48.269395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd5a16-9328-4381-b18b-eeb216c660ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:48.270109 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd5a16-9328-4381-b18b-eeb216c660ec None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:48.270392 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd5a16-9328-4381-b18b-eeb216c660ec None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:48.270716 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd5a16-9328-4381-b18b-eeb216c660ec None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:48.271431 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd5a16-9328-4381-b18b-eeb216c660ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:48.271737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd5a16-9328-4381-b18b-eeb216c660ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:48.273096 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd5a16-9328-4381-b18b-eeb216c660ec None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:48.281583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70591ace-ceaf-4aae-88fb-8768df421afb None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:48.282006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70591ace-ceaf-4aae-88fb-8768df421afb None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:48.282294 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70591ace-ceaf-4aae-88fb-8768df421afb None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:48.283708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 546/1095] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:04:48.288676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 550/1096] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:48.289024 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2200d-c3db-4fba-9aa9-169a9c1991fc None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:48.289315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2200d-c3db-4fba-9aa9-169a9c1991fc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:48.289582 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd5a16-9328-4381-b18b-eeb216c660ec None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:48.289686 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2200d-c3db-4fba-9aa9-169a9c1991fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:48.306545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d5c2200d-c3db-4fba-9aa9-169a9c1991fc None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:48.307801 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d5c2200d-c3db-4fba-9aa9-169a9c1991fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:48.308190 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:48.380839 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 547/1097] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:48.391770 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd5a16-9328-4381-b18b-eeb216c660ec None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:48.404785 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2200d-c3db-4fba-9aa9-169a9c1991fc None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:48.425719 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bb630-bf4a-478b-876d-ae1127f4ffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:48.426580 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb630-bf4a-478b-876d-ae1127f4ffae None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:48.426865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb630-bf4a-478b-876d-ae1127f4ffae None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:48.427140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb630-bf4a-478b-876d-ae1127f4ffae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:48.434820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bb630-bf4a-478b-876d-ae1127f4ffae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:48.436275 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bb630-bf4a-478b-876d-ae1127f4ffae None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:48.450919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ff9bb630-bf4a-478b-876d-ae1127f4ffae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:48.450919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:48.450919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:48.450919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:48.450919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:48.450919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:48.450919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:48.450919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:48.450919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:48.450919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:48.450919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:48.450919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:48.450919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:04:48.450919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:04:48.450919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:48.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:48.452848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:04:48.452848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:04:48.452848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:04:48.452848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:04:48.452848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:04:48.452848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:04:48.452848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:04:48.452848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:04:48.452848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 551/1098] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:04:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:48.457875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bb630-bf4a-478b-876d-ae1127f4ffae None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:48.492971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:48.510805 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2200d-c3db-4fba-9aa9-169a9c1991fc None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:48.536078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:48.545366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fd2aa-a071-4efe-aa2a-eda434c0da64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:48.546168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fd2aa-a071-4efe-aa2a-eda434c0da64 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:48.546468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fd2aa-a071-4efe-aa2a-eda434c0da64 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:48.546747 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fd2aa-a071-4efe-aa2a-eda434c0da64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:48.556906 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8fd2aa-a071-4efe-aa2a-eda434c0da64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:04:48.559710 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bb630-bf4a-478b-876d-ae1127f4ffae None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-af8fd2aa-a071-4efe-aa2a-eda434c0da64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:04:48.564879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:04:48.565989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:04:48.566935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:04:48.566935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:04:48.566935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:04:48.566935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:04:48.566935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:04:48.566935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:04:48.566935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:04:48.566935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:04:48.566935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:04:48.566935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:04:48.566935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:04:48.566935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:04:48.566935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 548/1099] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:04:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:04:48.572407 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fd2aa-a071-4efe-aa2a-eda434c0da64 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:48.594946 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebea33f-1f56-42f8-8c3f-e4e6486994b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:48.595895 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebea33f-1f56-42f8-8c3f-e4e6486994b8 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:48.596178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebea33f-1f56-42f8-8c3f-e4e6486994b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:48.596457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebea33f-1f56-42f8-8c3f-e4e6486994b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:48.597250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebea33f-1f56-42f8-8c3f-e4e6486994b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:48.597573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebea33f-1f56-42f8-8c3f-e4e6486994b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:48.599047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebea33f-1f56-42f8-8c3f-e4e6486994b8 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:48.611383 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 552/1100] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:04:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:48.617370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebea33f-1f56-42f8-8c3f-e4e6486994b8 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:48.676175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fd2aa-a071-4efe-aa2a-eda434c0da64 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:48.710903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a2113-aa06-4b22-9d3e-cc31725b6e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:48.711579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a2113-aa06-4b22-9d3e-cc31725b6e71 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:48.711870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a2113-aa06-4b22-9d3e-cc31725b6e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:48.712149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a2113-aa06-4b22-9d3e-cc31725b6e71 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:48.712904 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a2113-aa06-4b22-9d3e-cc31725b6e71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:48.713216 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a2113-aa06-4b22-9d3e-cc31725b6e71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:48.714621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a2113-aa06-4b22-9d3e-cc31725b6e71 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:48.716505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebea33f-1f56-42f8-8c3f-e4e6486994b8 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:48.724580 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 549/1101] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:04:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:48.731724 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a2113-aa06-4b22-9d3e-cc31725b6e71 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:48.739910 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:48.752643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422520a-6b12-40e0-afc5-0d850ef26467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:48.753308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422520a-6b12-40e0-afc5-0d850ef26467 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:48.753593 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422520a-6b12-40e0-afc5-0d850ef26467 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:48.753869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422520a-6b12-40e0-afc5-0d850ef26467 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:48.754774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422520a-6b12-40e0-afc5-0d850ef26467 None admin] RBAC: Adding query filter params (role.id=74eb0d20197044ea95b7e71c9a8b329c, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=795c029cb14b42b5b0f3987e218d4239) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:48.755088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422520a-6b12-40e0-afc5-0d850ef26467 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:48.756516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422520a-6b12-40e0-afc5-0d850ef26467 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:48.759544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:48.766609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 553/1102] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:04:48 2022] GET /identity/v3/role_assignments?user.id=795c029cb14b42b5b0f3987e218d4239&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=74eb0d20197044ea95b7e71c9a8b329c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:48.844930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a2113-aa06-4b22-9d3e-cc31725b6e71 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:48.884846 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520120a-cdf8-4e93-a20d-1928f67b6837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:48.885749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520120a-cdf8-4e93-a20d-1928f67b6837 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:48.886039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520120a-cdf8-4e93-a20d-1928f67b6837 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:48.886317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520120a-cdf8-4e93-a20d-1928f67b6837 None admin] PATH_INFO: `/v3/users/2f5109b5ffd644b2bff67adee5b92257` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:48.888501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520120a-cdf8-4e93-a20d-1928f67b6837 None admin] RBAC: Authorizing `identity:get_user(user_id=2f5109b5ffd644b2bff67adee5b92257)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:48.889984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520120a-cdf8-4e93-a20d-1928f67b6837 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:48.891763 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 550/1103] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:04:48 2022] GET /identity/v3/users/2f5109b5ffd644b2bff67adee5b92257 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:48.897432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422520a-6b12-40e0-afc5-0d850ef26467 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:49.004955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422520a-6b12-40e0-afc5-0d850ef26467 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:49.040554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0a857-02f7-4505-adfd-5774fbcb657a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:49.041213 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0a857-02f7-4505-adfd-5774fbcb657a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:49.041497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0a857-02f7-4505-adfd-5774fbcb657a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:49.041776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0a857-02f7-4505-adfd-5774fbcb657a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:49.110675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:49.113296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0a857-02f7-4505-adfd-5774fbcb657a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:49.115317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0a857-02f7-4505-adfd-5774fbcb657a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:49.217200 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 554/1104] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:04:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 16:04:49.223085 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520120a-cdf8-4e93-a20d-1928f67b6837 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:49.316517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:49.344169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520120a-cdf8-4e93-a20d-1928f67b6837 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:49.385676 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7314d4d-ed01-4e72-973a-2f43995c40c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:49.386732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7314d4d-ed01-4e72-973a-2f43995c40c0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:49.387020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7314d4d-ed01-4e72-973a-2f43995c40c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:49.387296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7314d4d-ed01-4e72-973a-2f43995c40c0 None admin] PATH_INFO: `/v3/projects/e684f0363b674ab3aad0e4909c034d9c` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:49.388606 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7314d4d-ed01-4e72-973a-2f43995c40c0 None admin] RBAC: Authorizing `identity:get_project(project_id=e684f0363b674ab3aad0e4909c034d9c)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:49.390031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7314d4d-ed01-4e72-973a-2f43995c40c0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:49.391781 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 551/1105] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:04:49 2022] GET /identity/v3/projects/e684f0363b674ab3aad0e4909c034d9c => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:49.398202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0a857-02f7-4505-adfd-5774fbcb657a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:49.497667 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:49.500798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0a857-02f7-4505-adfd-5774fbcb657a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:49.537878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66a857-42b6-4098-ac60-cd81b8f8686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:49.538574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66a857-42b6-4098-ac60-cd81b8f8686f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:49.538862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66a857-42b6-4098-ac60-cd81b8f8686f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:49.539137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66a857-42b6-4098-ac60-cd81b8f8686f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:49.539985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66a857-42b6-4098-ac60-cd81b8f8686f None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=e684f0363b674ab3aad0e4909c034d9c, user.id=2f5109b5ffd644b2bff67adee5b92257) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:49.540296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66a857-42b6-4098-ac60-cd81b8f8686f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:49.541732 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66a857-42b6-4098-ac60-cd81b8f8686f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:49.548495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 555/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:04:49 2022] GET /identity/v3/role_assignments?user.id=2f5109b5ffd644b2bff67adee5b92257&scope.project.id=e684f0363b674ab3aad0e4909c034d9c&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:04:51.689486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d56a8a-a4ed-4205-ba41-3672c2598c5e None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:51.690008 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d56a8a-a4ed-4205-ba41-3672c2598c5e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:51.690123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d56a8a-a4ed-4205-ba41-3672c2598c5e None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:51.691442 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 552/1107] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:51.696952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421495d-60bb-401a-b0e6-497a69783bbc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:51.697359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421495d-60bb-401a-b0e6-497a69783bbc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:51.697506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421495d-60bb-401a-b0e6-497a69783bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:51.714457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5421495d-60bb-401a-b0e6-497a69783bbc None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:51.715722 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5421495d-60bb-401a-b0e6-497a69783bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:51.781334 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 556/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:51.805595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d56a8a-a4ed-4205-ba41-3672c2598c5e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:51.904693 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d56a8a-a4ed-4205-ba41-3672c2598c5e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:51.938027 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c62cca-c035-43f7-a309-70641f751c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:51.938840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c62cca-c035-43f7-a309-70641f751c1e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:51.939124 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c62cca-c035-43f7-a309-70641f751c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:51.939404 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c62cca-c035-43f7-a309-70641f751c1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:51.940597 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c62cca-c035-43f7-a309-70641f751c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:51.941972 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c62cca-c035-43f7-a309-70641f751c1e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:51.943603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 553/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:04:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:51.949715 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421495d-60bb-401a-b0e6-497a69783bbc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:52.039896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:52.047183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421495d-60bb-401a-b0e6-497a69783bbc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:52.080194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcedf5-e573-4752-a3b1-64948538b8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:52.080851 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcedf5-e573-4752-a3b1-64948538b8f9 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:52.081131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcedf5-e573-4752-a3b1-64948538b8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:52.081404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcedf5-e573-4752-a3b1-64948538b8f9 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:52.082100 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcedf5-e573-4752-a3b1-64948538b8f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:52.083552 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcedf5-e573-4752-a3b1-64948538b8f9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:52.102250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 557/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:04:51 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:04:54.269133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a64fbd-ba4b-431b-aee0-b56e17f9d68e None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:54.269719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a64fbd-ba4b-431b-aee0-b56e17f9d68e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:54.269719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a64fbd-ba4b-431b-aee0-b56e17f9d68e None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:54.271169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 554/1111] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:54.276286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769857d-559b-4cdc-a1ab-33eb52d7e829 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:54.276702 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769857d-559b-4cdc-a1ab-33eb52d7e829 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:54.276914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769857d-559b-4cdc-a1ab-33eb52d7e829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:54.293840 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5769857d-559b-4cdc-a1ab-33eb52d7e829 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:54.295057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5769857d-559b-4cdc-a1ab-33eb52d7e829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:54.365948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 558/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:54.390180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a64fbd-ba4b-431b-aee0-b56e17f9d68e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:54.402694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:54.491369 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a64fbd-ba4b-431b-aee0-b56e17f9d68e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:54.524571 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc441e99-ca6f-4522-938c-0a83d08f8111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:54.525354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc441e99-ca6f-4522-938c-0a83d08f8111 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:54.525638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc441e99-ca6f-4522-938c-0a83d08f8111 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:54.525917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc441e99-ca6f-4522-938c-0a83d08f8111 None admin] PATH_INFO: `/v3/roles/255c2b4827324109a6d2068c8b0316c3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:54.528023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc441e99-ca6f-4522-938c-0a83d08f8111 None admin] RBAC: Authorizing `identity:get_role(role_id=255c2b4827324109a6d2068c8b0316c3)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:54.529388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc441e99-ca6f-4522-938c-0a83d08f8111 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:54.530780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 555/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:04:54 2022] GET /identity/v3/roles/255c2b4827324109a6d2068c8b0316c3 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:54.536534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769857d-559b-4cdc-a1ab-33eb52d7e829 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:54.616616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:54.636913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769857d-559b-4cdc-a1ab-33eb52d7e829 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:54.670836 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1569e4-4b0d-446a-894d-3f5a29c78d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:54.671693 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1569e4-4b0d-446a-894d-3f5a29c78d45 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:54.671978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1569e4-4b0d-446a-894d-3f5a29c78d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:54.672256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1569e4-4b0d-446a-894d-3f5a29c78d45 None admin] PATH_INFO: `/v3/users/90393dd8c5cb4dcdb3a5c31c50c9ce18` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:54.685029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1569e4-4b0d-446a-894d-3f5a29c78d45 None admin] RBAC: Authorizing `identity:get_user(user_id=90393dd8c5cb4dcdb3a5c31c50c9ce18)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:54.686494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1569e4-4b0d-446a-894d-3f5a29c78d45 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:54.688142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 559/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:04:54 2022] GET /identity/v3/users/90393dd8c5cb4dcdb3a5c31c50c9ce18 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:54.693834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc441e99-ca6f-4522-938c-0a83d08f8111 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:54.772086 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:54.794764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc441e99-ca6f-4522-938c-0a83d08f8111 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:54.827430 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa43406-66fa-49cc-9294-f0c1c02f91fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:54.828071 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa43406-66fa-49cc-9294-f0c1c02f91fb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:54.828352 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa43406-66fa-49cc-9294-f0c1c02f91fb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:54.828632 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa43406-66fa-49cc-9294-f0c1c02f91fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:54.897210 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa43406-66fa-49cc-9294-f0c1c02f91fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:54.898682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa43406-66fa-49cc-9294-f0c1c02f91fb None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:54.982177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:55.003767 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 556/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:04:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:04:55.009828 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1569e4-4b0d-446a-894d-3f5a29c78d45 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:55.108585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1569e4-4b0d-446a-894d-3f5a29c78d45 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:55.140913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3843c30-d856-44e1-974e-974fc34c97d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:55.141761 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3843c30-d856-44e1-974e-974fc34c97d6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:55.142040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3843c30-d856-44e1-974e-974fc34c97d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:55.142312 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3843c30-d856-44e1-974e-974fc34c97d6 None admin] PATH_INFO: `/v3/projects/e684f0363b674ab3aad0e4909c034d9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:55.143497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3843c30-d856-44e1-974e-974fc34c97d6 None admin] RBAC: Authorizing `identity:get_project(project_id=e684f0363b674ab3aad0e4909c034d9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:55.144914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3843c30-d856-44e1-974e-974fc34c97d6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:55.146604 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 560/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:04:55 2022] GET /identity/v3/projects/e684f0363b674ab3aad0e4909c034d9c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:55.153548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa43406-66fa-49cc-9294-f0c1c02f91fb None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:55.250754 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa43406-66fa-49cc-9294-f0c1c02f91fb None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:55.284271 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78c6ae-10a6-4535-a1c1-bd6a280cf1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:55.284928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78c6ae-10a6-4535-a1c1-bd6a280cf1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:55.285210 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78c6ae-10a6-4535-a1c1-bd6a280cf1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:55.285485 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78c6ae-10a6-4535-a1c1-bd6a280cf1f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:55.286307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78c6ae-10a6-4535-a1c1-bd6a280cf1f0 None admin] RBAC: Adding query filter params (role.id=255c2b4827324109a6d2068c8b0316c3, scope.project.id=e684f0363b674ab3aad0e4909c034d9c, user.id=90393dd8c5cb4dcdb3a5c31c50c9ce18) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:04:55.286648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78c6ae-10a6-4535-a1c1-bd6a280cf1f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:55.288065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78c6ae-10a6-4535-a1c1-bd6a280cf1f0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:55.293499 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 557/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:04:55 2022] GET /identity/v3/role_assignments?user.id=90393dd8c5cb4dcdb3a5c31c50c9ce18&scope.project.id=e684f0363b674ab3aad0e4909c034d9c&role.id=255c2b4827324109a6d2068c8b0316c3 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:57.366954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb09204-e640-4919-90ea-21b9f3ea03fe None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:57.367506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb09204-e640-4919-90ea-21b9f3ea03fe None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:57.367506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb09204-e640-4919-90ea-21b9f3ea03fe None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:57.368922 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 561/1118] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:04:57.374272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b323c02-2147-4332-b6e6-80e6af71e169 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:57.374731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b323c02-2147-4332-b6e6-80e6af71e169 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:57.374874 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b323c02-2147-4332-b6e6-80e6af71e169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:57.392307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3b323c02-2147-4332-b6e6-80e6af71e169 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:04:57.393500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3b323c02-2147-4332-b6e6-80e6af71e169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:04:57.429089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:57.461170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 558/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:04:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:04:57.483689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb09204-e640-4919-90ea-21b9f3ea03fe None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:57.492393 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:57.584021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb09204-e640-4919-90ea-21b9f3ea03fe None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:57.616271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70304dae-2778-4cb9-a85c-d0345bb3b72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:57.617200 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70304dae-2778-4cb9-a85c-d0345bb3b72a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:57.617435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70304dae-2778-4cb9-a85c-d0345bb3b72a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:57.617710 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70304dae-2778-4cb9-a85c-d0345bb3b72a None admin] PATH_INFO: `/v3/roles/255c2b4827324109a6d2068c8b0316c3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:57.619194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70304dae-2778-4cb9-a85c-d0345bb3b72a None admin] RBAC: Authorizing `identity:get_role(role_id=255c2b4827324109a6d2068c8b0316c3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:57.620565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70304dae-2778-4cb9-a85c-d0345bb3b72a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:57.622700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 562/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:04:57 2022] GET /identity/v3/roles/255c2b4827324109a6d2068c8b0316c3 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:57.628659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b323c02-2147-4332-b6e6-80e6af71e169 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:57.726034 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b323c02-2147-4332-b6e6-80e6af71e169 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:57.759794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343ddb9-c126-4d5a-8f6d-b7df60c7e01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:57.760670 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343ddb9-c126-4d5a-8f6d-b7df60c7e01e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:57.760957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343ddb9-c126-4d5a-8f6d-b7df60c7e01e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:57.761286 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343ddb9-c126-4d5a-8f6d-b7df60c7e01e None admin] PATH_INFO: `/v3/users/90393dd8c5cb4dcdb3a5c31c50c9ce18` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:57.762990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343ddb9-c126-4d5a-8f6d-b7df60c7e01e None admin] RBAC: Authorizing `identity:get_user(user_id=90393dd8c5cb4dcdb3a5c31c50c9ce18)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:57.764413 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343ddb9-c126-4d5a-8f6d-b7df60c7e01e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:57.766040 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 559/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:04:57 2022] GET /identity/v3/users/90393dd8c5cb4dcdb3a5c31c50c9ce18 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:57.771838 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70304dae-2778-4cb9-a85c-d0345bb3b72a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:57.845921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:57.871842 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70304dae-2778-4cb9-a85c-d0345bb3b72a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:57.906125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d61bd-59db-4328-b8c2-00fe444a1fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:57.907012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d61bd-59db-4328-b8c2-00fe444a1fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:57.907302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d61bd-59db-4328-b8c2-00fe444a1fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:57.907581 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d61bd-59db-4328-b8c2-00fe444a1fd6 None admin] PATH_INFO: `/v3/projects/e684f0363b674ab3aad0e4909c034d9c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:57.908749 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d61bd-59db-4328-b8c2-00fe444a1fd6 None admin] RBAC: Authorizing `identity:get_project(project_id=e684f0363b674ab3aad0e4909c034d9c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:57.910174 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d61bd-59db-4328-b8c2-00fe444a1fd6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:57.911885 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 563/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:04:57 2022] GET /identity/v3/projects/e684f0363b674ab3aad0e4909c034d9c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:04:57.918381 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343ddb9-c126-4d5a-8f6d-b7df60c7e01e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:04:57.959947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:04:58.015801 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343ddb9-c126-4d5a-8f6d-b7df60c7e01e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:04:58.049359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c7acd-9545-4b91-be31-3fe4a86ec075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:04:58.050238 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c7acd-9545-4b91-be31-3fe4a86ec075 None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:04:58.050550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c7acd-9545-4b91-be31-3fe4a86ec075 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:04:58.050830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c7acd-9545-4b91-be31-3fe4a86ec075 None admin] PATH_INFO: `/v3/projects/e684f0363b674ab3aad0e4909c034d9c/users/90393dd8c5cb4dcdb3a5c31c50c9ce18/roles/255c2b4827324109a6d2068c8b0316c3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:04:58.052966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c7acd-9545-4b91-be31-3fe4a86ec075 None admin] RBAC: Authorizing `identity:create_grant(project_id=e684f0363b674ab3aad0e4909c034d9c, user_id=90393dd8c5cb4dcdb3a5c31c50c9ce18, role_id=255c2b4827324109a6d2068c8b0316c3)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:04:58.054392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c7acd-9545-4b91-be31-3fe4a86ec075 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:04:58.067650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 560/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:04:57 2022] PUT /identity/v3/projects/e684f0363b674ab3aad0e4909c034d9c/users/90393dd8c5cb4dcdb3a5c31c50c9ce18/roles/255c2b4827324109a6d2068c8b0316c3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:05:00.199959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4da52-057c-4fdd-829a-4b972ff69f0c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:00.200497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4da52-057c-4fdd-829a-4b972ff69f0c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:00.200497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4da52-057c-4fdd-829a-4b972ff69f0c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:00.201857 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 564/1124] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:05:00.207439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99058abf-815a-46e9-9223-7d776d23c39a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:00.207826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99058abf-815a-46e9-9223-7d776d23c39a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:00.208047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99058abf-815a-46e9-9223-7d776d23c39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:00.224963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-99058abf-815a-46e9-9223-7d776d23c39a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:05:00.226189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-99058abf-815a-46e9-9223-7d776d23c39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:05:00.294751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 561/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:05:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:05:00.325359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4da52-057c-4fdd-829a-4b972ff69f0c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:00.440602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4da52-057c-4fdd-829a-4b972ff69f0c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:00.473323 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b05ee-09b2-40b9-b289-3381ed05f87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:00.474115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b05ee-09b2-40b9-b289-3381ed05f87e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:00.474393 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b05ee-09b2-40b9-b289-3381ed05f87e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:00.474696 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b05ee-09b2-40b9-b289-3381ed05f87e None admin] PATH_INFO: `/v3/roles/255c2b4827324109a6d2068c8b0316c3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:00.476146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b05ee-09b2-40b9-b289-3381ed05f87e None admin] RBAC: Authorizing `identity:get_role(role_id=255c2b4827324109a6d2068c8b0316c3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:00.477514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b05ee-09b2-40b9-b289-3381ed05f87e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:00.478913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 565/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:05:00 2022] GET /identity/v3/roles/255c2b4827324109a6d2068c8b0316c3 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:00.485673 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99058abf-815a-46e9-9223-7d776d23c39a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:00.515855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:00.585581 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99058abf-815a-46e9-9223-7d776d23c39a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:00.620707 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8479cd5-516f-45fd-8e14-0eb96261406a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:00.621696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8479cd5-516f-45fd-8e14-0eb96261406a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:00.621984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8479cd5-516f-45fd-8e14-0eb96261406a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:00.622266 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8479cd5-516f-45fd-8e14-0eb96261406a None admin] PATH_INFO: `/v3/users/90393dd8c5cb4dcdb3a5c31c50c9ce18` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:00.623477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8479cd5-516f-45fd-8e14-0eb96261406a None admin] RBAC: Authorizing `identity:get_user(user_id=90393dd8c5cb4dcdb3a5c31c50c9ce18)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:00.624915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8479cd5-516f-45fd-8e14-0eb96261406a None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:00.626574 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 562/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:05:00 2022] GET /identity/v3/users/90393dd8c5cb4dcdb3a5c31c50c9ce18 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:00.632466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b05ee-09b2-40b9-b289-3381ed05f87e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:00.646003 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:00.742077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b05ee-09b2-40b9-b289-3381ed05f87e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:00.775869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf598b-8ec5-488c-a96b-496e0b6bafa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:00.776519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf598b-8ec5-488c-a96b-496e0b6bafa1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:00.777906 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf598b-8ec5-488c-a96b-496e0b6bafa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:00.778107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf598b-8ec5-488c-a96b-496e0b6bafa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:00.847847 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf598b-8ec5-488c-a96b-496e0b6bafa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:00.849303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf598b-8ec5-488c-a96b-496e0b6bafa1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:00.861213 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:00.951047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 566/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:05:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:00.957012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8479cd5-516f-45fd-8e14-0eb96261406a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:01.065312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:01.072887 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8479cd5-516f-45fd-8e14-0eb96261406a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:01.108088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6aff94-0468-4120-95e9-5642e5fe053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:01.108958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6aff94-0468-4120-95e9-5642e5fe053c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:01.109247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6aff94-0468-4120-95e9-5642e5fe053c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:01.109528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6aff94-0468-4120-95e9-5642e5fe053c None admin] PATH_INFO: `/v3/projects/e684f0363b674ab3aad0e4909c034d9c` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:01.110750 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6aff94-0468-4120-95e9-5642e5fe053c None admin] RBAC: Authorizing `identity:get_project(project_id=e684f0363b674ab3aad0e4909c034d9c)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:01.112184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6aff94-0468-4120-95e9-5642e5fe053c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:01.113895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 563/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:05:00 2022] GET /identity/v3/projects/e684f0363b674ab3aad0e4909c034d9c => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:01.120015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf598b-8ec5-488c-a96b-496e0b6bafa1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:01.218063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf598b-8ec5-488c-a96b-496e0b6bafa1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:01.228381 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:01.251779 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25deb4-16b4-4f0f-8903-ad56790a3912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:01.252425 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25deb4-16b4-4f0f-8903-ad56790a3912 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:01.252711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25deb4-16b4-4f0f-8903-ad56790a3912 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:01.252985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25deb4-16b4-4f0f-8903-ad56790a3912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:01.253804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25deb4-16b4-4f0f-8903-ad56790a3912 None admin] RBAC: Adding query filter params (role.id=255c2b4827324109a6d2068c8b0316c3, scope.project.id=e684f0363b674ab3aad0e4909c034d9c, user.id=90393dd8c5cb4dcdb3a5c31c50c9ce18) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:05:01.254117 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25deb4-16b4-4f0f-8903-ad56790a3912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:01.255572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25deb4-16b4-4f0f-8903-ad56790a3912 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:01.261793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 567/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:05:01 2022] GET /identity/v3/role_assignments?user.id=90393dd8c5cb4dcdb3a5c31c50c9ce18&scope.project.id=e684f0363b674ab3aad0e4909c034d9c&role.id=255c2b4827324109a6d2068c8b0316c3 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:03.492833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736d59c-d145-46fd-bf70-d6a26eb3dc7b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:03.493388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736d59c-d145-46fd-bf70-d6a26eb3dc7b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:03.493388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736d59c-d145-46fd-bf70-d6a26eb3dc7b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:03.494808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 564/1131] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:05:03.500572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9102b-b403-42b6-898f-f2aa33641c8c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:03.500990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9102b-b403-42b6-898f-f2aa33641c8c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:03.501127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9102b-b403-42b6-898f-f2aa33641c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:03.517935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d3e9102b-b403-42b6-898f-f2aa33641c8c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:05:03.519147 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d3e9102b-b403-42b6-898f-f2aa33641c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:05:03.585881 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 568/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:05:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:05:03.609082 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736d59c-d145-46fd-bf70-d6a26eb3dc7b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:03.709374 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736d59c-d145-46fd-bf70-d6a26eb3dc7b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:03.741891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee245ebf-a007-45a0-8e1d-47da82f209d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:03.742702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee245ebf-a007-45a0-8e1d-47da82f209d9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:03.742985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee245ebf-a007-45a0-8e1d-47da82f209d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:03.743258 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee245ebf-a007-45a0-8e1d-47da82f209d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:03.744430 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee245ebf-a007-45a0-8e1d-47da82f209d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:03.746642 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee245ebf-a007-45a0-8e1d-47da82f209d9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:03.748252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 565/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:05:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:03.754043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9102b-b403-42b6-898f-f2aa33641c8c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:03.852314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9102b-b403-42b6-898f-f2aa33641c8c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:03.854737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:03.886803 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d41fb-4d8b-4f2d-94ba-51788a1dfce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:03.887463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d41fb-4d8b-4f2d-94ba-51788a1dfce7 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:03.887744 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d41fb-4d8b-4f2d-94ba-51788a1dfce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:03.888020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d41fb-4d8b-4f2d-94ba-51788a1dfce7 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:03.888727 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d41fb-4d8b-4f2d-94ba-51788a1dfce7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:03.890168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d41fb-4d8b-4f2d-94ba-51788a1dfce7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:03.914500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 569/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 16 16:05:03 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:05:06.064052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23450e9b-3f9c-4b8c-ad50-d2e766e153f8 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:06.064615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23450e9b-3f9c-4b8c-ad50-d2e766e153f8 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:06.064615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23450e9b-3f9c-4b8c-ad50-d2e766e153f8 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:06.065974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 566/1135] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:05:06.071489 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13184ef-4038-4011-959f-89b351121e06 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:06.071878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13184ef-4038-4011-959f-89b351121e06 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:06.072054 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13184ef-4038-4011-959f-89b351121e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:06.088534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d13184ef-4038-4011-959f-89b351121e06 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:05:06.090447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d13184ef-4038-4011-959f-89b351121e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:05:06.164936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 570/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:05:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:05:06.191540 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23450e9b-3f9c-4b8c-ad50-d2e766e153f8 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:06.228116 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:06.294535 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23450e9b-3f9c-4b8c-ad50-d2e766e153f8 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:06.328362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf8ed0-286b-417d-92ce-5f43bd44f277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:06.329084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf8ed0-286b-417d-92ce-5f43bd44f277 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:06.329372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf8ed0-286b-417d-92ce-5f43bd44f277 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:06.329651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf8ed0-286b-417d-92ce-5f43bd44f277 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:06.330856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf8ed0-286b-417d-92ce-5f43bd44f277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:06.332276 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf8ed0-286b-417d-92ce-5f43bd44f277 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:06.333889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 567/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:05:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:06.340831 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13184ef-4038-4011-959f-89b351121e06 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:06.429401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:06.445747 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13184ef-4038-4011-959f-89b351121e06 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:06.479349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b99e63-f0f9-4f7e-9010-cd5bcac776c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:06.480273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b99e63-f0f9-4f7e-9010-cd5bcac776c3 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:06.480562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b99e63-f0f9-4f7e-9010-cd5bcac776c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:06.480840 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b99e63-f0f9-4f7e-9010-cd5bcac776c3 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:06.481543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b99e63-f0f9-4f7e-9010-cd5bcac776c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:06.482996 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b99e63-f0f9-4f7e-9010-cd5bcac776c3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:06.501880 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 571/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:05:06 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:05:08.677424 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a9fba-96fb-41ad-9654-2425c54add4a None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:08.677961 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a9fba-96fb-41ad-9654-2425c54add4a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:08.678059 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a9fba-96fb-41ad-9654-2425c54add4a None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:08.679472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 568/1139] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:05:08.685176 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9692f-4a7f-4872-8bf4-aa8b5c7aae37 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:08.685583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9692f-4a7f-4872-8bf4-aa8b5c7aae37 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:08.685728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9692f-4a7f-4872-8bf4-aa8b5c7aae37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:08.702236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-daa9692f-4a7f-4872-8bf4-aa8b5c7aae37 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:05:08.703443 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-daa9692f-4a7f-4872-8bf4-aa8b5c7aae37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:05:08.770708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 572/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:05:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:05:08.802612 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a9fba-96fb-41ad-9654-2425c54add4a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:08.916812 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a9fba-96fb-41ad-9654-2425c54add4a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:08.919150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:08.956215 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d071f-1460-4207-8ef0-70ad9134abd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:08.956924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d071f-1460-4207-8ef0-70ad9134abd8 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:08.957209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d071f-1460-4207-8ef0-70ad9134abd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:08.957488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d071f-1460-4207-8ef0-70ad9134abd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:08.969873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d071f-1460-4207-8ef0-70ad9134abd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-e03d071f-1460-4207-8ef0-70ad9134abd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:05:08.977898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:05:08.979108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:05:08.980120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:05:08.980120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:05:08.980120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:05:08.980120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:05:08.980120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:05:08.980120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:05:08.980120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:05:08.980120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:05:08.980120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:05:08.980120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:05:08.980120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:05:08.980120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:05:08.980120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 569/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:05:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:05:08.985899 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9692f-4a7f-4872-8bf4-aa8b5c7aae37 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:09.064300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:09.112679 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9692f-4a7f-4872-8bf4-aa8b5c7aae37 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:09.155692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2abcf9-a60c-4916-9a13-bc700125991d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:09.156357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2abcf9-a60c-4916-9a13-bc700125991d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:09.157754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2abcf9-a60c-4916-9a13-bc700125991d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:09.158047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2abcf9-a60c-4916-9a13-bc700125991d None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:09.159428 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2abcf9-a60c-4916-9a13-bc700125991d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:05:09.159741 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2abcf9-a60c-4916-9a13-bc700125991d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:09.163112 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2abcf9-a60c-4916-9a13-bc700125991d None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:09.175234 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 573/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:05:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:09.181145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d071f-1460-4207-8ef0-70ad9134abd8 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:09.301364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d071f-1460-4207-8ef0-70ad9134abd8 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:09.340968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10b7f8-4682-46a6-ba43-9c06eab7251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:09.341849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10b7f8-4682-46a6-ba43-9c06eab7251f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:09.342133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10b7f8-4682-46a6-ba43-9c06eab7251f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:09.342412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10b7f8-4682-46a6-ba43-9c06eab7251f None admin] PATH_INFO: `/v3/users/70887369ba5d40eca72b8428a3685f04` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:09.358217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10b7f8-4682-46a6-ba43-9c06eab7251f None admin] RBAC: Authorizing `identity:get_user(user_id=70887369ba5d40eca72b8428a3685f04)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:09.359723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10b7f8-4682-46a6-ba43-9c06eab7251f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:09.361471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 570/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:05:09 2022] GET /identity/v3/users/70887369ba5d40eca72b8428a3685f04 => generated 286 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:09.369408 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2abcf9-a60c-4916-9a13-bc700125991d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:09.509346 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2abcf9-a60c-4916-9a13-bc700125991d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:09.545241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2a37b-7cbe-4a04-8d4a-37d099f835c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:09.545896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2a37b-7cbe-4a04-8d4a-37d099f835c6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:09.546182 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2a37b-7cbe-4a04-8d4a-37d099f835c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:09.546484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2a37b-7cbe-4a04-8d4a-37d099f835c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:09.549109 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:09.627386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2a37b-7cbe-4a04-8d4a-37d099f835c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:09.628749 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2a37b-7cbe-4a04-8d4a-37d099f835c6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:09.727668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 574/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:05:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:09.734110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10b7f8-4682-46a6-ba43-9c06eab7251f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:09.755065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:09.838524 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10b7f8-4682-46a6-ba43-9c06eab7251f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:09.873832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef5ad8-9ec4-4db6-b7f2-994ef1d3565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:09.874720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef5ad8-9ec4-4db6-b7f2-994ef1d3565d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:09.875009 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef5ad8-9ec4-4db6-b7f2-994ef1d3565d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:09.875288 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef5ad8-9ec4-4db6-b7f2-994ef1d3565d None admin] PATH_INFO: `/v3/projects/35765d1689ca4bd9bf2430335e9c70a4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:09.876456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef5ad8-9ec4-4db6-b7f2-994ef1d3565d None admin] RBAC: Authorizing `identity:get_project(project_id=35765d1689ca4bd9bf2430335e9c70a4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:09.877974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef5ad8-9ec4-4db6-b7f2-994ef1d3565d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:09.879660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 571/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:05:09 2022] GET /identity/v3/projects/35765d1689ca4bd9bf2430335e9c70a4 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:09.885886 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2a37b-7cbe-4a04-8d4a-37d099f835c6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:09.919531 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:09.985501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2a37b-7cbe-4a04-8d4a-37d099f835c6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:10.019036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bcd53-c007-43e3-9c36-fe20067203df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:10.019688 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bcd53-c007-43e3-9c36-fe20067203df None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:10.019977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bcd53-c007-43e3-9c36-fe20067203df None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:10.020256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bcd53-c007-43e3-9c36-fe20067203df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:10.021089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bcd53-c007-43e3-9c36-fe20067203df None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=35765d1689ca4bd9bf2430335e9c70a4, user.id=70887369ba5d40eca72b8428a3685f04) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:05:10.021405 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bcd53-c007-43e3-9c36-fe20067203df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:10.022871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bcd53-c007-43e3-9c36-fe20067203df None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:10.029072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 575/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:05:09 2022] GET /identity/v3/role_assignments?user.id=70887369ba5d40eca72b8428a3685f04&scope.project.id=35765d1689ca4bd9bf2430335e9c70a4&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:12.154285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a141c-39c6-45fa-af17-bf2f15dfbe40 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:12.154854 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a141c-39c6-45fa-af17-bf2f15dfbe40 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:12.154986 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a141c-39c6-45fa-af17-bf2f15dfbe40 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:12.156265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 572/1147] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:05:12.161567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4807d-0bd8-4c9d-9f1c-6e3153c06cc3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:12.161940 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4807d-0bd8-4c9d-9f1c-6e3153c06cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:12.162124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4807d-0bd8-4c9d-9f1c-6e3153c06cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:12.178897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-13a4807d-0bd8-4c9d-9f1c-6e3153c06cc3 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:05:12.180061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-13a4807d-0bd8-4c9d-9f1c-6e3153c06cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:05:12.246273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 576/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:05:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:05:12.268188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a141c-39c6-45fa-af17-bf2f15dfbe40 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:12.361529 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:12.375204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a141c-39c6-45fa-af17-bf2f15dfbe40 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:12.410409 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536a11d-25e7-4c53-ace7-e7ac7aca121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:12.411163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536a11d-25e7-4c53-ace7-e7ac7aca121f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:12.411455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536a11d-25e7-4c53-ace7-e7ac7aca121f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:12.411732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536a11d-25e7-4c53-ace7-e7ac7aca121f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:12.422357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536a11d-25e7-4c53-ace7-e7ac7aca121f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-4536a11d-25e7-4c53-ace7-e7ac7aca121f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:05:12.429960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:05:12.431075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:05:12.431991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:05:12.431991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:05:12.431991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:05:12.431991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:05:12.431991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:05:12.431991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:05:12.431991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:05:12.431991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:05:12.431991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:05:12.431991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:05:12.431991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:05:12.431991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:05:12.431991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 573/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:05:12.437991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4807d-0bd8-4c9d-9f1c-6e3153c06cc3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:12.466274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:12.536752 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4807d-0bd8-4c9d-9f1c-6e3153c06cc3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:12.570580 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95aae3-92c6-496f-89e7-9795ce9a44f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:12.571248 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95aae3-92c6-496f-89e7-9795ce9a44f5 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:12.571533 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95aae3-92c6-496f-89e7-9795ce9a44f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:12.571812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95aae3-92c6-496f-89e7-9795ce9a44f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:12.572642 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95aae3-92c6-496f-89e7-9795ce9a44f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:05:12.572950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95aae3-92c6-496f-89e7-9795ce9a44f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:12.575052 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95aae3-92c6-496f-89e7-9795ce9a44f5 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:12.583019 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 577/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:12.589144 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536a11d-25e7-4c53-ace7-e7ac7aca121f None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:12.687719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536a11d-25e7-4c53-ace7-e7ac7aca121f None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:12.721913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7519e-155c-468e-a3f2-a790df951fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:12.722823 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7519e-155c-468e-a3f2-a790df951fdd None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:12.723129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7519e-155c-468e-a3f2-a790df951fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:12.723406 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7519e-155c-468e-a3f2-a790df951fdd None admin] PATH_INFO: `/v3/users/70887369ba5d40eca72b8428a3685f04` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:12.724615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7519e-155c-468e-a3f2-a790df951fdd None admin] RBAC: Authorizing `identity:get_user(user_id=70887369ba5d40eca72b8428a3685f04)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:12.726061 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7519e-155c-468e-a3f2-a790df951fdd None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:12.727754 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 574/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:05:12 2022] GET /identity/v3/users/70887369ba5d40eca72b8428a3685f04 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:12.733611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95aae3-92c6-496f-89e7-9795ce9a44f5 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:12.823395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:12.834165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95aae3-92c6-496f-89e7-9795ce9a44f5 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:12.866868 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49c71b-d4da-4b40-a6b2-5ff9fa54b7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:12.867723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49c71b-d4da-4b40-a6b2-5ff9fa54b7cf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:12.868009 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49c71b-d4da-4b40-a6b2-5ff9fa54b7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:12.868286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49c71b-d4da-4b40-a6b2-5ff9fa54b7cf None admin] PATH_INFO: `/v3/projects/35765d1689ca4bd9bf2430335e9c70a4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:12.869530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49c71b-d4da-4b40-a6b2-5ff9fa54b7cf None admin] RBAC: Authorizing `identity:get_project(project_id=35765d1689ca4bd9bf2430335e9c70a4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:12.871588 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49c71b-d4da-4b40-a6b2-5ff9fa54b7cf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:12.873462 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 578/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:05:12 2022] GET /identity/v3/projects/35765d1689ca4bd9bf2430335e9c70a4 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:12.879456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7519e-155c-468e-a3f2-a790df951fdd None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:12.898290 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:12.980433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7519e-155c-468e-a3f2-a790df951fdd None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:13.013613 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82731b2b-35c8-406a-a095-7cde05822bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:13.014530 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82731b2b-35c8-406a-a095-7cde05822bbf None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:13.014819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82731b2b-35c8-406a-a095-7cde05822bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:13.015100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82731b2b-35c8-406a-a095-7cde05822bbf None admin] PATH_INFO: `/v3/projects/35765d1689ca4bd9bf2430335e9c70a4/users/70887369ba5d40eca72b8428a3685f04/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:13.017046 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82731b2b-35c8-406a-a095-7cde05822bbf None admin] RBAC: Authorizing `identity:create_grant(project_id=35765d1689ca4bd9bf2430335e9c70a4, user_id=70887369ba5d40eca72b8428a3685f04, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:13.018501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82731b2b-35c8-406a-a095-7cde05822bbf None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:13.031426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 575/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:05:12 2022] PUT /identity/v3/projects/35765d1689ca4bd9bf2430335e9c70a4/users/70887369ba5d40eca72b8428a3685f04/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:05:15.154827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f60d6-8e63-4fff-9e90-e94ba64feafc None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:15.155504 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f60d6-8e63-4fff-9e90-e94ba64feafc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:15.155504 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f60d6-8e63-4fff-9e90-e94ba64feafc None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:15.156759 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 579/1154] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:05:15.163726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dd43f-4829-48d3-8e2c-b2dd495c5ff9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:15.164220 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dd43f-4829-48d3-8e2c-b2dd495c5ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:15.164337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dd43f-4829-48d3-8e2c-b2dd495c5ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:15.184569 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-c40dd43f-4829-48d3-8e2c-b2dd495c5ff9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:05:15.185750 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c40dd43f-4829-48d3-8e2c-b2dd495c5ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:05:15.251912 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 576/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:05:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:05:15.275531 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f60d6-8e63-4fff-9e90-e94ba64feafc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:15.377889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f60d6-8e63-4fff-9e90-e94ba64feafc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:15.411673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9f3b4-7dce-41f4-9ff3-745232e7e930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:15.412399 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9f3b4-7dce-41f4-9ff3-745232e7e930 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:15.412681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9f3b4-7dce-41f4-9ff3-745232e7e930 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:15.412958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9f3b4-7dce-41f4-9ff3-745232e7e930 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:15.423357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9f3b4-7dce-41f4-9ff3-745232e7e930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6ff9f3b4-7dce-41f4-9ff3-745232e7e930 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:05:15.430844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:05:15.432080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:05:15.433305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:05:15.433305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:05:15.433305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:05:15.433305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:05:15.433305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:05:15.433305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:05:15.433305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:05:15.433305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:05:15.433305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:05:15.433305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:05:15.433305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:05:15.433305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:05:15.433305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 580/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:05:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:05:15.438110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dd43f-4829-48d3-8e2c-b2dd495c5ff9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:15.446417 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:15.545380 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dd43f-4829-48d3-8e2c-b2dd495c5ff9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:15.582491 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999fb02-5800-4f90-ba98-6acd55d31fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:15.583165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999fb02-5800-4f90-ba98-6acd55d31fdf None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:15.583451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999fb02-5800-4f90-ba98-6acd55d31fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:15.583730 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999fb02-5800-4f90-ba98-6acd55d31fdf None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:15.584465 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999fb02-5800-4f90-ba98-6acd55d31fdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:05:15.584772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999fb02-5800-4f90-ba98-6acd55d31fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:15.586129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999fb02-5800-4f90-ba98-6acd55d31fdf None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:15.594005 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 577/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:05:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:15.600085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9f3b4-7dce-41f4-9ff3-745232e7e930 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:15.619378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:15.699915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9f3b4-7dce-41f4-9ff3-745232e7e930 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:15.732788 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815581e-9708-4344-8756-529fa0803cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:15.733736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815581e-9708-4344-8756-529fa0803cda None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:15.734022 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815581e-9708-4344-8756-529fa0803cda None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:15.734298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815581e-9708-4344-8756-529fa0803cda None admin] PATH_INFO: `/v3/users/70887369ba5d40eca72b8428a3685f04` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:15.735500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815581e-9708-4344-8756-529fa0803cda None admin] RBAC: Authorizing `identity:get_user(user_id=70887369ba5d40eca72b8428a3685f04)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:15.736929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815581e-9708-4344-8756-529fa0803cda None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:15.738712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 581/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:05:15 2022] GET /identity/v3/users/70887369ba5d40eca72b8428a3685f04 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:15.744430 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999fb02-5800-4f90-ba98-6acd55d31fdf None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:15.813376 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:15.850152 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999fb02-5800-4f90-ba98-6acd55d31fdf None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:15.887890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc29eac-bbda-4484-bd1a-805cc3895f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:15.888549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc29eac-bbda-4484-bd1a-805cc3895f5b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:15.888838 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc29eac-bbda-4484-bd1a-805cc3895f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:15.889120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc29eac-bbda-4484-bd1a-805cc3895f5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:15.957641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc29eac-bbda-4484-bd1a-805cc3895f5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:15.959053 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc29eac-bbda-4484-bd1a-805cc3895f5b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:16.023707 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:16.059761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 578/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:05:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:16.065803 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815581e-9708-4344-8756-529fa0803cda None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:16.147345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:16.166384 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815581e-9708-4344-8756-529fa0803cda None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:16.212246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92571adf-0787-45ab-952f-83f8312b55cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:16.213279 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92571adf-0787-45ab-952f-83f8312b55cc None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:16.213568 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92571adf-0787-45ab-952f-83f8312b55cc None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:16.214199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92571adf-0787-45ab-952f-83f8312b55cc None admin] PATH_INFO: `/v3/projects/35765d1689ca4bd9bf2430335e9c70a4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:16.216254 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92571adf-0787-45ab-952f-83f8312b55cc None admin] RBAC: Authorizing `identity:get_project(project_id=35765d1689ca4bd9bf2430335e9c70a4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:16.218602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92571adf-0787-45ab-952f-83f8312b55cc None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:16.221389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 582/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:05:16 2022] GET /identity/v3/projects/35765d1689ca4bd9bf2430335e9c70a4 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:16.227464 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc29eac-bbda-4484-bd1a-805cc3895f5b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:16.330699 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc29eac-bbda-4484-bd1a-805cc3895f5b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:16.366005 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae3a58-d017-4964-aa33-2d9072fa2c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:16.366708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae3a58-d017-4964-aa33-2d9072fa2c55 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:16.367003 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae3a58-d017-4964-aa33-2d9072fa2c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:16.367626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae3a58-d017-4964-aa33-2d9072fa2c55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:16.368102 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae3a58-d017-4964-aa33-2d9072fa2c55 None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=35765d1689ca4bd9bf2430335e9c70a4, user.id=70887369ba5d40eca72b8428a3685f04) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:05:16.368417 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae3a58-d017-4964-aa33-2d9072fa2c55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:16.369923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae3a58-d017-4964-aa33-2d9072fa2c55 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:16.378335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 579/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:05:16 2022] GET /identity/v3/role_assignments?user.id=70887369ba5d40eca72b8428a3685f04&scope.project.id=35765d1689ca4bd9bf2430335e9c70a4&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:05:18.535407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be7db9-dec3-4e69-812d-62c378f3c640 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:18.535930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be7db9-dec3-4e69-812d-62c378f3c640 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:18.536129 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be7db9-dec3-4e69-812d-62c378f3c640 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:18.537318 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 583/1162] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:05:18.543099 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4b417-74d6-49f3-b6b8-d5ac778b6b48 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:18.543503 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4b417-74d6-49f3-b6b8-d5ac778b6b48 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:18.543662 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4b417-74d6-49f3-b6b8-d5ac778b6b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:18.560135 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-69b4b417-74d6-49f3-b6b8-d5ac778b6b48 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:05:18.561316 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-69b4b417-74d6-49f3-b6b8-d5ac778b6b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:05:18.586416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:18.628139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 580/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:05:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:05:18.650262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be7db9-dec3-4e69-812d-62c378f3c640 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:18.751102 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be7db9-dec3-4e69-812d-62c378f3c640 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:18.784073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94888011-5ad5-4bbb-ac31-30bf40c3fe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:18.784714 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94888011-5ad5-4bbb-ac31-30bf40c3fe7e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:18.784998 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94888011-5ad5-4bbb-ac31-30bf40c3fe7e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:18.785275 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94888011-5ad5-4bbb-ac31-30bf40c3fe7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:18.809020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:18.852020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94888011-5ad5-4bbb-ac31-30bf40c3fe7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:18.853469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94888011-5ad5-4bbb-ac31-30bf40c3fe7e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:18.949763 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 584/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:05:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:18.955667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4b417-74d6-49f3-b6b8-d5ac778b6b48 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:19.054646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4b417-74d6-49f3-b6b8-d5ac778b6b48 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:19.090574 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bae49-7b1c-4baa-94e4-740e79ff8d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:19.091375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bae49-7b1c-4baa-94e4-740e79ff8d83 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:19.091663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bae49-7b1c-4baa-94e4-740e79ff8d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:19.091944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bae49-7b1c-4baa-94e4-740e79ff8d83 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:19.098641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bae49-7b1c-4baa-94e4-740e79ff8d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:19.100081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bae49-7b1c-4baa-94e4-740e79ff8d83 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-930bae49-7b1c-4baa-94e4-740e79ff8d83 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:05:19.114645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:05:19.115903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:05:19.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:05:19.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:05:19.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:05:19.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:05:19.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:05:19.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:05:19.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:05:19.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:05:19.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:05:19.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:05:19.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 16:05:19.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:05:19.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 16:05:19.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:05:19.117101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 581/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 16 16:05:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:05:19.122325 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94888011-5ad5-4bbb-ac31-30bf40c3fe7e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:19.179967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:19.226109 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94888011-5ad5-4bbb-ac31-30bf40c3fe7e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:19.260070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708dfe5-af6f-4b89-a3f4-51ba57191a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:19.260070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708dfe5-af6f-4b89-a3f4-51ba57191a77 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:19.260358 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708dfe5-af6f-4b89-a3f4-51ba57191a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:19.260608 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708dfe5-af6f-4b89-a3f4-51ba57191a77 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:19.261344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708dfe5-af6f-4b89-a3f4-51ba57191a77 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:05:19.261642 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708dfe5-af6f-4b89-a3f4-51ba57191a77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:19.263027 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708dfe5-af6f-4b89-a3f4-51ba57191a77 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:19.269940 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 585/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jun 16 16:05:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:21.388813 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aadc9-53b2-4a6f-8d8f-1ed73e27c469 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:21.389284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aadc9-53b2-4a6f-8d8f-1ed73e27c469 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:21.389423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aadc9-53b2-4a6f-8d8f-1ed73e27c469 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:21.390891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 582/1167] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:05:21.396161 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a709a-d0fd-4cb6-bbd7-a326cf39aaa8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:21.396567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a709a-d0fd-4cb6-bbd7-a326cf39aaa8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:21.396710 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a709a-d0fd-4cb6-bbd7-a326cf39aaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:21.413601 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ac2a709a-d0fd-4cb6-bbd7-a326cf39aaa8 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:05:21.414836 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ac2a709a-d0fd-4cb6-bbd7-a326cf39aaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:05:21.485317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 586/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:05:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:05:21.509084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aadc9-53b2-4a6f-8d8f-1ed73e27c469 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:21.535308 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:21.615698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aadc9-53b2-4a6f-8d8f-1ed73e27c469 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:21.655764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b5c6c-0f09-4d8d-9d37-b308ef66ae54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:21.656345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b5c6c-0f09-4d8d-9d37-b308ef66ae54 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:21.656626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b5c6c-0f09-4d8d-9d37-b308ef66ae54 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:21.656904 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b5c6c-0f09-4d8d-9d37-b308ef66ae54 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:21.657714 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b5c6c-0f09-4d8d-9d37-b308ef66ae54 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:21.659309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b5c6c-0f09-4d8d-9d37-b308ef66ae54 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:21.674271 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 583/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Thu Jun 16 16:05:21 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:05:23.825086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d9889-91a9-46bc-b778-d0d19d3f4038 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:23.825649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d9889-91a9-46bc-b778-d0d19d3f4038 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:23.825649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d9889-91a9-46bc-b778-d0d19d3f4038 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:23.827044 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 587/1170] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:05:23.832294 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc05b4a-bc1c-4308-b6ed-83cbf4bc5df3 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:23.832699 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc05b4a-bc1c-4308-b6ed-83cbf4bc5df3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:23.832864 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc05b4a-bc1c-4308-b6ed-83cbf4bc5df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:23.849942 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-abc05b4a-bc1c-4308-b6ed-83cbf4bc5df3 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:05:23.851166 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-abc05b4a-bc1c-4308-b6ed-83cbf4bc5df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:05:23.919112 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 584/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:05:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:05:23.943208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d9889-91a9-46bc-b778-d0d19d3f4038 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:23.996758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:24.048601 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d9889-91a9-46bc-b778-d0d19d3f4038 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:24.081898 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a1a08-189a-41e3-81f1-074630c5baa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:24.082719 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a1a08-189a-41e3-81f1-074630c5baa9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:24.083002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a1a08-189a-41e3-81f1-074630c5baa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:24.083276 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a1a08-189a-41e3-81f1-074630c5baa9 None admin] PATH_INFO: `/v3/domains/199d5d5f526448aeacd48279821c8b05` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:24.094405 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a1a08-189a-41e3-81f1-074630c5baa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=199d5d5f526448aeacd48279821c8b05)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:24.095946 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a1a08-189a-41e3-81f1-074630c5baa9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:24.097593 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 588/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Thu Jun 16 16:05:23 2022] GET /identity/v3/domains/199d5d5f526448aeacd48279821c8b05 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:24.103508 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc05b4a-bc1c-4308-b6ed-83cbf4bc5df3 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:24.118003 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:24.203577 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc05b4a-bc1c-4308-b6ed-83cbf4bc5df3 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:24.237540 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977506c-f662-4157-813d-249e941702cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:24.238200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977506c-f662-4157-813d-249e941702cd None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:24.238515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977506c-f662-4157-813d-249e941702cd None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:24.238800 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977506c-f662-4157-813d-249e941702cd None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:24.239512 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977506c-f662-4157-813d-249e941702cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:24.240948 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977506c-f662-4157-813d-249e941702cd None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:24.267489 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 585/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 16 16:05:24 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:05:26.506795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc9a51-61ca-402b-b263-87648b1654a3 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:26.507343 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc9a51-61ca-402b-b263-87648b1654a3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:26.507343 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc9a51-61ca-402b-b263-87648b1654a3 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:26.508701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 589/1174] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:05:26.514501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7806838-c35e-4a18-a3a4-d2f3bd4e20a5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:26.514938 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7806838-c35e-4a18-a3a4-d2f3bd4e20a5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:26.515118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7806838-c35e-4a18-a3a4-d2f3bd4e20a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:26.532111 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f7806838-c35e-4a18-a3a4-d2f3bd4e20a5 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:05:26.533307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f7806838-c35e-4a18-a3a4-d2f3bd4e20a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:05:26.593903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:26.603470 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 586/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:05:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:05:26.629174 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc9a51-61ca-402b-b263-87648b1654a3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:26.730041 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc9a51-61ca-402b-b263-87648b1654a3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:26.738577 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:26.762877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e7048-961e-4e5e-bea1-db92c9a64562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:26.763736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e7048-961e-4e5e-bea1-db92c9a64562 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:26.764017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e7048-961e-4e5e-bea1-db92c9a64562 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:26.764292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e7048-961e-4e5e-bea1-db92c9a64562 None admin] PATH_INFO: `/v3/domains/199d5d5f526448aeacd48279821c8b05` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:26.765447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e7048-961e-4e5e-bea1-db92c9a64562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=199d5d5f526448aeacd48279821c8b05)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:26.766919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e7048-961e-4e5e-bea1-db92c9a64562 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:26.768506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 590/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Thu Jun 16 16:05:26 2022] GET /identity/v3/domains/199d5d5f526448aeacd48279821c8b05 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:26.774194 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7806838-c35e-4a18-a3a4-d2f3bd4e20a5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:26.870930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7806838-c35e-4a18-a3a4-d2f3bd4e20a5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:26.903975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62942c4b-008c-4248-8c1e-c5f2f4856a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:26.904567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62942c4b-008c-4248-8c1e-c5f2f4856a88 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:26.904848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62942c4b-008c-4248-8c1e-c5f2f4856a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:26.905124 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62942c4b-008c-4248-8c1e-c5f2f4856a88 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:26.905830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62942c4b-008c-4248-8c1e-c5f2f4856a88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:26.907276 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62942c4b-008c-4248-8c1e-c5f2f4856a88 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:26.926621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 587/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:05:26 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:05:29.080286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0440c-c755-4142-86c2-35d66d5635ca None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:29.080817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0440c-c755-4142-86c2-35d66d5635ca None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:29.080817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0440c-c755-4142-86c2-35d66d5635ca None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:29.082213 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 591/1178] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:05:29.087366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c08bd-5fd4-46c8-a5c7-3208933b5ecf None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:29.087786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c08bd-5fd4-46c8-a5c7-3208933b5ecf None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:29.087934 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c08bd-5fd4-46c8-a5c7-3208933b5ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:29.105752 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a21c08bd-5fd4-46c8-a5c7-3208933b5ecf None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:05:29.106971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a21c08bd-5fd4-46c8-a5c7-3208933b5ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:05:29.152937 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:29.175137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 588/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:05:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:05:29.198710 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0440c-c755-4142-86c2-35d66d5635ca None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:29.306768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0440c-c755-4142-86c2-35d66d5635ca None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:29.341312 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a038cc-57f8-42d1-9ea5-f20d79ed4d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:29.342025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a038cc-57f8-42d1-9ea5-f20d79ed4d5d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:29.342310 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a038cc-57f8-42d1-9ea5-f20d79ed4d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:29.342686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a038cc-57f8-42d1-9ea5-f20d79ed4d5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:29.353201 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a038cc-57f8-42d1-9ea5-f20d79ed4d5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-76a038cc-57f8-42d1-9ea5-f20d79ed4d5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:05:29.360926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:05:29.362082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:05:29.363158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:05:29.363158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:05:29.363158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:05:29.363158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:05:29.363158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:05:29.363158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:05:29.363158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:05:29.363158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:05:29.363158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:05:29.363158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:05:29.363158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:05:29.363158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:05:29.363158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 592/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:05:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:05:29.368325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c08bd-5fd4-46c8-a5c7-3208933b5ecf None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:29.466329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c08bd-5fd4-46c8-a5c7-3208933b5ecf None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:29.501091 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c3c22-3300-4a0f-a0b7-e5de9c0f90eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:29.501758 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c3c22-3300-4a0f-a0b7-e5de9c0f90eb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:29.502043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c3c22-3300-4a0f-a0b7-e5de9c0f90eb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:29.502322 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c3c22-3300-4a0f-a0b7-e5de9c0f90eb None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:29.503171 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c3c22-3300-4a0f-a0b7-e5de9c0f90eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:05:29.503481 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c3c22-3300-4a0f-a0b7-e5de9c0f90eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:29.504849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c3c22-3300-4a0f-a0b7-e5de9c0f90eb None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:29.513776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 589/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:05:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:29.520098 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a038cc-57f8-42d1-9ea5-f20d79ed4d5d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:29.555121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:29.626963 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a038cc-57f8-42d1-9ea5-f20d79ed4d5d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:29.664939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a57f8-3d8c-4c18-a984-99161a8ca369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:29.665791 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a57f8-3d8c-4c18-a984-99161a8ca369 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:29.666073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a57f8-3d8c-4c18-a984-99161a8ca369 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:29.666345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a57f8-3d8c-4c18-a984-99161a8ca369 None admin] PATH_INFO: `/v3/users/665d3e6469864ed687d5ab9ddbf2834a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:29.680203 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a57f8-3d8c-4c18-a984-99161a8ca369 None admin] RBAC: Authorizing `identity:get_user(user_id=665d3e6469864ed687d5ab9ddbf2834a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:29.681650 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a57f8-3d8c-4c18-a984-99161a8ca369 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:29.684097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 593/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:05:29 2022] GET /identity/v3/users/665d3e6469864ed687d5ab9ddbf2834a => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:29.689883 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c3c22-3300-4a0f-a0b7-e5de9c0f90eb None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:29.735933 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:29.793896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c3c22-3300-4a0f-a0b7-e5de9c0f90eb None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:29.828755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8027e64-4b95-4c5a-9dda-05a011d84bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:29.829405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8027e64-4b95-4c5a-9dda-05a011d84bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:29.829695 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8027e64-4b95-4c5a-9dda-05a011d84bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:29.829977 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8027e64-4b95-4c5a-9dda-05a011d84bf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:29.897508 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8027e64-4b95-4c5a-9dda-05a011d84bf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:29.898907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8027e64-4b95-4c5a-9dda-05a011d84bf6 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:29.940633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:30.000119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 590/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:05:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:30.005990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a57f8-3d8c-4c18-a984-99161a8ca369 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:30.098282 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:30.105394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a57f8-3d8c-4c18-a984-99161a8ca369 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:30.138876 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3720d1-d73b-44dd-937c-27d7a396a17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:30.139723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3720d1-d73b-44dd-937c-27d7a396a17e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:30.140006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3720d1-d73b-44dd-937c-27d7a396a17e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:30.140283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3720d1-d73b-44dd-937c-27d7a396a17e None admin] PATH_INFO: `/v3/projects/94b2a2baa4dd42c88c610110d7f952cd` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:30.141446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3720d1-d73b-44dd-937c-27d7a396a17e None admin] RBAC: Authorizing `identity:get_project(project_id=94b2a2baa4dd42c88c610110d7f952cd)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:30.142902 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3720d1-d73b-44dd-937c-27d7a396a17e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:30.144574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 594/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:05:30 2022] GET /identity/v3/projects/94b2a2baa4dd42c88c610110d7f952cd => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:30.150953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8027e64-4b95-4c5a-9dda-05a011d84bf6 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:30.248611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8027e64-4b95-4c5a-9dda-05a011d84bf6 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:30.281376 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3de860-0289-40a4-9805-14fc41170778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:30.282029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3de860-0289-40a4-9805-14fc41170778 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:30.282310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3de860-0289-40a4-9805-14fc41170778 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:30.282621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3de860-0289-40a4-9805-14fc41170778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:30.283441 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3de860-0289-40a4-9805-14fc41170778 None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=94b2a2baa4dd42c88c610110d7f952cd, user.id=665d3e6469864ed687d5ab9ddbf2834a) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:05:30.283751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3de860-0289-40a4-9805-14fc41170778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:30.285165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3de860-0289-40a4-9805-14fc41170778 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:30.290470 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 591/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:05:30 2022] GET /identity/v3/role_assignments?user.id=665d3e6469864ed687d5ab9ddbf2834a&scope.project.id=94b2a2baa4dd42c88c610110d7f952cd&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:32.449849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33301187-417c-44ab-946e-2ce3bacc546a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:32.450372 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33301187-417c-44ab-946e-2ce3bacc546a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:32.450372 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33301187-417c-44ab-946e-2ce3bacc546a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:32.451784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 595/1186] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:05:32.456939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97605014-e110-4da9-b915-88bc877221a0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:32.457334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97605014-e110-4da9-b915-88bc877221a0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:32.457496 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97605014-e110-4da9-b915-88bc877221a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:32.468610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:32.474724 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-97605014-e110-4da9-b915-88bc877221a0 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:05:32.475899 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-97605014-e110-4da9-b915-88bc877221a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:05:32.541313 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 592/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:05:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:05:32.564203 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33301187-417c-44ab-946e-2ce3bacc546a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:32.663241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33301187-417c-44ab-946e-2ce3bacc546a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:32.696682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a75811-dda6-4b46-89a3-8b7be95c9843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:32.697460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a75811-dda6-4b46-89a3-8b7be95c9843 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:32.697741 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a75811-dda6-4b46-89a3-8b7be95c9843 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:32.698156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a75811-dda6-4b46-89a3-8b7be95c9843 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:32.708061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a75811-dda6-4b46-89a3-8b7be95c9843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-21a75811-dda6-4b46-89a3-8b7be95c9843 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:05:32.715677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:05:32.716844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:05:32.717728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:05:32.717728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:05:32.717728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:05:32.717728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:05:32.717728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:05:32.717728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:05:32.717728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:05:32.717728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:05:32.717728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:05:32.717728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:05:32.717728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:05:32.717728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:05:32.717728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 596/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:05:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:05:32.723174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97605014-e110-4da9-b915-88bc877221a0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:32.819943 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97605014-e110-4da9-b915-88bc877221a0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:32.852711 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857e02b-61ca-480d-bc48-55ee2df70943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:32.853519 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857e02b-61ca-480d-bc48-55ee2df70943 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:32.853655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857e02b-61ca-480d-bc48-55ee2df70943 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:32.853925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857e02b-61ca-480d-bc48-55ee2df70943 None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:32.855391 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857e02b-61ca-480d-bc48-55ee2df70943 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:05:32.855705 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857e02b-61ca-480d-bc48-55ee2df70943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:32.857077 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857e02b-61ca-480d-bc48-55ee2df70943 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:32.859270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:32.866363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 593/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:05:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:32.872363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a75811-dda6-4b46-89a3-8b7be95c9843 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:32.896439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:32.971622 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a75811-dda6-4b46-89a3-8b7be95c9843 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:33.004268 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ef637-ce74-4eb6-9b6c-170061400700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:33.005139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ef637-ce74-4eb6-9b6c-170061400700 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:33.005418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ef637-ce74-4eb6-9b6c-170061400700 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:33.005689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ef637-ce74-4eb6-9b6c-170061400700 None admin] PATH_INFO: `/v3/users/665d3e6469864ed687d5ab9ddbf2834a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:33.006888 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ef637-ce74-4eb6-9b6c-170061400700 None admin] RBAC: Authorizing `identity:get_user(user_id=665d3e6469864ed687d5ab9ddbf2834a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:33.008319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ef637-ce74-4eb6-9b6c-170061400700 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:33.009932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 597/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:05:32 2022] GET /identity/v3/users/665d3e6469864ed687d5ab9ddbf2834a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:33.015936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857e02b-61ca-480d-bc48-55ee2df70943 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:33.116615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857e02b-61ca-480d-bc48-55ee2df70943 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:33.150585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c126e-3dca-4509-b553-3573833bce39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:33.151466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c126e-3dca-4509-b553-3573833bce39 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:33.151836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c126e-3dca-4509-b553-3573833bce39 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:33.152113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c126e-3dca-4509-b553-3573833bce39 None admin] PATH_INFO: `/v3/projects/94b2a2baa4dd42c88c610110d7f952cd` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:33.153297 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c126e-3dca-4509-b553-3573833bce39 None admin] RBAC: Authorizing `identity:get_project(project_id=94b2a2baa4dd42c88c610110d7f952cd)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:33.154760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c126e-3dca-4509-b553-3573833bce39 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:33.156455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 594/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:05:33 2022] GET /identity/v3/projects/94b2a2baa4dd42c88c610110d7f952cd => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:33.162378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ef637-ce74-4eb6-9b6c-170061400700 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:33.252314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:33.262138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ef637-ce74-4eb6-9b6c-170061400700 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:33.295399 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37790ae1-4737-41aa-9794-6a99dbd3e2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:33.296273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37790ae1-4737-41aa-9794-6a99dbd3e2be None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:33.296558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37790ae1-4737-41aa-9794-6a99dbd3e2be None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:33.296835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37790ae1-4737-41aa-9794-6a99dbd3e2be None admin] PATH_INFO: `/v3/projects/94b2a2baa4dd42c88c610110d7f952cd/users/665d3e6469864ed687d5ab9ddbf2834a/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:33.298782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37790ae1-4737-41aa-9794-6a99dbd3e2be None admin] RBAC: Authorizing `identity:create_grant(project_id=94b2a2baa4dd42c88c610110d7f952cd, user_id=665d3e6469864ed687d5ab9ddbf2834a, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:33.300215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37790ae1-4737-41aa-9794-6a99dbd3e2be None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:33.313155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 598/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:05:33 2022] PUT /identity/v3/projects/94b2a2baa4dd42c88c610110d7f952cd/users/665d3e6469864ed687d5ab9ddbf2834a/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:05:35.412438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd69956-859e-4e7c-9a4d-68f450c397e0 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:35.412953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd69956-859e-4e7c-9a4d-68f450c397e0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:35.413066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd69956-859e-4e7c-9a4d-68f450c397e0 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:35.414378 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 595/1193] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:05:35.420154 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a64881-0d50-416c-9264-433d1d4c6774 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:35.420548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a64881-0d50-416c-9264-433d1d4c6774 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:35.420708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a64881-0d50-416c-9264-433d1d4c6774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:35.441772 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a5a64881-0d50-416c-9264-433d1d4c6774 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:05:35.442985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a5a64881-0d50-416c-9264-433d1d4c6774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:05:35.522966 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 599/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:05:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:05:35.546779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd69956-859e-4e7c-9a4d-68f450c397e0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:35.613197 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:35.650591 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd69956-859e-4e7c-9a4d-68f450c397e0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:35.684106 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da393f5b-f1e6-459f-b24a-daba968050bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:35.684893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da393f5b-f1e6-459f-b24a-daba968050bb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:35.685175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da393f5b-f1e6-459f-b24a-daba968050bb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:35.685447 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da393f5b-f1e6-459f-b24a-daba968050bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:35.695892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da393f5b-f1e6-459f-b24a-daba968050bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-da393f5b-f1e6-459f-b24a-daba968050bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:05:35.703694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:05:35.704788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:05:35.705843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:05:35.705843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:05:35.705843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:05:35.705843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:05:35.705843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:05:35.705843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:05:35.705843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:05:35.705843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:05:35.705843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:05:35.705843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:05:35.705843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:05:35.705843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:05:35.705843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 596/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:05:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:05:35.710960 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a64881-0d50-416c-9264-433d1d4c6774 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:35.793808 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:35.814960 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a64881-0d50-416c-9264-433d1d4c6774 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:35.849833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e9fbc-60a0-470a-9e57-e5d4f9687923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:35.850533 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e9fbc-60a0-470a-9e57-e5d4f9687923 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:35.850818 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e9fbc-60a0-470a-9e57-e5d4f9687923 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:35.851097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e9fbc-60a0-470a-9e57-e5d4f9687923 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:35.851839 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e9fbc-60a0-470a-9e57-e5d4f9687923 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:05:35.852149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e9fbc-60a0-470a-9e57-e5d4f9687923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:35.853509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e9fbc-60a0-470a-9e57-e5d4f9687923 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:35.862492 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 600/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:05:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:35.868338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da393f5b-f1e6-459f-b24a-daba968050bb None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:35.967092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da393f5b-f1e6-459f-b24a-daba968050bb None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:35.991945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:36.000945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb178d-9209-4864-a4e1-198cda001d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:36.001812 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb178d-9209-4864-a4e1-198cda001d9c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:36.002090 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb178d-9209-4864-a4e1-198cda001d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:36.002364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb178d-9209-4864-a4e1-198cda001d9c None admin] PATH_INFO: `/v3/users/665d3e6469864ed687d5ab9ddbf2834a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:36.003559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb178d-9209-4864-a4e1-198cda001d9c None admin] RBAC: Authorizing `identity:get_user(user_id=665d3e6469864ed687d5ab9ddbf2834a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:36.004979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb178d-9209-4864-a4e1-198cda001d9c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:36.006610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 597/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 16 16:05:35 2022] GET /identity/v3/users/665d3e6469864ed687d5ab9ddbf2834a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:36.012862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e9fbc-60a0-470a-9e57-e5d4f9687923 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:36.111241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e9fbc-60a0-470a-9e57-e5d4f9687923 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:36.143133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fefe85-0d1b-42e4-b1b9-e4da72be7c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:36.143768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fefe85-0d1b-42e4-b1b9-e4da72be7c52 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:36.144047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fefe85-0d1b-42e4-b1b9-e4da72be7c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:36.144321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fefe85-0d1b-42e4-b1b9-e4da72be7c52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:36.156321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:36.210829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fefe85-0d1b-42e4-b1b9-e4da72be7c52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:36.212284 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fefe85-0d1b-42e4-b1b9-e4da72be7c52 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:36.307356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 601/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:05:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:05:36.313231 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb178d-9209-4864-a4e1-198cda001d9c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:36.412193 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb178d-9209-4864-a4e1-198cda001d9c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:36.444837 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9888e6-0e67-4b4c-8dac-1f8b8b2a5f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:36.445692 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9888e6-0e67-4b4c-8dac-1f8b8b2a5f10 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:36.445973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9888e6-0e67-4b4c-8dac-1f8b8b2a5f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:36.446244 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9888e6-0e67-4b4c-8dac-1f8b8b2a5f10 None admin] PATH_INFO: `/v3/projects/94b2a2baa4dd42c88c610110d7f952cd` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:36.447450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9888e6-0e67-4b4c-8dac-1f8b8b2a5f10 None admin] RBAC: Authorizing `identity:get_project(project_id=94b2a2baa4dd42c88c610110d7f952cd)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:36.449759 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9888e6-0e67-4b4c-8dac-1f8b8b2a5f10 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:36.451468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 598/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 16 16:05:36 2022] GET /identity/v3/projects/94b2a2baa4dd42c88c610110d7f952cd => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:36.457661 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fefe85-0d1b-42e4-b1b9-e4da72be7c52 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:05:36.499069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:36.554344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fefe85-0d1b-42e4-b1b9-e4da72be7c52 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:05:36.588226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef7cf4-a640-4f97-8bd6-04598651c116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:05:36.588910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef7cf4-a640-4f97-8bd6-04598651c116 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:05:36.589194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef7cf4-a640-4f97-8bd6-04598651c116 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:05:36.589464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef7cf4-a640-4f97-8bd6-04598651c116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:05:36.590278 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef7cf4-a640-4f97-8bd6-04598651c116 None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=94b2a2baa4dd42c88c610110d7f952cd, user.id=665d3e6469864ed687d5ab9ddbf2834a) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:05:36.590746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef7cf4-a640-4f97-8bd6-04598651c116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:05:36.592190 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef7cf4-a640-4f97-8bd6-04598651c116 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:05:36.597854 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 602/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:05:36 2022] GET /identity/v3/role_assignments?user.id=665d3e6469864ed687d5ab9ddbf2834a&scope.project.id=94b2a2baa4dd42c88c610110d7f952cd&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:05:46.440523 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=69 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:05:46.595356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=47 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:33.792601 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807e79a-d40b-4e8b-80c5-d5d21e2e4da5 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:33.793289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807e79a-d40b-4e8b-80c5-d5d21e2e4da5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:33.793289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807e79a-d40b-4e8b-80c5-d5d21e2e4da5 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:33.794954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 599/1201] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:06:33.803153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35ad7-eca6-43b3-a3f6-c3829b292169 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:33.803785 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35ad7-eca6-43b3-a3f6-c3829b292169 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:33.803875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d35ad7-eca6-43b3-a3f6-c3829b292169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:33.824689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-03d35ad7-eca6-43b3-a3f6-c3829b292169 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:06:33.825902 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-03d35ad7-eca6-43b3-a3f6-c3829b292169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:06:33.928060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 603/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:06:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:06:33.957323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807e79a-d40b-4e8b-80c5-d5d21e2e4da5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:34.106103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807e79a-d40b-4e8b-80c5-d5d21e2e4da5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:34.154995 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f5c30-6a60-4bfd-a413-29da0416b729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:34.155889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f5c30-6a60-4bfd-a413-29da0416b729 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:34.156257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f5c30-6a60-4bfd-a413-29da0416b729 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:34.156437 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f5c30-6a60-4bfd-a413-29da0416b729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:34.169170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f5c30-6a60-4bfd-a413-29da0416b729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:34.170797 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f5c30-6a60-4bfd-a413-29da0416b729 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:34.192312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-606f5c30-6a60-4bfd-a413-29da0416b729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:34.192312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:34.192312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:34.192312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:34.192312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:34.192312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:34.192312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:34.192312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:34.192312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:34.192312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:34.192312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:34.192312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:34.192312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:06:34.192312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:06:34.192312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:34.194109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:34.196180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:06:34.196180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:06:34.196180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:34.196180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:06:34.200792 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 600/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:34.201043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d35ad7-eca6-43b3-a3f6-c3829b292169 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:34.386211 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d35ad7-eca6-43b3-a3f6-c3829b292169 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:34.423142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:34.434615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37efa10-4fc4-4e23-a940-0dee48f42492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:34.435405 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37efa10-4fc4-4e23-a940-0dee48f42492 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:34.435685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37efa10-4fc4-4e23-a940-0dee48f42492 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:34.435977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37efa10-4fc4-4e23-a940-0dee48f42492 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:34.436707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37efa10-4fc4-4e23-a940-0dee48f42492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:34.437046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37efa10-4fc4-4e23-a940-0dee48f42492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:34.438386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37efa10-4fc4-4e23-a940-0dee48f42492 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:34.452792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 604/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:34.458777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f5c30-6a60-4bfd-a413-29da0416b729 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:34.531270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:34.598552 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f5c30-6a60-4bfd-a413-29da0416b729 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:34.647036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f3ee2-e20c-482e-91e5-f6506f3f9b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:34.647715 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f3ee2-e20c-482e-91e5-f6506f3f9b43 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:34.648763 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f3ee2-e20c-482e-91e5-f6506f3f9b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:34.649348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f3ee2-e20c-482e-91e5-f6506f3f9b43 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:34.650392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f3ee2-e20c-482e-91e5-f6506f3f9b43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:34.651889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f3ee2-e20c-482e-91e5-f6506f3f9b43 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:34.681139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 601/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 16 16:06:34 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:06:37.079588 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1aea5-bf49-4f65-8c48-37a7827c8d63 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:37.080161 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1aea5-bf49-4f65-8c48-37a7827c8d63 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:37.080161 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1aea5-bf49-4f65-8c48-37a7827c8d63 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:37.081676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 605/1206] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:06:37.087088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54efbaa-4127-43d2-90ec-071fda75bbb2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:37.087734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54efbaa-4127-43d2-90ec-071fda75bbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:37.087734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54efbaa-4127-43d2-90ec-071fda75bbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:37.106184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f54efbaa-4127-43d2-90ec-071fda75bbb2 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:06:37.107409 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f54efbaa-4127-43d2-90ec-071fda75bbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:06:37.193482 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 602/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:06:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:06:37.217804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1aea5-bf49-4f65-8c48-37a7827c8d63 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:37.344864 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1aea5-bf49-4f65-8c48-37a7827c8d63 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:37.392350 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c924b-6d8c-4a4f-a99a-94527b1fb06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:37.393187 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c924b-6d8c-4a4f-a99a-94527b1fb06d None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:37.393508 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c924b-6d8c-4a4f-a99a-94527b1fb06d None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:37.393761 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c924b-6d8c-4a4f-a99a-94527b1fb06d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:37.405663 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c924b-6d8c-4a4f-a99a-94527b1fb06d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-c07c924b-6d8c-4a4f-a99a-94527b1fb06d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:06:37.413333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:37.415065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:37.415915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:37.415915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:37.415915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:37.415915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:37.415915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:06:37.415915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:06:37.415915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:06:37.415915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:06:37.415915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:06:37.415915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:06:37.415915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:06:37.415915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:06:37.415915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 606/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:06:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:37.421947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54efbaa-4127-43d2-90ec-071fda75bbb2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:37.466625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:37.543144 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54efbaa-4127-43d2-90ec-071fda75bbb2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:37.592809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af40a8d-6cab-4f23-98ba-e75d100a0dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:37.593590 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af40a8d-6cab-4f23-98ba-e75d100a0dda None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:37.593864 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af40a8d-6cab-4f23-98ba-e75d100a0dda None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:37.594169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af40a8d-6cab-4f23-98ba-e75d100a0dda None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:37.594996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af40a8d-6cab-4f23-98ba-e75d100a0dda None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:37.595252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af40a8d-6cab-4f23-98ba-e75d100a0dda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:37.596710 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af40a8d-6cab-4f23-98ba-e75d100a0dda None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:37.605433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 603/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:06:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:37.611359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c924b-6d8c-4a4f-a99a-94527b1fb06d None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:37.674747 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:37.743377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c924b-6d8c-4a4f-a99a-94527b1fb06d None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:37.785691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1e06c-e2ac-48b4-8288-e607d5eed446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:37.786604 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1e06c-e2ac-48b4-8288-e607d5eed446 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:37.786862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1e06c-e2ac-48b4-8288-e607d5eed446 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:37.787640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1e06c-e2ac-48b4-8288-e607d5eed446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:37.802296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1e06c-e2ac-48b4-8288-e607d5eed446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:37.804156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1e06c-e2ac-48b4-8288-e607d5eed446 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:37.827564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0ff1e06c-e2ac-48b4-8288-e607d5eed446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:37.827564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:37.827564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:37.827564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:37.827564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:37.827564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:37.827564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:37.827564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:37.827564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:37.827564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:37.827564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:37.827564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:37.827564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:06:37.827564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:06:37.827564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:37.828566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:37.829480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:06:37.829480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:06:37.829480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:37.829480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:06:37.829480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 607/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:37.836128 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af40a8d-6cab-4f23-98ba-e75d100a0dda None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:37.970272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:37.975920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af40a8d-6cab-4f23-98ba-e75d100a0dda None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:38.026675 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296f276-9cc8-48e9-9c9f-7ee71ea2dfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:38.027381 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296f276-9cc8-48e9-9c9f-7ee71ea2dfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:38.027658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296f276-9cc8-48e9-9c9f-7ee71ea2dfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:38.027983 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296f276-9cc8-48e9-9c9f-7ee71ea2dfd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:38.028677 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296f276-9cc8-48e9-9c9f-7ee71ea2dfd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:38.029019 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296f276-9cc8-48e9-9c9f-7ee71ea2dfd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:38.030382 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296f276-9cc8-48e9-9c9f-7ee71ea2dfd9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:38.048130 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 604/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:38.055113 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1e06c-e2ac-48b4-8288-e607d5eed446 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:38.198167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1e06c-e2ac-48b4-8288-e607d5eed446 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:38.200249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:38.242286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff316468-e1dd-41c4-b169-395982d53c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:38.243337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff316468-e1dd-41c4-b169-395982d53c08 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:38.243627 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff316468-e1dd-41c4-b169-395982d53c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:38.243942 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff316468-e1dd-41c4-b169-395982d53c08 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:38.252014 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff316468-e1dd-41c4-b169-395982d53c08 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:38.253616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff316468-e1dd-41c4-b169-395982d53c08 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ff316468-e1dd-41c4-b169-395982d53c08 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:06:38.270618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:38.271869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:38.273083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:38.273083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:38.273083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:06:38.273083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:06:38.273083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:06:38.273083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:06:38.273083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:06:38.273083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:06:38.273083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 16:06:38.273083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:06:38.279435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 608/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:38.280828 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296f276-9cc8-48e9-9c9f-7ee71ea2dfd9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:38.404053 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296f276-9cc8-48e9-9c9f-7ee71ea2dfd9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:38.442780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8faee2-5277-437c-a37a-6a4d9664b731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:38.443722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8faee2-5277-437c-a37a-6a4d9664b731 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:38.444230 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8faee2-5277-437c-a37a-6a4d9664b731 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:38.444585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8faee2-5277-437c-a37a-6a4d9664b731 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:38.446511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8faee2-5277-437c-a37a-6a4d9664b731 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:38.446833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8faee2-5277-437c-a37a-6a4d9664b731 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:38.448292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8faee2-5277-437c-a37a-6a4d9664b731 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:38.468744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 605/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jun 16 16:06:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:38.477506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff316468-e1dd-41c4-b169-395982d53c08 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:38.609494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff316468-e1dd-41c4-b169-395982d53c08 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:38.646457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dab7e-18fd-4dd8-83c3-f19a73be2c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:38.647120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dab7e-18fd-4dd8-83c3-f19a73be2c4f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:38.647402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dab7e-18fd-4dd8-83c3-f19a73be2c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:38.647676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dab7e-18fd-4dd8-83c3-f19a73be2c4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:38.686023 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:38.731059 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dab7e-18fd-4dd8-83c3-f19a73be2c4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:38.733508 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dab7e-18fd-4dd8-83c3-f19a73be2c4f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:38.839626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 609/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:06:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:06:38.845011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8faee2-5277-437c-a37a-6a4d9664b731 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:38.865035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:38.956645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8faee2-5277-437c-a37a-6a4d9664b731 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:38.994981 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c48b34-0748-4026-b130-18600a799239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:38.995981 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c48b34-0748-4026-b130-18600a799239 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:38.996358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c48b34-0748-4026-b130-18600a799239 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:38.996726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c48b34-0748-4026-b130-18600a799239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:39.007612 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c48b34-0748-4026-b130-18600a799239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:39.009850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c48b34-0748-4026-b130-18600a799239 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:39.028346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-b5c48b34-0748-4026-b130-18600a799239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:39.028346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:39.028346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:39.028346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:39.028346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:39.028346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:39.028346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:39.028346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:39.028346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:39.028346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:39.028346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:39.028346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:39.028346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:06:39.028346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:06:39.028346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:39.029466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:39.030668 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:06:39.030668 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:06:39.030668 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:39.030668 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:06:39.031873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 606/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:39.037551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dab7e-18fd-4dd8-83c3-f19a73be2c4f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:39.108047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:39.153202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dab7e-18fd-4dd8-83c3-f19a73be2c4f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:39.195613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54525c78-c3c8-4839-87e3-8a8cb58ec66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:39.196543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54525c78-c3c8-4839-87e3-8a8cb58ec66e None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:39.196928 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54525c78-c3c8-4839-87e3-8a8cb58ec66e None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:39.197415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54525c78-c3c8-4839-87e3-8a8cb58ec66e None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:39.198540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54525c78-c3c8-4839-87e3-8a8cb58ec66e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:39.199076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54525c78-c3c8-4839-87e3-8a8cb58ec66e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:39.200789 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54525c78-c3c8-4839-87e3-8a8cb58ec66e None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:39.221169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 610/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:39.222503 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c48b34-0748-4026-b130-18600a799239 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:39.311045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:39.364922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c48b34-0748-4026-b130-18600a799239 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:39.414280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251f78c-6382-4782-b98d-155dd55b9aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:39.415058 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251f78c-6382-4782-b98d-155dd55b9aaf None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:39.415353 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251f78c-6382-4782-b98d-155dd55b9aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:39.415646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251f78c-6382-4782-b98d-155dd55b9aaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:39.422761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251f78c-6382-4782-b98d-155dd55b9aaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:39.424201 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251f78c-6382-4782-b98d-155dd55b9aaf None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:39.438877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-c251f78c-6382-4782-b98d-155dd55b9aaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:06:39.438877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:39.438877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:39.438877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:39.438877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:39.438877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:39.438877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:39.438877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:39.438877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:39.438877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:39.438877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:39.438877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:39.438877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:06:39.438877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:06:39.438877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:39.439974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:39.441031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:06:39.441031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:06:39.441031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:06:39.441031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:06:39.441031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:06:39.441031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:06:39.441031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:06:39.441031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:06:39.441031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 607/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:06:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:39.446259 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54525c78-c3c8-4839-87e3-8a8cb58ec66e None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:39.578507 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54525c78-c3c8-4839-87e3-8a8cb58ec66e None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:39.608072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:39.622385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac743249-789b-45b1-941e-9929a458ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:39.623121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac743249-789b-45b1-941e-9929a458ea12 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:39.623406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac743249-789b-45b1-941e-9929a458ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:39.623685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac743249-789b-45b1-941e-9929a458ea12 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:39.624480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac743249-789b-45b1-941e-9929a458ea12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:39.624796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac743249-789b-45b1-941e-9929a458ea12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:39.626249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac743249-789b-45b1-941e-9929a458ea12 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:39.641811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 611/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:06:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:39.646878 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251f78c-6382-4782-b98d-155dd55b9aaf None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:39.782673 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251f78c-6382-4782-b98d-155dd55b9aaf None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:39.818872 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:39.828192 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6677c-bc5e-4f57-bcc4-85e632807494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:39.829270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6677c-bc5e-4f57-bcc4-85e632807494 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:39.829777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6677c-bc5e-4f57-bcc4-85e632807494 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:39.830510 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6677c-bc5e-4f57-bcc4-85e632807494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:39.831919 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6677c-bc5e-4f57-bcc4-85e632807494 None admin] RBAC: Adding query filter params (role.id=6da95c91bacf48f9870a114e2ab05472, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=9e8222d303aa487ca2b5c5bed6124f35) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:39.832465 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6677c-bc5e-4f57-bcc4-85e632807494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:39.834228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6677c-bc5e-4f57-bcc4-85e632807494 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:39.842240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 608/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:06:39 2022] GET /identity/v3/role_assignments?user.id=9e8222d303aa487ca2b5c5bed6124f35&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=6da95c91bacf48f9870a114e2ab05472 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:42.117271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760be4c-8115-4646-a6f7-de237755197b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:42.118116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760be4c-8115-4646-a6f7-de237755197b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:42.118116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760be4c-8115-4646-a6f7-de237755197b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:42.119764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 612/1220] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:06:42.125233 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe791f5-9574-4828-ba3d-445cd63b2130 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:42.125677 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe791f5-9574-4828-ba3d-445cd63b2130 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:42.125852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe791f5-9574-4828-ba3d-445cd63b2130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:42.146150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-dbe791f5-9574-4828-ba3d-445cd63b2130 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:06:42.147594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-dbe791f5-9574-4828-ba3d-445cd63b2130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:06:42.227617 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 609/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:06:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:06:42.249952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760be4c-8115-4646-a6f7-de237755197b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:42.369842 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760be4c-8115-4646-a6f7-de237755197b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:42.407949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccee24-c3d0-4788-8f9b-1dcbae02dd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:42.408745 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccee24-c3d0-4788-8f9b-1dcbae02dd60 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:42.409026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccee24-c3d0-4788-8f9b-1dcbae02dd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:42.409296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccee24-c3d0-4788-8f9b-1dcbae02dd60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:42.419954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccee24-c3d0-4788-8f9b-1dcbae02dd60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-59ccee24-c3d0-4788-8f9b-1dcbae02dd60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:06:42.427628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:42.428584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:42.429532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:42.429532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:42.429532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:42.429532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:42.429532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:06:42.429532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:06:42.429532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:06:42.429532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:06:42.429532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:06:42.429532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:06:42.429532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:06:42.429532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:06:42.429532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 613/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:06:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:42.435205 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe791f5-9574-4828-ba3d-445cd63b2130 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:42.558576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe791f5-9574-4828-ba3d-445cd63b2130 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:42.589175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:42.601721 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcd941-9e8c-4941-b2a2-3a0799545a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:42.602527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcd941-9e8c-4941-b2a2-3a0799545a9b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:42.602932 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcd941-9e8c-4941-b2a2-3a0799545a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:42.603376 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcd941-9e8c-4941-b2a2-3a0799545a9b None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:42.604425 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcd941-9e8c-4941-b2a2-3a0799545a9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:42.604835 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcd941-9e8c-4941-b2a2-3a0799545a9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:42.606262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcd941-9e8c-4941-b2a2-3a0799545a9b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:42.621116 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 610/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:06:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:42.622565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccee24-c3d0-4788-8f9b-1dcbae02dd60 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:42.675298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:42.741943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccee24-c3d0-4788-8f9b-1dcbae02dd60 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:42.780930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c68f6-901f-4abf-bca2-94d4b1ba65ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:42.781980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c68f6-901f-4abf-bca2-94d4b1ba65ea None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:42.782337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c68f6-901f-4abf-bca2-94d4b1ba65ea None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:42.782700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c68f6-901f-4abf-bca2-94d4b1ba65ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:42.797350 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c68f6-901f-4abf-bca2-94d4b1ba65ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:42.799378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c68f6-901f-4abf-bca2-94d4b1ba65ea None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:42.820415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ba8c68f6-901f-4abf-bca2-94d4b1ba65ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:42.820415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:42.820415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:42.820415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:42.820415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:42.820415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:42.820415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:42.820415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:42.820415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:42.820415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:42.820415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:42.820415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:42.820415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:06:42.820415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:06:42.820415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:42.821948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:42.822934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:06:42.822934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:06:42.822934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:42.822934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:06:42.822934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 614/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:42.828284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcd941-9e8c-4941-b2a2-3a0799545a9b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:42.946093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcd941-9e8c-4941-b2a2-3a0799545a9b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:42.987415 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2e97c-b31b-4e27-9c29-1de96ab3c283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:42.988122 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2e97c-b31b-4e27-9c29-1de96ab3c283 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:42.988424 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2e97c-b31b-4e27-9c29-1de96ab3c283 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:42.988736 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2e97c-b31b-4e27-9c29-1de96ab3c283 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:42.989507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2e97c-b31b-4e27-9c29-1de96ab3c283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:42.989920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2e97c-b31b-4e27-9c29-1de96ab3c283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:42.991254 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2e97c-b31b-4e27-9c29-1de96ab3c283 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:43.004987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 611/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:43.011259 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c68f6-901f-4abf-bca2-94d4b1ba65ea None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:43.117592 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:43.127012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c68f6-901f-4abf-bca2-94d4b1ba65ea None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:43.169596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac493610-1267-435a-84c5-2337b1fec627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:43.170623 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493610-1267-435a-84c5-2337b1fec627 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:43.170850 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493610-1267-435a-84c5-2337b1fec627 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:43.171176 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493610-1267-435a-84c5-2337b1fec627 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:43.179777 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac493610-1267-435a-84c5-2337b1fec627 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:43.181244 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac493610-1267-435a-84c5-2337b1fec627 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-ac493610-1267-435a-84c5-2337b1fec627 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:06:43.197171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:43.198534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:43.199754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:43.199754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:43.199754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:06:43.199754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:06:43.199754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:06:43.199754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:06:43.199754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:06:43.199754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:06:43.199754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 16:06:43.199754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:06:43.199754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 615/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:43.204580 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2e97c-b31b-4e27-9c29-1de96ab3c283 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:43.259970 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:43.324080 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2e97c-b31b-4e27-9c29-1de96ab3c283 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:43.365466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b2ad2-a2f7-4a26-8dc7-76487f70e866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:43.365466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b2ad2-a2f7-4a26-8dc7-76487f70e866 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:43.365466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b2ad2-a2f7-4a26-8dc7-76487f70e866 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:43.365466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b2ad2-a2f7-4a26-8dc7-76487f70e866 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:43.365900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b2ad2-a2f7-4a26-8dc7-76487f70e866 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:43.365900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b2ad2-a2f7-4a26-8dc7-76487f70e866 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:43.367375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b2ad2-a2f7-4a26-8dc7-76487f70e866 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:43.385815 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 612/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jun 16 16:06:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:43.391919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac493610-1267-435a-84c5-2337b1fec627 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:43.517350 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac493610-1267-435a-84c5-2337b1fec627 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:43.553603 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fab102-2c0e-4a84-be11-b5a6ea822647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:43.555220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab102-2c0e-4a84-be11-b5a6ea822647 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:43.555525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab102-2c0e-4a84-be11-b5a6ea822647 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:43.555805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab102-2c0e-4a84-be11-b5a6ea822647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:43.566948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fab102-2c0e-4a84-be11-b5a6ea822647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:43.568872 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fab102-2c0e-4a84-be11-b5a6ea822647 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:43.589703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-e0fab102-2c0e-4a84-be11-b5a6ea822647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:43.589703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:43.589703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:43.589703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:43.589703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:43.589703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:43.589703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:43.589703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:43.589703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:43.589703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:43.589703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:43.589703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:43.589703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:06:43.589703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:06:43.589703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:43.590939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:43.592063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:06:43.592063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:06:43.592063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:43.592063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:06:43.592863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 616/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:43.599617 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b2ad2-a2f7-4a26-8dc7-76487f70e866 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:43.728519 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b2ad2-a2f7-4a26-8dc7-76487f70e866 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:43.731627 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:43.770200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3c3ce-c1a0-4e9e-9f31-184a616d4a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:43.770925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3c3ce-c1a0-4e9e-9f31-184a616d4a11 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:43.771228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3c3ce-c1a0-4e9e-9f31-184a616d4a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:43.771692 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3c3ce-c1a0-4e9e-9f31-184a616d4a11 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:43.772590 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3c3ce-c1a0-4e9e-9f31-184a616d4a11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:43.772967 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3c3ce-c1a0-4e9e-9f31-184a616d4a11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:43.774533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3c3ce-c1a0-4e9e-9f31-184a616d4a11 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:43.789926 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 613/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:43.796228 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fab102-2c0e-4a84-be11-b5a6ea822647 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:43.807726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:43.919080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fab102-2c0e-4a84-be11-b5a6ea822647 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:43.957721 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f25045-638f-493d-9059-f2818efea93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:43.958557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f25045-638f-493d-9059-f2818efea93f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:43.958848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f25045-638f-493d-9059-f2818efea93f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:43.959120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f25045-638f-493d-9059-f2818efea93f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:43.969312 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f25045-638f-493d-9059-f2818efea93f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:43.970939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f25045-638f-493d-9059-f2818efea93f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:43.989342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-47f25045-638f-493d-9059-f2818efea93f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:06:43.989342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:43.989342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:43.989342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:43.989342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:43.989342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:43.989342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:43.989342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:43.989342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:43.989342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:43.989342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:43.989342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:43.989342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:06:43.989342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:06:43.989342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:43.990514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:43.992241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:06:43.992241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:06:43.992241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:06:43.992241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:06:43.992241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:06:43.992241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:06:43.992241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:06:43.992241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:06:43.998390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 617/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:06:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:43.998542 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3c3ce-c1a0-4e9e-9f31-184a616d4a11 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:44.120869 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3c3ce-c1a0-4e9e-9f31-184a616d4a11 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:44.160454 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819605c-9079-4210-a9ca-5e4df8ede76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:44.161108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819605c-9079-4210-a9ca-5e4df8ede76e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:44.161392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819605c-9079-4210-a9ca-5e4df8ede76e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:44.161696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819605c-9079-4210-a9ca-5e4df8ede76e None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:44.162491 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819605c-9079-4210-a9ca-5e4df8ede76e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:44.162806 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819605c-9079-4210-a9ca-5e4df8ede76e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:44.164397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819605c-9079-4210-a9ca-5e4df8ede76e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:44.176874 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 614/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:06:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:44.184554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f25045-638f-493d-9059-f2818efea93f None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:44.262371 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:44.302406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f25045-638f-493d-9059-f2818efea93f None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:44.342488 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bce06-2367-4d5f-b248-30c515600f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:44.343571 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bce06-2367-4d5f-b248-30c515600f2c None admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:44.343935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bce06-2367-4d5f-b248-30c515600f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:44.344293 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bce06-2367-4d5f-b248-30c515600f2c None admin] PATH_INFO: `/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/9e8222d303aa487ca2b5c5bed6124f35/roles/6da95c91bacf48f9870a114e2ab05472` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:44.364179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bce06-2367-4d5f-b248-30c515600f2c None admin] RBAC: Authorizing `identity:create_grant(project_id=227cd348bea64e1f89d77ae2cf63a031, user_id=9e8222d303aa487ca2b5c5bed6124f35, role_id=6da95c91bacf48f9870a114e2ab05472)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:44.365985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bce06-2367-4d5f-b248-30c515600f2c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:44.381729 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 618/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:06:44 2022] PUT /identity/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/9e8222d303aa487ca2b5c5bed6124f35/roles/6da95c91bacf48f9870a114e2ab05472 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:06:46.656065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7abc7-fcbc-406a-a26d-9953ed66cf01 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:46.656607 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7abc7-fcbc-406a-a26d-9953ed66cf01 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:46.656698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7abc7-fcbc-406a-a26d-9953ed66cf01 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:46.658451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 615/1233] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:06:46.665727 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5528d85-fdc2-40ca-a31e-e406ced8ef12 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:46.666235 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5528d85-fdc2-40ca-a31e-e406ced8ef12 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:46.666340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5528d85-fdc2-40ca-a31e-e406ced8ef12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:46.683729 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e5528d85-fdc2-40ca-a31e-e406ced8ef12 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:06:46.685084 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e5528d85-fdc2-40ca-a31e-e406ced8ef12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:06:46.761066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 619/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:06:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:06:46.786265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7abc7-fcbc-406a-a26d-9953ed66cf01 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:46.817777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:46.963566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7abc7-fcbc-406a-a26d-9953ed66cf01 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:47.002098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0529974-77f4-4f2c-8ff2-a097957a84ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:47.003004 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0529974-77f4-4f2c-8ff2-a097957a84ef None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:47.003305 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0529974-77f4-4f2c-8ff2-a097957a84ef None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:47.003565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0529974-77f4-4f2c-8ff2-a097957a84ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:47.015818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0529974-77f4-4f2c-8ff2-a097957a84ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-b0529974-77f4-4f2c-8ff2-a097957a84ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:06:47.024766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:47.026013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:47.026978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:47.026978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:47.026978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:47.026978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:47.026978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:06:47.026978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:06:47.026978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:06:47.026978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:06:47.026978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:06:47.026978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:06:47.026978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 16:06:47.026978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:06:47.026978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 616/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 16 16:06:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:47.032002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5528d85-fdc2-40ca-a31e-e406ced8ef12 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:47.101103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:47.160193 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5528d85-fdc2-40ca-a31e-e406ced8ef12 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:47.202401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64803b2-78f7-47bd-9a79-ac6d131f2cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:47.203148 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64803b2-78f7-47bd-9a79-ac6d131f2cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:47.203429 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64803b2-78f7-47bd-9a79-ac6d131f2cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:47.203720 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64803b2-78f7-47bd-9a79-ac6d131f2cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:47.204488 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64803b2-78f7-47bd-9a79-ac6d131f2cd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:47.205059 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64803b2-78f7-47bd-9a79-ac6d131f2cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:47.206512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64803b2-78f7-47bd-9a79-ac6d131f2cd6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:47.218543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 620/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 16 16:06:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:06:47.224594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0529974-77f4-4f2c-8ff2-a097957a84ef None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:47.330017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:47.353913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0529974-77f4-4f2c-8ff2-a097957a84ef None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:47.399274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cfa8c-0feb-43e1-a348-1060ac5bc546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:47.400588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cfa8c-0feb-43e1-a348-1060ac5bc546 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:47.401072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cfa8c-0feb-43e1-a348-1060ac5bc546 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:47.401540 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cfa8c-0feb-43e1-a348-1060ac5bc546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:47.420457 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cfa8c-0feb-43e1-a348-1060ac5bc546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:47.422937 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cfa8c-0feb-43e1-a348-1060ac5bc546 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:47.453334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-ea1cfa8c-0feb-43e1-a348-1060ac5bc546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:47.453334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:47.453334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:47.453334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:47.453334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:47.453334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:47.453334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:47.453334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:47.453334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:47.453334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:47.453334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:47.453334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:47.453334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:06:47.453334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:06:47.453334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:47.454638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:47.461594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:06:47.461594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:06:47.461594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:47.461594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:06:47.461594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 617/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:06:47.462017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64803b2-78f7-47bd-9a79-ac6d131f2cd6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:47.581903 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64803b2-78f7-47bd-9a79-ac6d131f2cd6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:47.592926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:47.623104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b2f90-d54a-4f1c-addc-c6ae4a2157a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:47.623794 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b2f90-d54a-4f1c-addc-c6ae4a2157a6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:47.624076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b2f90-d54a-4f1c-addc-c6ae4a2157a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:47.624429 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b2f90-d54a-4f1c-addc-c6ae4a2157a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:47.625258 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b2f90-d54a-4f1c-addc-c6ae4a2157a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:47.625632 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b2f90-d54a-4f1c-addc-c6ae4a2157a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:47.627313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b2f90-d54a-4f1c-addc-c6ae4a2157a6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:47.640648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 621/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:47.647334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cfa8c-0feb-43e1-a348-1060ac5bc546 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:47.769089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cfa8c-0feb-43e1-a348-1060ac5bc546 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:47.811729 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26b343-d41c-457d-9768-236529bd8874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:47.812583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26b343-d41c-457d-9768-236529bd8874 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:47.812873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26b343-d41c-457d-9768-236529bd8874 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:47.813172 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26b343-d41c-457d-9768-236529bd8874 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:47.816211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:47.822896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26b343-d41c-457d-9768-236529bd8874 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:47.824559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26b343-d41c-457d-9768-236529bd8874 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-8a26b343-d41c-457d-9768-236529bd8874 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:06:47.842214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:47.843576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:47.844566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:47.844566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:47.844566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:06:47.844566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:06:47.844566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:06:47.844566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:06:47.844566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:06:47.844566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:06:47.844566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 16:06:47.844566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:06:47.844566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 618/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:06:47.849366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b2f90-d54a-4f1c-addc-c6ae4a2157a6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:47.971559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b2f90-d54a-4f1c-addc-c6ae4a2157a6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:48.013876 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da493fb9-de59-4f37-b8fa-ccc9a182c9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:48.014701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da493fb9-de59-4f37-b8fa-ccc9a182c9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:48.015069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da493fb9-de59-4f37-b8fa-ccc9a182c9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:48.015396 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da493fb9-de59-4f37-b8fa-ccc9a182c9a4 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:48.016447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da493fb9-de59-4f37-b8fa-ccc9a182c9a4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:48.016765 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da493fb9-de59-4f37-b8fa-ccc9a182c9a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:48.018203 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da493fb9-de59-4f37-b8fa-ccc9a182c9a4 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:48.037026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 622/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jun 16 16:06:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:48.044285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26b343-d41c-457d-9768-236529bd8874 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:48.166311 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26b343-d41c-457d-9768-236529bd8874 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:48.204427 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b831419-a2bc-41b0-a6de-2c2c6d81601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:48.205089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b831419-a2bc-41b0-a6de-2c2c6d81601b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:48.205433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b831419-a2bc-41b0-a6de-2c2c6d81601b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:48.205713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b831419-a2bc-41b0-a6de-2c2c6d81601b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:48.270458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:48.281337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b831419-a2bc-41b0-a6de-2c2c6d81601b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:48.282978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b831419-a2bc-41b0-a6de-2c2c6d81601b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:48.416235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 619/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:06:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:06:48.422088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da493fb9-de59-4f37-b8fa-ccc9a182c9a4 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:48.454680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:48.545476 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da493fb9-de59-4f37-b8fa-ccc9a182c9a4 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:48.588132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0cf6e-6144-4977-85dc-4ead99fb4db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:48.589309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0cf6e-6144-4977-85dc-4ead99fb4db6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:48.589594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0cf6e-6144-4977-85dc-4ead99fb4db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:48.589880 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0cf6e-6144-4977-85dc-4ead99fb4db6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:48.602488 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0cf6e-6144-4977-85dc-4ead99fb4db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:48.603979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0cf6e-6144-4977-85dc-4ead99fb4db6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:48.625137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-44f0cf6e-6144-4977-85dc-4ead99fb4db6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:48.625137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:48.625137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:48.625137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:48.625137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:48.625137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:48.625137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:48.625137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:48.625137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:48.625137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:48.625137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:48.625137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:48.625137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:06:48.625137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:06:48.625137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:48.626262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:48.627490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:06:48.627490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:06:48.627490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:48.627490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:06:48.627490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 623/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:48.634256 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b831419-a2bc-41b0-a6de-2c2c6d81601b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:48.740848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:48.750138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b831419-a2bc-41b0-a6de-2c2c6d81601b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:48.796979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcafcb-037d-4e1f-ae5b-881501eb9009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:48.797664 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcafcb-037d-4e1f-ae5b-881501eb9009 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:48.797936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcafcb-037d-4e1f-ae5b-881501eb9009 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:48.798218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcafcb-037d-4e1f-ae5b-881501eb9009 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:48.798996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcafcb-037d-4e1f-ae5b-881501eb9009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:48.799309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcafcb-037d-4e1f-ae5b-881501eb9009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:48.800686 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcafcb-037d-4e1f-ae5b-881501eb9009 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:48.813858 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 620/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:48.821304 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0cf6e-6144-4977-85dc-4ead99fb4db6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:48.915222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:48.942041 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0cf6e-6144-4977-85dc-4ead99fb4db6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:48.978038 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8942-2f54-4fbb-bd19-0164df13c5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:48.978920 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8942-2f54-4fbb-bd19-0164df13c5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:48.979175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8942-2f54-4fbb-bd19-0164df13c5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:48.979451 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8942-2f54-4fbb-bd19-0164df13c5d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:48.987578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e8942-2f54-4fbb-bd19-0164df13c5d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:48.989147 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e8942-2f54-4fbb-bd19-0164df13c5d9 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:49.004329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-6d8e8942-2f54-4fbb-bd19-0164df13c5d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:06:49.004329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:49.004329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:49.004329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:49.004329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:49.004329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:49.004329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:49.004329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:49.004329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:49.004329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:49.004329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:49.004329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:49.004329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:06:49.004329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:06:49.004329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:49.005464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:49.006456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:06:49.006456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:06:49.006456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:06:49.006456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:06:49.006456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:06:49.006456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:06:49.006456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:06:49.006456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:06:49.006456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 624/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:06:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:49.012384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcafcb-037d-4e1f-ae5b-881501eb9009 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:49.141416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcafcb-037d-4e1f-ae5b-881501eb9009 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:49.181667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585101c9-34bf-46d8-8e75-d20cdcca14d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:49.182374 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585101c9-34bf-46d8-8e75-d20cdcca14d3 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:49.182663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585101c9-34bf-46d8-8e75-d20cdcca14d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:49.183100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585101c9-34bf-46d8-8e75-d20cdcca14d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:49.183980 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585101c9-34bf-46d8-8e75-d20cdcca14d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:49.184368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585101c9-34bf-46d8-8e75-d20cdcca14d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:49.186162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585101c9-34bf-46d8-8e75-d20cdcca14d3 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:49.201671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 621/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:06:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:49.208048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8942-2f54-4fbb-bd19-0164df13c5d9 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:49.328134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8942-2f54-4fbb-bd19-0164df13c5d9 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:49.370176 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd85a0-b51c-467f-9089-b7c6c483ec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:49.370919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd85a0-b51c-467f-9089-b7c6c483ec5c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:49.371306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd85a0-b51c-467f-9089-b7c6c483ec5c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:49.371609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd85a0-b51c-467f-9089-b7c6c483ec5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:49.372549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd85a0-b51c-467f-9089-b7c6c483ec5c None admin] RBAC: Adding query filter params (role.id=6da95c91bacf48f9870a114e2ab05472, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=9e8222d303aa487ca2b5c5bed6124f35) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:49.372953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd85a0-b51c-467f-9089-b7c6c483ec5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:49.374777 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd85a0-b51c-467f-9089-b7c6c483ec5c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:49.394458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 625/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:06:49 2022] GET /identity/v3/role_assignments?user.id=9e8222d303aa487ca2b5c5bed6124f35&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=6da95c91bacf48f9870a114e2ab05472 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:51.923475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79a68d-9d97-44be-b032-d9c702e61069 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:51.924154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79a68d-9d97-44be-b032-d9c702e61069 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:51.924154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79a68d-9d97-44be-b032-d9c702e61069 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:51.925536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 622/1247] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:06:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:06:51.931799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137f5c-f7b7-4ebd-ae3f-8e577541d2e9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:51.932248 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137f5c-f7b7-4ebd-ae3f-8e577541d2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:51.932373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137f5c-f7b7-4ebd-ae3f-8e577541d2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:51.937718 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:51.952234 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-74137f5c-f7b7-4ebd-ae3f-8e577541d2e9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:06:51.953672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-74137f5c-f7b7-4ebd-ae3f-8e577541d2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:06:52.026035 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 626/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:06:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:06:52.050594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79a68d-9d97-44be-b032-d9c702e61069 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:52.075528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:52.190012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79a68d-9d97-44be-b032-d9c702e61069 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:52.232090 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af4709-7a95-47e2-b2b2-9ffaa796aefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:52.232896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af4709-7a95-47e2-b2b2-9ffaa796aefa None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:52.233182 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af4709-7a95-47e2-b2b2-9ffaa796aefa None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:52.233464 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af4709-7a95-47e2-b2b2-9ffaa796aefa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:52.245621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af4709-7a95-47e2-b2b2-9ffaa796aefa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-d0af4709-7a95-47e2-b2b2-9ffaa796aefa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:06:52.253362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:52.254526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:52.255412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:52.255412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:52.255412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:52.255412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:52.255412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:06:52.255412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:06:52.255412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:06:52.255412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:06:52.255412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:06:52.255412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:06:52.255412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:06:52.255412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:06:52.255412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 623/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:06:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:52.261387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74137f5c-f7b7-4ebd-ae3f-8e577541d2e9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:52.377260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74137f5c-f7b7-4ebd-ae3f-8e577541d2e9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:52.417758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:52.424765 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c03542-ffc4-4bbb-a8aa-f554e490e27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:52.425437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c03542-ffc4-4bbb-a8aa-f554e490e27c None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:52.425716 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c03542-ffc4-4bbb-a8aa-f554e490e27c None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:52.425996 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c03542-ffc4-4bbb-a8aa-f554e490e27c None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:52.426766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c03542-ffc4-4bbb-a8aa-f554e490e27c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:52.427214 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c03542-ffc4-4bbb-a8aa-f554e490e27c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:52.428612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c03542-ffc4-4bbb-a8aa-f554e490e27c None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:52.437334 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 627/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:06:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:52.443907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af4709-7a95-47e2-b2b2-9ffaa796aefa None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:52.530547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:52.555235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af4709-7a95-47e2-b2b2-9ffaa796aefa None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:52.592184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45701f-73e6-47ce-915f-083188224617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:52.593017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45701f-73e6-47ce-915f-083188224617 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:52.593341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45701f-73e6-47ce-915f-083188224617 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:52.593648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45701f-73e6-47ce-915f-083188224617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:52.605661 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45701f-73e6-47ce-915f-083188224617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:52.607235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45701f-73e6-47ce-915f-083188224617 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:52.626357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-de45701f-73e6-47ce-915f-083188224617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:52.626357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:52.626357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:52.626357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:52.626357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:52.626357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:52.626357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:52.626357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:52.626357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:52.626357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:52.626357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:52.626357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:52.626357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:06:52.626357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:06:52.626357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:52.627546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:52.628819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:06:52.628819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:06:52.628819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:52.628819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:06:52.628819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 624/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 16:06:52.634233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c03542-ffc4-4bbb-a8aa-f554e490e27c None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:52.748653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c03542-ffc4-4bbb-a8aa-f554e490e27c None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:52.783991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ee038-66ab-438f-be9e-f3ba2db3c0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:52.784658 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ee038-66ab-438f-be9e-f3ba2db3c0ad None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:52.784943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ee038-66ab-438f-be9e-f3ba2db3c0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:52.785218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ee038-66ab-438f-be9e-f3ba2db3c0ad None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:52.785945 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ee038-66ab-438f-be9e-f3ba2db3c0ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:52.786252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ee038-66ab-438f-be9e-f3ba2db3c0ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:52.787656 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ee038-66ab-438f-be9e-f3ba2db3c0ad None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:52.800596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 628/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:52.807075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45701f-73e6-47ce-915f-083188224617 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:52.922466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45701f-73e6-47ce-915f-083188224617 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:52.952634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:52.961733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2d760-dc08-47ce-8f80-22a0e5e844b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:52.962219 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2d760-dc08-47ce-8f80-22a0e5e844b1 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:52.962541 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2d760-dc08-47ce-8f80-22a0e5e844b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:52.962826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2d760-dc08-47ce-8f80-22a0e5e844b1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:52.971136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2d760-dc08-47ce-8f80-22a0e5e844b1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:52.972751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2d760-dc08-47ce-8f80-22a0e5e844b1 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-fea2d760-dc08-47ce-8f80-22a0e5e844b1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:06:52.988862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:52.990069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:52.991280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:52.991280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:52.991280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:06:52.991280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:06:52.991280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:06:52.991280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:06:52.991280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:06:52.991280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:06:52.991280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 16:06:52.991280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:06:52.991280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 625/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:52.996360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ee038-66ab-438f-be9e-f3ba2db3c0ad None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:53.059344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:53.117369 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ee038-66ab-438f-be9e-f3ba2db3c0ad None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:53.160445 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46df8d-5fbd-4b83-a9a3-84b2285fd665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:53.161181 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46df8d-5fbd-4b83-a9a3-84b2285fd665 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:53.161461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46df8d-5fbd-4b83-a9a3-84b2285fd665 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:53.161736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46df8d-5fbd-4b83-a9a3-84b2285fd665 None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:53.162688 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46df8d-5fbd-4b83-a9a3-84b2285fd665 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:53.163675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46df8d-5fbd-4b83-a9a3-84b2285fd665 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:53.165222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46df8d-5fbd-4b83-a9a3-84b2285fd665 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:53.184585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 629/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jun 16 16:06:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:06:53.190659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2d760-dc08-47ce-8f80-22a0e5e844b1 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:53.319968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2d760-dc08-47ce-8f80-22a0e5e844b1 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:53.363568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034af16-f685-4b09-9578-9741cf139a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:53.364225 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034af16-f685-4b09-9578-9741cf139a7b None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:53.364510 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034af16-f685-4b09-9578-9741cf139a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:53.364785 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034af16-f685-4b09-9578-9741cf139a7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:53.434098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:53.448329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034af16-f685-4b09-9578-9741cf139a7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:53.449809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034af16-f685-4b09-9578-9741cf139a7b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:53.556427 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 626/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:06:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:06:53.562344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46df8d-5fbd-4b83-a9a3-84b2285fd665 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:53.678260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46df8d-5fbd-4b83-a9a3-84b2285fd665 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:53.693968 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:53.718382 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4762e15-236b-4033-b220-40274b42eb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:53.719243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4762e15-236b-4033-b220-40274b42eb37 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:53.719522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4762e15-236b-4033-b220-40274b42eb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:53.719794 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4762e15-236b-4033-b220-40274b42eb37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:53.731651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4762e15-236b-4033-b220-40274b42eb37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:53.733126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4762e15-236b-4033-b220-40274b42eb37 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:53.752216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f4762e15-236b-4033-b220-40274b42eb37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:53.752216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:53.752216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:53.752216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:53.752216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:53.752216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:53.752216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:53.752216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:53.752216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:53.752216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:53.752216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:53.752216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:53.752216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:06:53.752216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:06:53.752216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:53.753374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:53.759410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:06:53.759410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:06:53.759410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:53.759410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:06:53.759410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 630/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:53.759767 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034af16-f685-4b09-9578-9741cf139a7b None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:53.854325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:53.867535 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034af16-f685-4b09-9578-9741cf139a7b None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:53.909355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ec0fc-8750-4e67-997c-b59b23d7fc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:53.910159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ec0fc-8750-4e67-997c-b59b23d7fc4c None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:53.910566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ec0fc-8750-4e67-997c-b59b23d7fc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:53.910852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ec0fc-8750-4e67-997c-b59b23d7fc4c None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:53.911597 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ec0fc-8750-4e67-997c-b59b23d7fc4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:53.911911 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ec0fc-8750-4e67-997c-b59b23d7fc4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:53.913902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ec0fc-8750-4e67-997c-b59b23d7fc4c None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:53.926053 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 627/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:53.932062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4762e15-236b-4033-b220-40274b42eb37 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:54.035634 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4762e15-236b-4033-b220-40274b42eb37 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:54.079722 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc0979-5d6a-4edc-80a5-638dde0b851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:54.080833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc0979-5d6a-4edc-80a5-638dde0b851b None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:54.081126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc0979-5d6a-4edc-80a5-638dde0b851b None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:54.081501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc0979-5d6a-4edc-80a5-638dde0b851b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:54.092094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc0979-5d6a-4edc-80a5-638dde0b851b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:54.094071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc0979-5d6a-4edc-80a5-638dde0b851b None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:54.109805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-0cfc0979-5d6a-4edc-80a5-638dde0b851b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:06:54.109805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:54.109805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:54.109805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:54.109805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:54.109805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:54.109805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:54.109805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:54.109805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:54.109805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:54.109805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:54.109805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:54.109805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:06:54.109805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:06:54.109805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:54.110931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:54.112047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:06:54.112047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:06:54.112047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:06:54.112047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:06:54.112047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:06:54.112047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:06:54.112047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:06:54.112047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:06:54.112047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 631/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:06:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:54.116917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ec0fc-8750-4e67-997c-b59b23d7fc4c None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:54.217583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ec0fc-8750-4e67-997c-b59b23d7fc4c None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:54.249471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b9149-b970-45d9-b7bd-d27829aadc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:54.250130 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b9149-b970-45d9-b7bd-d27829aadc9f None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:54.250414 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b9149-b970-45d9-b7bd-d27829aadc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:54.250722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b9149-b970-45d9-b7bd-d27829aadc9f None admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:54.251493 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b9149-b970-45d9-b7bd-d27829aadc9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:54.251802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b9149-b970-45d9-b7bd-d27829aadc9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:54.253210 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b9149-b970-45d9-b7bd-d27829aadc9f None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:54.265363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 628/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:06:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:54.271366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc0979-5d6a-4edc-80a5-638dde0b851b None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:54.298793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:54.375210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc0979-5d6a-4edc-80a5-638dde0b851b None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:54.408922 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac337b-0e65-4f38-a92a-7c00408540a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:54.409616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac337b-0e65-4f38-a92a-7c00408540a1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:54.409901 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac337b-0e65-4f38-a92a-7c00408540a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:54.410177 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac337b-0e65-4f38-a92a-7c00408540a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:54.411025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac337b-0e65-4f38-a92a-7c00408540a1 None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=9e8222d303aa487ca2b5c5bed6124f35) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:54.411337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac337b-0e65-4f38-a92a-7c00408540a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:54.412940 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac337b-0e65-4f38-a92a-7c00408540a1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:54.418301 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 632/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:06:54 2022] GET /identity/v3/role_assignments?user.id=9e8222d303aa487ca2b5c5bed6124f35&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:56.520027 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637232f0-fb93-40c3-ade0-f28350be872b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:56.520651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637232f0-fb93-40c3-ade0-f28350be872b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:56.520651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637232f0-fb93-40c3-ade0-f28350be872b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:56.522032 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 629/1261] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:06:56.527603 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59f60a-300e-4baa-b91d-8ca7a1f23d27 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:56.527997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59f60a-300e-4baa-b91d-8ca7a1f23d27 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:56.528162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59f60a-300e-4baa-b91d-8ca7a1f23d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:56.544580 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bd59f60a-300e-4baa-b91d-8ca7a1f23d27 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:06:56.545764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bd59f60a-300e-4baa-b91d-8ca7a1f23d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:06:56.610846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 633/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:06:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:06:56.634090 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637232f0-fb93-40c3-ade0-f28350be872b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:56.644818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:56.734691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637232f0-fb93-40c3-ade0-f28350be872b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:56.767620 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96fc2d-4556-45fd-9051-0ee45b2f863a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:56.768401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96fc2d-4556-45fd-9051-0ee45b2f863a None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:56.768683 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96fc2d-4556-45fd-9051-0ee45b2f863a None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:56.768960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96fc2d-4556-45fd-9051-0ee45b2f863a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:56.779513 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96fc2d-4556-45fd-9051-0ee45b2f863a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-ea96fc2d-4556-45fd-9051-0ee45b2f863a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:06:56.787078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:56.788720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:56.789712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:56.789712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:56.789712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:56.789712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:56.789712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:06:56.789712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:06:56.789712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:06:56.789712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:06:56.789712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:06:56.789712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:06:56.789712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:06:56.789712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:06:56.789712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 630/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:06:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:56.795035 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59f60a-300e-4baa-b91d-8ca7a1f23d27 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:56.812895 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:56.893734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59f60a-300e-4baa-b91d-8ca7a1f23d27 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:56.927322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d339e-267e-46fa-b24e-592f577dd9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:56.927980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d339e-267e-46fa-b24e-592f577dd9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:56.928395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d339e-267e-46fa-b24e-592f577dd9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:56.928677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d339e-267e-46fa-b24e-592f577dd9e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:56.929417 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d339e-267e-46fa-b24e-592f577dd9e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:56.929717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d339e-267e-46fa-b24e-592f577dd9e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:56.931108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d339e-267e-46fa-b24e-592f577dd9e6 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:56.938994 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 634/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:06:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:56.945151 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96fc2d-4556-45fd-9051-0ee45b2f863a None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:57.012544 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:57.048103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96fc2d-4556-45fd-9051-0ee45b2f863a None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:57.085982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2013e-90e2-4f81-b336-528c7a1458e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:57.086823 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2013e-90e2-4f81-b336-528c7a1458e7 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:57.087154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2013e-90e2-4f81-b336-528c7a1458e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:57.087447 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2013e-90e2-4f81-b336-528c7a1458e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:57.099009 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2013e-90e2-4f81-b336-528c7a1458e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:57.101253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2013e-90e2-4f81-b336-528c7a1458e7 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:57.119527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-dac2013e-90e2-4f81-b336-528c7a1458e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:57.119527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:57.119527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:57.119527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:57.119527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:57.119527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:57.119527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:57.119527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:57.119527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:57.119527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:57.119527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:57.119527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:57.119527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:06:57.119527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:06:57.119527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:57.120663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:57.121998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:06:57.121998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:06:57.121998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:57.121998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:06:57.121998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 631/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:57.126550 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d339e-267e-46fa-b24e-592f577dd9e6 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:57.206950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:57.227532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d339e-267e-46fa-b24e-592f577dd9e6 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:57.262894 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb66a8-1e27-4a56-89ab-ae8d25ee37d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:57.263558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb66a8-1e27-4a56-89ab-ae8d25ee37d7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:57.263844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb66a8-1e27-4a56-89ab-ae8d25ee37d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:57.264149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb66a8-1e27-4a56-89ab-ae8d25ee37d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:57.264866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb66a8-1e27-4a56-89ab-ae8d25ee37d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:57.265178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb66a8-1e27-4a56-89ab-ae8d25ee37d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:57.266570 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb66a8-1e27-4a56-89ab-ae8d25ee37d7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:57.278633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 635/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:57.284379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2013e-90e2-4f81-b336-528c7a1458e7 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:57.383945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2013e-90e2-4f81-b336-528c7a1458e7 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:57.403245 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:57.417579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1eac2c-502b-4ef4-bed3-3711bcb7ca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:57.418377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1eac2c-502b-4ef4-bed3-3711bcb7ca0d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:57.418689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1eac2c-502b-4ef4-bed3-3711bcb7ca0d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:57.418968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1eac2c-502b-4ef4-bed3-3711bcb7ca0d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:57.426206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1eac2c-502b-4ef4-bed3-3711bcb7ca0d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:57.427764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1eac2c-502b-4ef4-bed3-3711bcb7ca0d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-1d1eac2c-502b-4ef4-bed3-3711bcb7ca0d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:06:57.442658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:57.443840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:57.444833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:57.444833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:57.444833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:06:57.444833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:06:57.444833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:06:57.444833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:06:57.444833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:06:57.444833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:06:57.444833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 16:06:57.444833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:06:57.444833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 632/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:57.449650 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb66a8-1e27-4a56-89ab-ae8d25ee37d7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:57.552689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb66a8-1e27-4a56-89ab-ae8d25ee37d7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:57.587126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a52b-0b41-4753-8784-24b0d4c3324a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:57.587803 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a52b-0b41-4753-8784-24b0d4c3324a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:57.588090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a52b-0b41-4753-8784-24b0d4c3324a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:57.588373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a52b-0b41-4753-8784-24b0d4c3324a None admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:57.589202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671a52b-0b41-4753-8784-24b0d4c3324a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:57.589512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671a52b-0b41-4753-8784-24b0d4c3324a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:57.590980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671a52b-0b41-4753-8784-24b0d4c3324a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:57.599539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:57.608785 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 636/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jun 16 16:06:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:57.614477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1eac2c-502b-4ef4-bed3-3711bcb7ca0d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:57.713950 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1eac2c-502b-4ef4-bed3-3711bcb7ca0d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:57.746713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babab72-df29-40c4-9964-01e8ff34b914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:57.747501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babab72-df29-40c4-9964-01e8ff34b914 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:57.747788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babab72-df29-40c4-9964-01e8ff34b914 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:57.748069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babab72-df29-40c4-9964-01e8ff34b914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:57.758450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babab72-df29-40c4-9964-01e8ff34b914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:57.759879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babab72-df29-40c4-9964-01e8ff34b914 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:57.777377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-0babab72-df29-40c4-9964-01e8ff34b914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:57.777377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:57.777377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:57.777377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:57.777377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:57.777377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:57.777377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:57.777377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:57.777377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:57.777377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:57.777377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:57.777377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:57.777377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:06:57.777377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:06:57.777377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:57.778325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:57.779284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:06:57.779284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:06:57.779284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:06:57.779284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:06:57.779284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 633/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:06:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:57.784348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a52b-0b41-4753-8784-24b0d4c3324a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:57.889296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a52b-0b41-4753-8784-24b0d4c3324a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:57.929545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59013278-4e4c-4a7f-8ca3-6ec9e8f5ef46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:57.930211 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59013278-4e4c-4a7f-8ca3-6ec9e8f5ef46 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:57.930685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59013278-4e4c-4a7f-8ca3-6ec9e8f5ef46 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:57.931126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59013278-4e4c-4a7f-8ca3-6ec9e8f5ef46 None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:57.931852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59013278-4e4c-4a7f-8ca3-6ec9e8f5ef46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:57.932163 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59013278-4e4c-4a7f-8ca3-6ec9e8f5ef46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:57.933531 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59013278-4e4c-4a7f-8ca3-6ec9e8f5ef46 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:57.945250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 637/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:57.951233 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babab72-df29-40c4-9964-01e8ff34b914 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:57.982893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:58.052930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babab72-df29-40c4-9964-01e8ff34b914 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:58.092535 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e443009-b9c9-431d-9864-1b7dac3db7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:58.093322 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e443009-b9c9-431d-9864-1b7dac3db7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:58.093605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e443009-b9c9-431d-9864-1b7dac3db7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:58.093882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e443009-b9c9-431d-9864-1b7dac3db7a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:58.101070 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e443009-b9c9-431d-9864-1b7dac3db7a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:58.102531 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e443009-b9c9-431d-9864-1b7dac3db7a9 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:58.117331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-2e443009-b9c9-431d-9864-1b7dac3db7a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:06:58.117331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:06:58.117331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:06:58.117331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:06:58.117331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:06:58.117331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:06:58.117331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:06:58.117331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:06:58.117331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:06:58.117331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:06:58.117331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:06:58.117331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:06:58.117331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:06:58.117331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:06:58.117331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:06:58.118475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:06:58.119760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:06:58.119760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:06:58.119760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:06:58.119760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:06:58.119760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:06:58.119760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:06:58.119760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:06:58.119760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:06:58.119760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 634/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:06:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:06:58.124322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59013278-4e4c-4a7f-8ca3-6ec9e8f5ef46 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:58.182974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:58.225483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59013278-4e4c-4a7f-8ca3-6ec9e8f5ef46 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:58.258072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9dcc9c-30f5-447a-8598-51cb858f55a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:58.258832 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dcc9c-30f5-447a-8598-51cb858f55a3 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:58.259116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dcc9c-30f5-447a-8598-51cb858f55a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:58.259391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dcc9c-30f5-447a-8598-51cb858f55a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:58.260168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9dcc9c-30f5-447a-8598-51cb858f55a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:06:58.260476 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9dcc9c-30f5-447a-8598-51cb858f55a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:58.261889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9dcc9c-30f5-447a-8598-51cb858f55a3 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:58.274915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 638/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:06:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:06:58.280953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e443009-b9c9-431d-9864-1b7dac3db7a9 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:06:58.372059 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:06:58.380998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e443009-b9c9-431d-9864-1b7dac3db7a9 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:06:58.420518 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbc2ee-9332-4fa5-bcb6-dcf36086fc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:06:58.421212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbc2ee-9332-4fa5-bcb6-dcf36086fc6b None admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:06:58.421497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbc2ee-9332-4fa5-bcb6-dcf36086fc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:06:58.421773 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbc2ee-9332-4fa5-bcb6-dcf36086fc6b None admin] PATH_INFO: `/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/9e8222d303aa487ca2b5c5bed6124f35/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:06:58.423769 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbc2ee-9332-4fa5-bcb6-dcf36086fc6b None admin] RBAC: Authorizing `identity:create_grant(project_id=227cd348bea64e1f89d77ae2cf63a031, user_id=9e8222d303aa487ca2b5c5bed6124f35, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:06:58.425212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbc2ee-9332-4fa5-bcb6-dcf36086fc6b None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:06:58.438113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 635/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 16 16:06:58 2022] PUT /identity/v3/projects/227cd348bea64e1f89d77ae2cf63a031/users/9e8222d303aa487ca2b5c5bed6124f35/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:07:00.556056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f174ec-42c9-4277-90bc-2fec02accae4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:00.556602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f174ec-42c9-4277-90bc-2fec02accae4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:00.556602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f174ec-42c9-4277-90bc-2fec02accae4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:00.557985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 639/1274] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:07:00.563076 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a8426-42b9-431e-9947-97238bd2af23 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:00.563518 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a8426-42b9-431e-9947-97238bd2af23 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:00.563622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a8426-42b9-431e-9947-97238bd2af23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:00.581261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d97a8426-42b9-431e-9947-97238bd2af23 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:07:00.582454 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d97a8426-42b9-431e-9947-97238bd2af23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:07:00.647334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 636/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:07:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:07:00.669726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f174ec-42c9-4277-90bc-2fec02accae4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:00.771607 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f174ec-42c9-4277-90bc-2fec02accae4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:00.788403 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:00.805348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c35054-9386-40d5-943f-201b8816ee57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:00.806131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c35054-9386-40d5-943f-201b8816ee57 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:00.806410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c35054-9386-40d5-943f-201b8816ee57 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:00.806712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c35054-9386-40d5-943f-201b8816ee57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:00.816801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c35054-9386-40d5-943f-201b8816ee57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-94c35054-9386-40d5-943f-201b8816ee57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 16:07:00.825437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:07:00.826576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:07:00.827631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:07:00.827631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:07:00.827631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:07:00.827631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:07:00.827631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 16:07:00.827631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 16:07:00.827631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 16:07:00.827631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 16:07:00.827631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 16:07:00.827631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 16:07:00.827631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 16:07:00.827631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:07:00.827631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 640/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 16 16:07:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:07:00.832566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a8426-42b9-431e-9947-97238bd2af23 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:00.911565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:00.931418 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a8426-42b9-431e-9947-97238bd2af23 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:00.965548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eee7a3-d551-4d29-86ff-8721dcb8e32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:00.966220 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eee7a3-d551-4d29-86ff-8721dcb8e32d None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:00.966533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eee7a3-d551-4d29-86ff-8721dcb8e32d None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:00.966815 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eee7a3-d551-4d29-86ff-8721dcb8e32d None admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:00.967561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eee7a3-d551-4d29-86ff-8721dcb8e32d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:07:00.967870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eee7a3-d551-4d29-86ff-8721dcb8e32d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:00.969238 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eee7a3-d551-4d29-86ff-8721dcb8e32d None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:00.977761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 637/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 16 16:07:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:07:00.983559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c35054-9386-40d5-943f-201b8816ee57 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:01.095088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c35054-9386-40d5-943f-201b8816ee57 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:01.133201 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a5eb6-7817-42e4-9832-cac9817a8da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:01.133988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a5eb6-7817-42e4-9832-cac9817a8da7 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:01.134267 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a5eb6-7817-42e4-9832-cac9817a8da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:01.134570 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a5eb6-7817-42e4-9832-cac9817a8da7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:01.145009 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a5eb6-7817-42e4-9832-cac9817a8da7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:01.146492 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a5eb6-7817-42e4-9832-cac9817a8da7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:01.163988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-f84a5eb6-7817-42e4-9832-cac9817a8da7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:07:01.163988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:07:01.163988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:07:01.163988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:07:01.163988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:07:01.163988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:07:01.163988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:07:01.163988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:07:01.163988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:07:01.163988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:07:01.163988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:07:01.163988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:07:01.163988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:07:01.163988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:07:01.163988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:07:01.165033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:07:01.166362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:07:01.166362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:07:01.166362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:07:01.166362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:07:01.166362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 641/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:07:01.170892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eee7a3-d551-4d29-86ff-8721dcb8e32d None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:01.268042 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eee7a3-d551-4d29-86ff-8721dcb8e32d None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:01.300812 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9828a08-9893-445d-b0c4-649743cb1d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:01.301475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9828a08-9893-445d-b0c4-649743cb1d05 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:01.301760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9828a08-9893-445d-b0c4-649743cb1d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:01.302041 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9828a08-9893-445d-b0c4-649743cb1d05 None admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:01.302787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9828a08-9893-445d-b0c4-649743cb1d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:07:01.303639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9828a08-9893-445d-b0c4-649743cb1d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:01.305220 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9828a08-9893-445d-b0c4-649743cb1d05 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:01.317173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 638/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:07:01.323508 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a5eb6-7817-42e4-9832-cac9817a8da7 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:01.353490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:01.424100 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a5eb6-7817-42e4-9832-cac9817a8da7 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:01.464243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c948a3-5cc1-419b-8797-7109989d3aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:01.465041 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c948a3-5cc1-419b-8797-7109989d3aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:01.465326 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c948a3-5cc1-419b-8797-7109989d3aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:01.465602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c948a3-5cc1-419b-8797-7109989d3aa1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:01.472918 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c948a3-5cc1-419b-8797-7109989d3aa1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:01.474357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c948a3-5cc1-419b-8797-7109989d3aa1 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-68c948a3-5cc1-419b-8797-7109989d3aa1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 16:07:01.488879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:07:01.490074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:07:01.491605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:07:01.491605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:07:01.491605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 16:07:01.491605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 16:07:01.491605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 16:07:01.491605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 16:07:01.491605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 16:07:01.491605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 16:07:01.491605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 16:07:01.491605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:07:01.491605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 642/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:07:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:07:01.496568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9828a08-9893-445d-b0c4-649743cb1d05 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:01.500363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:01.596571 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9828a08-9893-445d-b0c4-649743cb1d05 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:01.630130 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac629f7-82e4-495a-995f-faf2cc1403e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:01.630830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac629f7-82e4-495a-995f-faf2cc1403e0 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:01.631697 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac629f7-82e4-495a-995f-faf2cc1403e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:01.632084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac629f7-82e4-495a-995f-faf2cc1403e0 None admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:01.632917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac629f7-82e4-495a-995f-faf2cc1403e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:07:01.633230 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac629f7-82e4-495a-995f-faf2cc1403e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:01.634668 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac629f7-82e4-495a-995f-faf2cc1403e0 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:01.651272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 639/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jun 16 16:07:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:07:01.657058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c948a3-5cc1-419b-8797-7109989d3aa1 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:01.747940 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:01.757764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c948a3-5cc1-419b-8797-7109989d3aa1 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:01.790756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e65a8-b5b5-4b90-8483-bfaa5b58b492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:01.791415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e65a8-b5b5-4b90-8483-bfaa5b58b492 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:01.791696 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e65a8-b5b5-4b90-8483-bfaa5b58b492 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:01.791970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e65a8-b5b5-4b90-8483-bfaa5b58b492 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:01.857183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e65a8-b5b5-4b90-8483-bfaa5b58b492 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:01.858644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e65a8-b5b5-4b90-8483-bfaa5b58b492 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:01.944567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:01.954862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 643/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 16 16:07:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 16:07:01.960973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac629f7-82e4-495a-995f-faf2cc1403e0 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:02.022724 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:02.062637 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac629f7-82e4-495a-995f-faf2cc1403e0 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:02.096499 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bdcd9-e9db-4e03-95c5-632dc529333e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:02.097292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bdcd9-e9db-4e03-95c5-632dc529333e None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:02.097571 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bdcd9-e9db-4e03-95c5-632dc529333e None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:02.097841 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bdcd9-e9db-4e03-95c5-632dc529333e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:02.108136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bdcd9-e9db-4e03-95c5-632dc529333e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:02.109567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bdcd9-e9db-4e03-95c5-632dc529333e None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:02.126478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-7e5bdcd9-e9db-4e03-95c5-632dc529333e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:07:02.126478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:07:02.126478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:07:02.126478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:07:02.126478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:07:02.126478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:07:02.126478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:07:02.126478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:07:02.126478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:07:02.126478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:07:02.126478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:07:02.126478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:07:02.126478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 16:07:02.126478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 16:07:02.126478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:07:02.127515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:07:02.128628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 16:07:02.128628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 16:07:02.128628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 16:07:02.128628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:07:02.128628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 640/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:07:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:07:02.133901 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e65a8-b5b5-4b90-8483-bfaa5b58b492 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:02.234873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e65a8-b5b5-4b90-8483-bfaa5b58b492 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:02.267563 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8dd87-3341-4ee0-92a5-15e3c6e5284a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:02.268221 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8dd87-3341-4ee0-92a5-15e3c6e5284a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:02.268505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8dd87-3341-4ee0-92a5-15e3c6e5284a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:02.268784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8dd87-3341-4ee0-92a5-15e3c6e5284a None admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:02.269505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8dd87-3341-4ee0-92a5-15e3c6e5284a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:07:02.269810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8dd87-3341-4ee0-92a5-15e3c6e5284a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:02.271209 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8dd87-3341-4ee0-92a5-15e3c6e5284a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:02.283132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 644/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 16 16:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:07:02.289501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bdcd9-e9db-4e03-95c5-632dc529333e None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:02.388532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bdcd9-e9db-4e03-95c5-632dc529333e None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:02.402968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:02.423313 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c10279-eec2-40ba-9b44-2f5402021076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:02.424108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c10279-eec2-40ba-9b44-2f5402021076 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:02.424395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c10279-eec2-40ba-9b44-2f5402021076 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:02.424672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c10279-eec2-40ba-9b44-2f5402021076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:02.432040 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c10279-eec2-40ba-9b44-2f5402021076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:02.433491 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c10279-eec2-40ba-9b44-2f5402021076 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:02.447990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application [None req-34c10279-eec2-40ba-9b44-2f5402021076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:07:02.447990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:07:02.447990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:07:02.447990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:07:02.447990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:07:02.447990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:07:02.447990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:07:02.447990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:07:02.447990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:07:02.447990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:07:02.447990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:07:02.447990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:07:02.447990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 16:07:02.447990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 16:07:02.447990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application with Lock( Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:07:02.449033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:07:02.449964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 16:07:02.449964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 16:07:02.449964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 16:07:02.449964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 16:07:02.449964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 16:07:02.449964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 16:07:02.449964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 16:07:02.449964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: ERROR keystone.server.flask.application Jun 16 16:07:02.449964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 641/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 16 16:07:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:07:02.455242 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8dd87-3341-4ee0-92a5-15e3c6e5284a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:02.508058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:02.558887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8dd87-3341-4ee0-92a5-15e3c6e5284a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:02.592377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757324c-7208-4f54-ab13-e2e5d3903dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:02.593020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757324c-7208-4f54-ab13-e2e5d3903dcf None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:02.593316 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757324c-7208-4f54-ab13-e2e5d3903dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:02.593570 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757324c-7208-4f54-ab13-e2e5d3903dcf None admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:02.594344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757324c-7208-4f54-ab13-e2e5d3903dcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:07:02.594675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757324c-7208-4f54-ab13-e2e5d3903dcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:02.596090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757324c-7208-4f54-ab13-e2e5d3903dcf None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:02.608444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 645/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 16 16:07:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:07:02.614629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c10279-eec2-40ba-9b44-2f5402021076 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:02.712538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c10279-eec2-40ba-9b44-2f5402021076 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:02.745709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25477f76-ba9e-477b-a2a1-16cde3fe4ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:02.746362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25477f76-ba9e-477b-a2a1-16cde3fe4ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:02.746678 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25477f76-ba9e-477b-a2a1-16cde3fe4ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:02.746954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25477f76-ba9e-477b-a2a1-16cde3fe4ce5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:02.747782 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25477f76-ba9e-477b-a2a1-16cde3fe4ce5 None admin] RBAC: Adding query filter params (role.id=f45a54997fdf4bb2a778ae7e16070ec2, scope.project.id=227cd348bea64e1f89d77ae2cf63a031, user.id=9e8222d303aa487ca2b5c5bed6124f35) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:07:02.748094 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25477f76-ba9e-477b-a2a1-16cde3fe4ce5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:02.749515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25477f76-ba9e-477b-a2a1-16cde3fe4ce5 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:02.755289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 642/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 16 16:07:02 2022] GET /identity/v3/role_assignments?user.id=9e8222d303aa487ca2b5c5bed6124f35&scope.project.id=227cd348bea64e1f89d77ae2cf63a031&role.id=f45a54997fdf4bb2a778ae7e16070ec2 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:07:04.919148 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2ce69-24d7-412c-bb65-dfd7378c2b63 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:04.919684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2ce69-24d7-412c-bb65-dfd7378c2b63 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:04.919801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2ce69-24d7-412c-bb65-dfd7378c2b63 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:04.921083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 646/1288] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:07:04.926291 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078930dd-3c67-4f5f-a6cd-ff889348af7f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:04.926753 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078930dd-3c67-4f5f-a6cd-ff889348af7f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:04.926896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078930dd-3c67-4f5f-a6cd-ff889348af7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:04.944764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-078930dd-3c67-4f5f-a6cd-ff889348af7f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:07:04.946010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-078930dd-3c67-4f5f-a6cd-ff889348af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:07:04.977634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:05.018514 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 643/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:07:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:07:05.044575 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2ce69-24d7-412c-bb65-dfd7378c2b63 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:05.157809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2ce69-24d7-412c-bb65-dfd7378c2b63 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:05.168692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:05.192314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf1704-ffd6-4597-9691-9613b9076040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:05.193020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf1704-ffd6-4597-9691-9613b9076040 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:05.193300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf1704-ffd6-4597-9691-9613b9076040 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:05.193773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf1704-ffd6-4597-9691-9613b9076040 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:05.194633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf1704-ffd6-4597-9691-9613b9076040 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:05.196000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf1704-ffd6-4597-9691-9613b9076040 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-9ebf1704-ffd6-4597-9691-9613b9076040 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:07:05.207487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:07:05.209523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:07:05.210751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:07:05.210751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:07:05.210751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:07:05.210751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:07:05.210751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:07:05.210751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:07:05.210751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:07:05.210751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:07:05.210751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:07:05.210751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:07:05.210751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:07:05.210751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:07:05.210751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 16:07:05.210751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:07:05.210751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 647/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 16 16:07:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:07:05.215178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078930dd-3c67-4f5f-a6cd-ff889348af7f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:05.313482 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078930dd-3c67-4f5f-a6cd-ff889348af7f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:05.363801 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f23899-31f5-468d-bce9-2e42737ebaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:05.364482 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23899-31f5-468d-bce9-2e42737ebaea None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:05.364767 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23899-31f5-468d-bce9-2e42737ebaea None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:05.365043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23899-31f5-468d-bce9-2e42737ebaea None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:05.366068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f23899-31f5-468d-bce9-2e42737ebaea None admin] RBAC: Adding query filter params (name=placement) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:07:05.366530 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f23899-31f5-468d-bce9-2e42737ebaea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:05.368676 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f23899-31f5-468d-bce9-2e42737ebaea None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:05.375473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 644/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jun 16 16:07:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:07:05.382377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf1704-ffd6-4597-9691-9613b9076040 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:05.484243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf1704-ffd6-4597-9691-9613b9076040 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:05.517033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552612a1-ec2c-43eb-9870-435bc074b65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:05.517692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552612a1-ec2c-43eb-9870-435bc074b65f None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:05.517976 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552612a1-ec2c-43eb-9870-435bc074b65f None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:05.518250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552612a1-ec2c-43eb-9870-435bc074b65f None admin] PATH_INFO: `/v3/services` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:05.518980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552612a1-ec2c-43eb-9870-435bc074b65f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:07:05.519287 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552612a1-ec2c-43eb-9870-435bc074b65f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:05.520879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552612a1-ec2c-43eb-9870-435bc074b65f None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:05.525858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 648/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jun 16 16:07:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:07:07.610398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c7c78-da5f-4877-a47a-07cf199aeeef None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:07.610944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c7c78-da5f-4877-a47a-07cf199aeeef None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:07.611068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c7c78-da5f-4877-a47a-07cf199aeeef None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:07.612346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 645/1293] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:07:07.617607 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c529e4-6e59-4c5b-bec8-3bdda7a8fbdb None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:07.618037 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c529e4-6e59-4c5b-bec8-3bdda7a8fbdb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:07.618132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c529e4-6e59-4c5b-bec8-3bdda7a8fbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:07.635511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a6c529e4-6e59-4c5b-bec8-3bdda7a8fbdb None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:07:07.636701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a6c529e4-6e59-4c5b-bec8-3bdda7a8fbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:07:07.667159 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:07.706779 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 649/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:07:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:07:07.730144 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c7c78-da5f-4877-a47a-07cf199aeeef None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:07.761506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:07.832170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c7c78-da5f-4877-a47a-07cf199aeeef None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:07.866954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667070a-2401-4ed1-9ea3-cf40c2339646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:07.867668 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667070a-2401-4ed1-9ea3-cf40c2339646 None admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:07.867903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667070a-2401-4ed1-9ea3-cf40c2339646 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:07.868181 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667070a-2401-4ed1-9ea3-cf40c2339646 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:07.868893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667070a-2401-4ed1-9ea3-cf40c2339646 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:07.870248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667070a-2401-4ed1-9ea3-cf40c2339646 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:07.883945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 646/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 16 16:07:07 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:07:10.169052 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5a527-db58-4fa9-9e84-08924808df49 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:10.169614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5a527-db58-4fa9-9e84-08924808df49 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:10.169614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5a527-db58-4fa9-9e84-08924808df49 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:10.170988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 650/1296] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:07:10.176020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323ca2c-b59e-4bde-bcd8-627d4d9fc47f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:10.176397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323ca2c-b59e-4bde-bcd8-627d4d9fc47f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:10.176582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323ca2c-b59e-4bde-bcd8-627d4d9fc47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:10.193932 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6323ca2c-b59e-4bde-bcd8-627d4d9fc47f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:07:10.195142 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6323ca2c-b59e-4bde-bcd8-627d4d9fc47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:07:10.267687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 647/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:07:10 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 16:07:10.290850 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5a527-db58-4fa9-9e84-08924808df49 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:10.392651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5a527-db58-4fa9-9e84-08924808df49 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:10.425661 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce82c3-2daf-4a1e-bd08-fac8b91b707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:10.426382 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce82c3-2daf-4a1e-bd08-fac8b91b707a None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:10.426695 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce82c3-2daf-4a1e-bd08-fac8b91b707a None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:10.426970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce82c3-2daf-4a1e-bd08-fac8b91b707a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:10.428280 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce82c3-2daf-4a1e-bd08-fac8b91b707a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:10.429655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce82c3-2daf-4a1e-bd08-fac8b91b707a None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-79ce82c3-2daf-4a1e-bd08-fac8b91b707a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:07:10.441500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:07:10.442701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:07:10.443891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:07:10.443891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:07:10.443891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:07:10.443891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:07:10.443891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:07:10.443891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:07:10.443891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:07:10.443891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:07:10.443891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:07:10.443891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:07:10.443891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:07:10.443891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:07:10.443891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 16:07:10.443891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:07:10.443891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 651/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 16 16:07:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:07:10.448936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323ca2c-b59e-4bde-bcd8-627d4d9fc47f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:10.467254 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:10.548704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323ca2c-b59e-4bde-bcd8-627d4d9fc47f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:10.586529 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc270a-2639-4a32-aced-b4fe13826447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:10.587190 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc270a-2639-4a32-aced-b4fe13826447 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:10.587471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc270a-2639-4a32-aced-b4fe13826447 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:10.587743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc270a-2639-4a32-aced-b4fe13826447 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:10.588467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc270a-2639-4a32-aced-b4fe13826447 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:07:10.588770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc270a-2639-4a32-aced-b4fe13826447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:10.590119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc270a-2639-4a32-aced-b4fe13826447 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:10.595163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 648/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jun 16 16:07:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:07:10.601447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce82c3-2daf-4a1e-bd08-fac8b91b707a None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:10.633698 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:10.701881 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce82c3-2daf-4a1e-bd08-fac8b91b707a None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:10.734778 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ca86c-5d81-4fa4-84e9-5ac2e9dc2294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:10.735423 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ca86c-5d81-4fa4-84e9-5ac2e9dc2294 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:10.735707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ca86c-5d81-4fa4-84e9-5ac2e9dc2294 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:10.735986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ca86c-5d81-4fa4-84e9-5ac2e9dc2294 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:10.736766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ca86c-5d81-4fa4-84e9-5ac2e9dc2294 None admin] RBAC: Adding query filter params (interface=public, service_id=f5deeb5de0a1444ea268491098e3e6ce, region_id=RegionOne) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:07:10.737079 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ca86c-5d81-4fa4-84e9-5ac2e9dc2294 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:10.738465 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ca86c-5d81-4fa4-84e9-5ac2e9dc2294 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:10.744147 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 652/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 16 16:07:10 2022] GET /identity/v3/endpoints?service_id=f5deeb5de0a1444ea268491098e3e6ce&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:07:10.749941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc270a-2639-4a32-aced-b4fe13826447 None admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:10.828843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:10.846503 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc270a-2639-4a32-aced-b4fe13826447 None admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:10.880075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59515886-6a03-44d1-a783-ab15bd276945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:10.880762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59515886-6a03-44d1-a783-ab15bd276945 None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:10.881040 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59515886-6a03-44d1-a783-ab15bd276945 None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:10.881316 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59515886-6a03-44d1-a783-ab15bd276945 None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:10.881991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59515886-6a03-44d1-a783-ab15bd276945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:10.883372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59515886-6a03-44d1-a783-ab15bd276945 None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:10.890239 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 649/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 16 16:07:10 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:07:13.025397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5303c-9cfa-462d-9d4f-03705d84142a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:13.025931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5303c-9cfa-462d-9d4f-03705d84142a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:13.025931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5303c-9cfa-462d-9d4f-03705d84142a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:13.027358 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 653/1302] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:07:13.032466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fd6c7-8085-411d-b0d4-9189a298248f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:13.032836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fd6c7-8085-411d-b0d4-9189a298248f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:13.033030 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fd6c7-8085-411d-b0d4-9189a298248f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:13.053259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-c48fd6c7-8085-411d-b0d4-9189a298248f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:07:13.054541 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c48fd6c7-8085-411d-b0d4-9189a298248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:07:13.122173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 650/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:07:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 16:07:13.145287 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5303c-9cfa-462d-9d4f-03705d84142a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:13.238290 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:13.245639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5303c-9cfa-462d-9d4f-03705d84142a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:13.278171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc960d-6a01-42eb-9687-79a2a4bd4e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:13.278912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc960d-6a01-42eb-9687-79a2a4bd4e54 None admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:13.279194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc960d-6a01-42eb-9687-79a2a4bd4e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:13.279468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc960d-6a01-42eb-9687-79a2a4bd4e54 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:13.280110 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc960d-6a01-42eb-9687-79a2a4bd4e54 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:13.281463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc960d-6a01-42eb-9687-79a2a4bd4e54 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application [None req-58bc960d-6a01-42eb-9687-79a2a4bd4e54 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 16:07:13.292948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 16:07:13.294130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 16:07:13.295385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 16:07:13.295385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application with Lock( Jun 16 16:07:13.295385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 16:07:13.295385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self._enter() Jun 16 16:07:13.295385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 16:07:13.295385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 16:07:13.295385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 16:07:13.295385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application return self.creator() Jun 16 16:07:13.295385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 16:07:13.295385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application created_value = creator( Jun 16 16:07:13.295385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 16:07:13.295385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 16:07:13.295385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 16:07:13.295385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: ERROR keystone.server.flask.application Jun 16 16:07:13.295385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 654/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 16 16:07:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 16:07:13.300106 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fd6c7-8085-411d-b0d4-9189a298248f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:13.376182 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:13.399572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fd6c7-8085-411d-b0d4-9189a298248f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:13.434271 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d460e4c-91c1-4689-b9e6-480266b9c1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:13.434972 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d460e4c-91c1-4689-b9e6-480266b9c1fb None admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:13.435262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d460e4c-91c1-4689-b9e6-480266b9c1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:13.435543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d460e4c-91c1-4689-b9e6-480266b9c1fb None admin] PATH_INFO: `/v3/services` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:13.436247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d460e4c-91c1-4689-b9e6-480266b9c1fb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:07:13.436559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d460e4c-91c1-4689-b9e6-480266b9c1fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:13.437924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d460e4c-91c1-4689-b9e6-480266b9c1fb None admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:13.444017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 651/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jun 16 16:07:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:07:13.449901 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc960d-6a01-42eb-9687-79a2a4bd4e54 None admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:07:13.545875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc960d-6a01-42eb-9687-79a2a4bd4e54 None admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:07:13.579536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6b815-f79b-4ea8-8204-360389f39dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:07:13.580181 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6b815-f79b-4ea8-8204-360389f39dc7 None admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:07:13.580463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6b815-f79b-4ea8-8204-360389f39dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:07:13.580732 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6b815-f79b-4ea8-8204-360389f39dc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:07:13.581455 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6b815-f79b-4ea8-8204-360389f39dc7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:07:13.582843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6b815-f79b-4ea8-8204-360389f39dc7 None admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:07:13.601475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 655/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 16 16:07:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:07:23.440131 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=30 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:07:23.596264 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:17.631234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7500ee-72e6-439b-a4db-ce04fa9bf8d7 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:17.631772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7500ee-72e6-439b-a4db-ce04fa9bf8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:17.631772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7500ee-72e6-439b-a4db-ce04fa9bf8d7 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:17.637446 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 652/1307] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:08:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:08:17.639225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ef3c4-61d4-4f01-a3b5-1f544d85ce65 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:17.640019 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ef3c4-61d4-4f01-a3b5-1f544d85ce65 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:17.640452 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ef3c4-61d4-4f01-a3b5-1f544d85ce65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:17.739249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-072ef3c4-61d4-4f01-a3b5-1f544d85ce65 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:08:17.740977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-072ef3c4-61d4-4f01-a3b5-1f544d85ce65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:17.870388 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 656/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:08:17.923212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883ecf9-9bba-47c2-b566-49836f9f2a62 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:17.923430 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883ecf9-9bba-47c2-b566-49836f9f2a62 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:17.923716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883ecf9-9bba-47c2-b566-49836f9f2a62 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:17.925507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 653/1309] 10.222.0.48 () {54 vars in 964 bytes} [Thu Jun 16 16:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:08:17.936610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ec7fb-03b6-4747-80cb-8793558bd7e6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:17.937423 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ec7fb-03b6-4747-80cb-8793558bd7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:17.938155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ec7fb-03b6-4747-80cb-8793558bd7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:18.077365 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c96ec7fb-03b6-4747-80cb-8793558bd7e6 None None] MFA Rules not processed for user `087adcbf737843db97dabfa9708484c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:08:18.078944 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c96ec7fb-03b6-4747-80cb-8793558bd7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:18.105463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:18.190622 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 657/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Thu Jun 16 16:08:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:08:18.199673 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883ecf9-9bba-47c2-b566-49836f9f2a62 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:08:18.201404 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b883ecf9-9bba-47c2-b566-49836f9f2a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:18.327287 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883ecf9-9bba-47c2-b566-49836f9f2a62 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:08:18.416758 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6bfae-7d99-460c-b19f-28bc08bff7d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:08:18.417336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6bfae-7d99-460c-b19f-28bc08bff7d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:18.417624 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6bfae-7d99-460c-b19f-28bc08bff7d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:18.417906 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6bfae-7d99-460c-b19f-28bc08bff7d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:18.419625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ead6bfae-7d99-460c-b19f-28bc08bff7d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:18.480421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:18.543430 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6bfae-7d99-460c-b19f-28bc08bff7d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:08:18.544841 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6bfae-7d99-460c-b19f-28bc08bff7d9 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:08:18.564390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 654/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:08:21.086380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d35c79-680f-49c4-ba9d-47d2278ccdab None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:21.087000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d35c79-680f-49c4-ba9d-47d2278ccdab None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:21.087000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d35c79-680f-49c4-ba9d-47d2278ccdab None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:21.088483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 658/1312] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:08:21.093469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c30b6-6113-4b4c-9637-cc209ffa86b7 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:21.093905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c30b6-6113-4b4c-9637-cc209ffa86b7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:21.094020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c30b6-6113-4b4c-9637-cc209ffa86b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:21.188936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f15c30b6-6113-4b4c-9637-cc209ffa86b7 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:08:21.191955 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f15c30b6-6113-4b4c-9637-cc209ffa86b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:21.329830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 655/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:08:21.371130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d35c79-680f-49c4-ba9d-47d2278ccdab None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:08:21.372675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-19d35c79-680f-49c4-ba9d-47d2278ccdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:21.489035 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d35c79-680f-49c4-ba9d-47d2278ccdab None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:08:21.585755 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:21.588048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ab319-e57f-4633-8d5d-93c122d248a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:08:21.588707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ab319-e57f-4633-8d5d-93c122d248a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:21.589142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ab319-e57f-4633-8d5d-93c122d248a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:21.589438 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ab319-e57f-4633-8d5d-93c122d248a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:21.591851 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e59ab319-e57f-4633-8d5d-93c122d248a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:21.712921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ab319-e57f-4633-8d5d-93c122d248a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:08:21.714373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ab319-e57f-4633-8d5d-93c122d248a7 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:08:21.734961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 659/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:08:24.253675 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb6798-b27b-4bc0-acf9-78f453778d1a None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:24.254230 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb6798-b27b-4bc0-acf9-78f453778d1a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:24.254230 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb6798-b27b-4bc0-acf9-78f453778d1a None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:24.255570 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 656/1315] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:08:24.261067 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2328aa-1a3d-4ba6-92ae-ec3ccdf2b8b6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:24.261605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2328aa-1a3d-4ba6-92ae-ec3ccdf2b8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:24.261895 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2328aa-1a3d-4ba6-92ae-ec3ccdf2b8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:24.325847 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ea2328aa-1a3d-4ba6-92ae-ec3ccdf2b8b6 None None] MFA Rules not processed for user `39c09083dd8a4c6dadfc555929d428f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:08:24.327080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ea2328aa-1a3d-4ba6-92ae-ec3ccdf2b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:24.380804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:24.429876 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 660/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:08:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:08:24.468608 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb6798-b27b-4bc0-acf9-78f453778d1a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:08:24.470160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a1eb6798-b27b-4bc0-acf9-78f453778d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:24.480896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:24.577243 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb6798-b27b-4bc0-acf9-78f453778d1a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:08:24.650202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bdee1-e306-4d51-8e5b-67fb180c087a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:08:24.650880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bdee1-e306-4d51-8e5b-67fb180c087a service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:24.651163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bdee1-e306-4d51-8e5b-67fb180c087a service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:24.651440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bdee1-e306-4d51-8e5b-67fb180c087a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:24.653081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-522bdee1-e306-4d51-8e5b-67fb180c087a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:24.716324 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:24.764720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bdee1-e306-4d51-8e5b-67fb180c087a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:08:24.766159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bdee1-e306-4d51-8e5b-67fb180c087a service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:08:24.783887 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 657/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:08:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:08:27.492224 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a367ff-62b3-4098-af51-28b9e2f893eb None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:27.492778 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a367ff-62b3-4098-af51-28b9e2f893eb None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:27.492778 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a367ff-62b3-4098-af51-28b9e2f893eb None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:27.494178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 661/1318] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:08:27.499491 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246100d6-97af-4850-9ef9-521e94dd24a6 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:27.499902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246100d6-97af-4850-9ef9-521e94dd24a6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:27.500064 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246100d6-97af-4850-9ef9-521e94dd24a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:27.569976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-246100d6-97af-4850-9ef9-521e94dd24a6 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:08:27.571223 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-246100d6-97af-4850-9ef9-521e94dd24a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:27.667446 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 658/1319] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:08:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:08:27.707558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a367ff-62b3-4098-af51-28b9e2f893eb None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:08:27.709114 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-11a367ff-62b3-4098-af51-28b9e2f893eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:27.811934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a367ff-62b3-4098-af51-28b9e2f893eb None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:08:27.884439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b380aaf-6de9-4035-8de8-2cb09b77c106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:08:27.885068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b380aaf-6de9-4035-8de8-2cb09b77c106 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:27.885351 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b380aaf-6de9-4035-8de8-2cb09b77c106 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:27.885628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b380aaf-6de9-4035-8de8-2cb09b77c106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:27.887297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6b380aaf-6de9-4035-8de8-2cb09b77c106 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:27.894683 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:27.995468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b380aaf-6de9-4035-8de8-2cb09b77c106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:08:27.996915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b380aaf-6de9-4035-8de8-2cb09b77c106 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:08:28.014737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 662/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:08:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:08:30.838310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778aa7c-3588-4557-baf8-a73254cc8326 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:30.838896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778aa7c-3588-4557-baf8-a73254cc8326 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:30.838896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778aa7c-3588-4557-baf8-a73254cc8326 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:30.840283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 659/1321] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:08:30.845738 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed75d8-0e3c-4757-b6ea-12e9a176a1ed None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:30.846160 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed75d8-0e3c-4757-b6ea-12e9a176a1ed None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:30.846293 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed75d8-0e3c-4757-b6ea-12e9a176a1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:30.918138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-faed75d8-0e3c-4757-b6ea-12e9a176a1ed None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:08:30.919492 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-faed75d8-0e3c-4757-b6ea-12e9a176a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:30.982851 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:31.035669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 663/1322] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:08:31.072414 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778aa7c-3588-4557-baf8-a73254cc8326 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:08:31.074021 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0778aa7c-3588-4557-baf8-a73254cc8326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:31.096703 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:31.184463 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778aa7c-3588-4557-baf8-a73254cc8326 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:08:31.259514 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b21b0-7f2b-4bad-b5f1-0a25dcbea26a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:08:31.260284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b21b0-7f2b-4bad-b5f1-0a25dcbea26a service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:31.260579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b21b0-7f2b-4bad-b5f1-0a25dcbea26a service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:31.260863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b21b0-7f2b-4bad-b5f1-0a25dcbea26a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:31.262598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3b3b21b0-7f2b-4bad-b5f1-0a25dcbea26a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:31.342186 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:31.380972 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b21b0-7f2b-4bad-b5f1-0a25dcbea26a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:08:31.382459 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b21b0-7f2b-4bad-b5f1-0a25dcbea26a service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:08:31.401539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 660/1323] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:08:33.614835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aa022-91d8-45f9-8710-3cce0fcfbdd7 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:33.615379 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aa022-91d8-45f9-8710-3cce0fcfbdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:33.615379 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aa022-91d8-45f9-8710-3cce0fcfbdd7 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:33.616664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 664/1324] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:08:33.622163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731c3db-3b7c-4fc3-b0aa-6af10c815783 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:33.622622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731c3db-3b7c-4fc3-b0aa-6af10c815783 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:33.622760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731c3db-3b7c-4fc3-b0aa-6af10c815783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:33.696511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6731c3db-3b7c-4fc3-b0aa-6af10c815783 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:08:33.697769 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6731c3db-3b7c-4fc3-b0aa-6af10c815783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:33.840919 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 661/1325] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:08:33.877501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aa022-91d8-45f9-8710-3cce0fcfbdd7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:08:33.879168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-287aa022-91d8-45f9-8710-3cce0fcfbdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:33.990743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aa022-91d8-45f9-8710-3cce0fcfbdd7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:08:34.066974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73b190-4fed-46dc-996b-e8fddb98cfad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:08:34.067624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73b190-4fed-46dc-996b-e8fddb98cfad service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:34.067906 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73b190-4fed-46dc-996b-e8fddb98cfad service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:34.068181 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73b190-4fed-46dc-996b-e8fddb98cfad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:34.069810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bf73b190-4fed-46dc-996b-e8fddb98cfad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:34.086705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:34.190366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73b190-4fed-46dc-996b-e8fddb98cfad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:08:34.191853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73b190-4fed-46dc-996b-e8fddb98cfad service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:08:34.210441 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 665/1326] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:08:36.446547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26ecc0-6d61-41a1-9f14-c5e96a600235 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:36.447092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26ecc0-6d61-41a1-9f14-c5e96a600235 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:36.447092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26ecc0-6d61-41a1-9f14-c5e96a600235 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:36.448487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 662/1327] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:08:36.453684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b1216-e16c-4407-9988-858cb998ed14 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:36.454127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b1216-e16c-4407-9988-858cb998ed14 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:36.454255 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b1216-e16c-4407-9988-858cb998ed14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:36.521696 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ff8b1216-e16c-4407-9988-858cb998ed14 None None] MFA Rules not processed for user `39c09083dd8a4c6dadfc555929d428f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:08:36.522959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ff8b1216-e16c-4407-9988-858cb998ed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:36.590834 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:36.626966 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 666/1328] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:08:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:08:36.677737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c0746-2deb-459a-accf-644b9fbfccd9 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:36.678175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c0746-2deb-459a-accf-644b9fbfccd9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:36.678478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c0746-2deb-459a-accf-644b9fbfccd9 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:36.679865 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 663/1329] 10.222.0.48 () {54 vars in 964 bytes} [Thu Jun 16 16:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:08:36.685992 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925b6b3-f41b-4e49-858d-dd7f3309362a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:36.686282 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925b6b3-f41b-4e49-858d-dd7f3309362a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:36.686602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925b6b3-f41b-4e49-858d-dd7f3309362a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:36.790227 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b925b6b3-f41b-4e49-858d-dd7f3309362a None None] MFA Rules not processed for user `087adcbf737843db97dabfa9708484c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:08:36.791500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b925b6b3-f41b-4e49-858d-dd7f3309362a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:36.874976 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 667/1330] 10.222.0.48 () {58 vars in 1061 bytes} [Thu Jun 16 16:08:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:08:36.884794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c0746-2deb-459a-accf-644b9fbfccd9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:08:36.886303 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-815c0746-2deb-459a-accf-644b9fbfccd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:36.917636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:36.996856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c0746-2deb-459a-accf-644b9fbfccd9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:08:37.072350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d8730-8104-4d14-b4ae-6c7b6f4cad38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:08:37.073006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d8730-8104-4d14-b4ae-6c7b6f4cad38 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:37.073292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d8730-8104-4d14-b4ae-6c7b6f4cad38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:37.073573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d8730-8104-4d14-b4ae-6c7b6f4cad38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:37.075265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-289d8730-8104-4d14-b4ae-6c7b6f4cad38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:37.178357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:37.210484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d8730-8104-4d14-b4ae-6c7b6f4cad38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:08:37.211938 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d8730-8104-4d14-b4ae-6c7b6f4cad38 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:08:37.230392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 664/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:08:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:08:40.066993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45172b25-d13e-4bfa-910f-ae75501e7626 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:40.067633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45172b25-d13e-4bfa-910f-ae75501e7626 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:40.067633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45172b25-d13e-4bfa-910f-ae75501e7626 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:40.068920 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 668/1332] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:08:40.074084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605086d9-28f6-4a10-af14-d991d6816b7d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:40.074558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605086d9-28f6-4a10-af14-d991d6816b7d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:40.074680 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605086d9-28f6-4a10-af14-d991d6816b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:40.141188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-605086d9-28f6-4a10-af14-d991d6816b7d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:08:40.143136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-605086d9-28f6-4a10-af14-d991d6816b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:40.239545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 665/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:08:40.275656 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45172b25-d13e-4bfa-910f-ae75501e7626 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:08:40.277184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-45172b25-d13e-4bfa-910f-ae75501e7626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:40.347682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:40.383936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45172b25-d13e-4bfa-910f-ae75501e7626 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:08:40.460361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99507d-0db4-4d72-a20c-533875406aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:08:40.461019 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99507d-0db4-4d72-a20c-533875406aad service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:40.461306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99507d-0db4-4d72-a20c-533875406aad service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:40.461588 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99507d-0db4-4d72-a20c-533875406aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:40.463278 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cc99507d-0db4-4d72-a20c-533875406aad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:40.573616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99507d-0db4-4d72-a20c-533875406aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:08:40.575097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99507d-0db4-4d72-a20c-533875406aad service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:08:40.585194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:40.593795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 669/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:08:42.802025 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6296-4cfd-401d-b294-e0062a49e88c None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:42.802588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6296-4cfd-401d-b294-e0062a49e88c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:42.802687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c6296-4cfd-401d-b294-e0062a49e88c None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:42.804012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 666/1335] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:08:42.809211 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca7626-06fe-463b-bb09-f9394a0ba71f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:42.809630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca7626-06fe-463b-bb09-f9394a0ba71f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:42.809766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca7626-06fe-463b-bb09-f9394a0ba71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:42.875113 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-feca7626-06fe-463b-bb09-f9394a0ba71f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:08:42.876881 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-feca7626-06fe-463b-bb09-f9394a0ba71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:42.977451 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 670/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:08:43.017531 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c6296-4cfd-401d-b294-e0062a49e88c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:08:43.019108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f90c6296-4cfd-401d-b294-e0062a49e88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:43.060466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:43.123987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c6296-4cfd-401d-b294-e0062a49e88c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:08:43.196307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d9535-233c-4a87-91b5-4d21d64daece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:08:43.196953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d9535-233c-4a87-91b5-4d21d64daece service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:43.197234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d9535-233c-4a87-91b5-4d21d64daece service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:43.197507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d9535-233c-4a87-91b5-4d21d64daece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:43.199168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bb8d9535-233c-4a87-91b5-4d21d64daece service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:43.284308 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:43.310872 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d9535-233c-4a87-91b5-4d21d64daece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:08:43.312351 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d9535-233c-4a87-91b5-4d21d64daece service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:08:43.331330 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 667/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:08:45.954756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b8d6f-1758-41bc-b1cc-436290395332 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:45.955315 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b8d6f-1758-41bc-b1cc-436290395332 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:45.955315 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b8d6f-1758-41bc-b1cc-436290395332 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:45.956777 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 671/1338] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:08:45.962035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb535833-b326-43d3-a401-f9007efe10b5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:45.962459 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb535833-b326-43d3-a401-f9007efe10b5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:45.962626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb535833-b326-43d3-a401-f9007efe10b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:46.028849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-fb535833-b326-43d3-a401-f9007efe10b5 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:08:46.030070 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fb535833-b326-43d3-a401-f9007efe10b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:46.125812 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 668/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:08:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:08:46.162955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b8d6f-1758-41bc-b1cc-436290395332 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:08:46.164493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-883b8d6f-1758-41bc-b1cc-436290395332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:46.241390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:46.270662 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b8d6f-1758-41bc-b1cc-436290395332 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:08:46.346466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fb9e5-e20c-4ada-bbd9-a328b9bb111f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:08:46.347324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fb9e5-e20c-4ada-bbd9-a328b9bb111f service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:46.347610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fb9e5-e20c-4ada-bbd9-a328b9bb111f service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:46.347884 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fb9e5-e20c-4ada-bbd9-a328b9bb111f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:46.349526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-902fb9e5-e20c-4ada-bbd9-a328b9bb111f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:46.459237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fb9e5-e20c-4ada-bbd9-a328b9bb111f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:08:46.460675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fb9e5-e20c-4ada-bbd9-a328b9bb111f service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:08:46.479014 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 672/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:08:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:08:50.769813 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea061c4-187d-4728-99af-915e2e7e96c9 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:50.770382 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea061c4-187d-4728-99af-915e2e7e96c9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:50.770382 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea061c4-187d-4728-99af-915e2e7e96c9 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:50.771786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 669/1341] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:08:50.788692 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd54d5-9d85-473f-a938-0891227313a6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:50.789223 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd54d5-9d85-473f-a938-0891227313a6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:50.789329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd54d5-9d85-473f-a938-0891227313a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:50.795587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:50.877120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-76fd54d5-9d85-473f-a938-0891227313a6 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:08:50.878331 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-76fd54d5-9d85-473f-a938-0891227313a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:51.005624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 673/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:08:51.044645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea061c4-187d-4728-99af-915e2e7e96c9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:08:51.046800 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bea061c4-187d-4728-99af-915e2e7e96c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:51.102989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:08:51.151689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea061c4-187d-4728-99af-915e2e7e96c9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:08:51.155377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce6f9b-7e90-47ec-a690-1e75ec844991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:08:51.156027 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce6f9b-7e90-47ec-a690-1e75ec844991 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:51.156313 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce6f9b-7e90-47ec-a690-1e75ec844991 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:51.156594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce6f9b-7e90-47ec-a690-1e75ec844991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:51.167126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce6f9b-7e90-47ec-a690-1e75ec844991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:08:51.168577 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce6f9b-7e90-47ec-a690-1e75ec844991 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:08:51.179445 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 670/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:08:54.068082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da66779-0010-47f1-b95e-badd76795c6b None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:54.068620 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da66779-0010-47f1-b95e-badd76795c6b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:54.068773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da66779-0010-47f1-b95e-badd76795c6b None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:54.070967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 674/1344] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:08:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:08:54.076159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c2de5-529b-42ff-be07-01cf2ae443ab None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:54.076621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c2de5-529b-42ff-be07-01cf2ae443ab None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:54.076729 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c2de5-529b-42ff-be07-01cf2ae443ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:54.105777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0d8c2de5-529b-42ff-be07-01cf2ae443ab None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:08:54.107008 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0d8c2de5-529b-42ff-be07-01cf2ae443ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:54.194683 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 671/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:08:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:08:54.233768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da66779-0010-47f1-b95e-badd76795c6b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:08:54.236194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7da66779-0010-47f1-b95e-badd76795c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:54.249797 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da66779-0010-47f1-b95e-badd76795c6b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:08:54.254604 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64737a27-06e3-4d8d-8766-5a26a5b447c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:08:54.255280 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64737a27-06e3-4d8d-8766-5a26a5b447c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:54.255566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64737a27-06e3-4d8d-8766-5a26a5b447c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:54.255869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64737a27-06e3-4d8d-8766-5a26a5b447c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:54.265833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64737a27-06e3-4d8d-8766-5a26a5b447c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:08:54.268331 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64737a27-06e3-4d8d-8766-5a26a5b447c2 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:08:54.279883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 675/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:08:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:08:58.751116 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111da1b4-d2c7-482c-8a1e-7035f23bceda None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:58.751904 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111da1b4-d2c7-482c-8a1e-7035f23bceda None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:58.752060 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111da1b4-d2c7-482c-8a1e-7035f23bceda None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:58.753440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 672/1347] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:08:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:08:58.759081 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db72dc-ad1a-4260-8038-6ee42b1b3f17 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:58.759535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db72dc-ad1a-4260-8038-6ee42b1b3f17 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:58.759640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db72dc-ad1a-4260-8038-6ee42b1b3f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:58.779104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-81db72dc-ad1a-4260-8038-6ee42b1b3f17 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:08:58.780313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-81db72dc-ad1a-4260-8038-6ee42b1b3f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:08:58.789483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 676/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:08:58.828620 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111da1b4-d2c7-482c-8a1e-7035f23bceda None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:08:58.840487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111da1b4-d2c7-482c-8a1e-7035f23bceda None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:08:58.843993 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164600c-14be-491b-a2a4-a0191de0c07f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:08:58.844695 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164600c-14be-491b-a2a4-a0191de0c07f service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:08:58.844979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164600c-14be-491b-a2a4-a0191de0c07f service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:08:58.845259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164600c-14be-491b-a2a4-a0191de0c07f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:08:58.855054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164600c-14be-491b-a2a4-a0191de0c07f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:08:58.856487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164600c-14be-491b-a2a4-a0191de0c07f service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:08:58.866213 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 673/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:09:04.196087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63d90c-8c99-473f-9df9-4c8aadb48bbe None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:04.196588 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63d90c-8c99-473f-9df9-4c8aadb48bbe None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:04.196705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63d90c-8c99-473f-9df9-4c8aadb48bbe None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:04.198284 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 677/1350] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 16 16:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:04.203476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e484c-381e-44df-b76d-d2f624613555 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:04.204289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e484c-381e-44df-b76d-d2f624613555 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:04.204731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e484c-381e-44df-b76d-d2f624613555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:04.281609 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1e3e484c-381e-44df-b76d-d2f624613555 None None] MFA Rules not processed for user `9e8222d303aa487ca2b5c5bed6124f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:04.283443 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1e3e484c-381e-44df-b76d-d2f624613555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:04.311904 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:09:04.373049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 674/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 16 16:09:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:08.611201 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b923db4-530c-44cd-9f2f-ec51eaa1a0a5 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:08.612081 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b923db4-530c-44cd-9f2f-ec51eaa1a0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:08.612081 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b923db4-530c-44cd-9f2f-ec51eaa1a0a5 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:08.613126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 678/1352] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 16 16:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:08.619262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09185c5f-6286-4930-939c-21d13647f6dc None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:08.620177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09185c5f-6286-4930-939c-21d13647f6dc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:08.620739 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09185c5f-6286-4930-939c-21d13647f6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:08.640262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-09185c5f-6286-4930-939c-21d13647f6dc None None] MFA Rules not processed for user `9e8222d303aa487ca2b5c5bed6124f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:08.641958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-09185c5f-6286-4930-939c-21d13647f6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:08.651623 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 675/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 16 16:09:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:08.773269 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=72 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:09:10.272398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980b8d5-975a-4a40-857d-f756d19f477a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:10.273048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980b8d5-975a-4a40-857d-f756d19f477a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:10.273048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980b8d5-975a-4a40-857d-f756d19f477a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:10.274319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 679/1354] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 16 16:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:10.279346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7723a3-f6d2-4c89-bf0f-d67855eedec9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:10.279772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7723a3-f6d2-4c89-bf0f-d67855eedec9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:10.280159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7723a3-f6d2-4c89-bf0f-d67855eedec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:10.300752 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-8e7723a3-f6d2-4c89-bf0f-d67855eedec9 None None] MFA Rules not processed for user `9e8222d303aa487ca2b5c5bed6124f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:10.301939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8e7723a3-f6d2-4c89-bf0f-d67855eedec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:10.310519 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 676/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 16 16:09:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:14.187690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50935eca-2e2a-443d-8ad2-8b91fc5c2412 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:14.188990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50935eca-2e2a-443d-8ad2-8b91fc5c2412 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:14.189274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50935eca-2e2a-443d-8ad2-8b91fc5c2412 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:14.190955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 680/1356] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:09:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:14.196259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40bd66-aab4-4687-9e4d-9b1d3e2429de None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:14.196697 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40bd66-aab4-4687-9e4d-9b1d3e2429de None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:14.196816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40bd66-aab4-4687-9e4d-9b1d3e2429de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:14.214974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1d40bd66-aab4-4687-9e4d-9b1d3e2429de None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:14.216171 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1d40bd66-aab4-4687-9e4d-9b1d3e2429de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:14.224242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 677/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:14.280239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e72ee-ac5f-49c1-8d86-0b252fb9047f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:14.300222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e72ee-ac5f-49c1-8d86-0b252fb9047f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:14.306906 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e72ee-ac5f-49c1-8d86-0b252fb9047f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:14.310328 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 681/1358] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jun 16 16:09:14 2022] GET /identity => generated 270 bytes in 33 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:14.319396 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f53fa2-1c1e-444c-8901-b8b8b243a413 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:14.319819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f53fa2-1c1e-444c-8901-b8b8b243a413 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:14.320335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f53fa2-1c1e-444c-8901-b8b8b243a413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:14.375820 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-68f53fa2-1c1e-444c-8901-b8b8b243a413 None None] MFA Rules not processed for user `795c029cb14b42b5b0f3987e218d4239`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:14.377156 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-68f53fa2-1c1e-444c-8901-b8b8b243a413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:14.471818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 678/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jun 16 16:09:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:14.480114 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e72ee-ac5f-49c1-8d86-0b252fb9047f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:09:14.495543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e72ee-ac5f-49c1-8d86-0b252fb9047f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:09:14.502533 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7819c63-f329-4ff9-9a71-6c6398411db4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:09:14.503305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7819c63-f329-4ff9-9a71-6c6398411db4 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:14.503742 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7819c63-f329-4ff9-9a71-6c6398411db4 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:14.504069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7819c63-f329-4ff9-9a71-6c6398411db4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:14.513141 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7819c63-f329-4ff9-9a71-6c6398411db4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:09:14.514875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7819c63-f329-4ff9-9a71-6c6398411db4 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:09:14.525033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 682/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:09:16.919346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c2886-35ca-488b-b103-c6c03d18e66f None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:16.919876 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c2886-35ca-488b-b103-c6c03d18e66f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:16.919961 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c2886-35ca-488b-b103-c6c03d18e66f None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:16.921439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 679/1361] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:16.927261 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4e176-0305-46fb-a634-750b88c41e0a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:16.929139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4e176-0305-46fb-a634-750b88c41e0a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:16.929630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4e176-0305-46fb-a634-750b88c41e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:16.949381 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cae4e176-0305-46fb-a634-750b88c41e0a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:16.950887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cae4e176-0305-46fb-a634-750b88c41e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:16.967117 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 683/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:17.009478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c2886-35ca-488b-b103-c6c03d18e66f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:09:17.025598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c2886-35ca-488b-b103-c6c03d18e66f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:09:17.032194 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b19a23-97e3-4b96-9c5b-f94d79999b42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:09:17.032971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b19a23-97e3-4b96-9c5b-f94d79999b42 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:17.033170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b19a23-97e3-4b96-9c5b-f94d79999b42 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:17.033452 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b19a23-97e3-4b96-9c5b-f94d79999b42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:17.043048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b19a23-97e3-4b96-9c5b-f94d79999b42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:09:17.044677 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b19a23-97e3-4b96-9c5b-f94d79999b42 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:09:17.060431 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 680/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:09:19.535329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ce491-2753-4181-8a93-a537a96a4dda None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:19.535872 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ce491-2753-4181-8a93-a537a96a4dda None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:19.535974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ce491-2753-4181-8a93-a537a96a4dda None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:19.537360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 684/1364] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:19.542628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3a9d3-015f-4c12-afb9-df50b91c7c66 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:19.543108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3a9d3-015f-4c12-afb9-df50b91c7c66 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:19.543211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3a9d3-015f-4c12-afb9-df50b91c7c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:19.561436 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-76a3a9d3-015f-4c12-afb9-df50b91c7c66 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:19.562934 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-76a3a9d3-015f-4c12-afb9-df50b91c7c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:19.570891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 681/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:19.615687 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd8d3-5b65-470a-bb0e-7e7ad365fe54 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:19.615973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd8d3-5b65-470a-bb0e-7e7ad365fe54 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:19.616253 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd8d3-5b65-470a-bb0e-7e7ad365fe54 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:19.617662 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 685/1366] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jun 16 16:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:19.623029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95115437-9781-4720-b390-f76ec0ca6b8a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:19.623415 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95115437-9781-4720-b390-f76ec0ca6b8a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:19.623757 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95115437-9781-4720-b390-f76ec0ca6b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:19.643362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-95115437-9781-4720-b390-f76ec0ca6b8a None None] MFA Rules not processed for user `795c029cb14b42b5b0f3987e218d4239`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:19.644659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-95115437-9781-4720-b390-f76ec0ca6b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:19.654165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 682/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jun 16 16:09:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:09:19.661988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bd8d3-5b65-470a-bb0e-7e7ad365fe54 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:09:19.677003 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bd8d3-5b65-470a-bb0e-7e7ad365fe54 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:09:19.682567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9f8cd-451b-4ae4-984e-f1b6a85c1ba4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:09:19.683310 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9f8cd-451b-4ae4-984e-f1b6a85c1ba4 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:19.683667 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9f8cd-451b-4ae4-984e-f1b6a85c1ba4 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:19.684017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9f8cd-451b-4ae4-984e-f1b6a85c1ba4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:19.693810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9f8cd-451b-4ae4-984e-f1b6a85c1ba4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:09:19.695428 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9f8cd-451b-4ae4-984e-f1b6a85c1ba4 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:09:19.705745 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 686/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:09:21.964640 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e085ccc-ff4d-4da5-8b0b-f3801ecc3a75 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:21.965234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e085ccc-ff4d-4da5-8b0b-f3801ecc3a75 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:21.965234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e085ccc-ff4d-4da5-8b0b-f3801ecc3a75 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:21.966650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 683/1369] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:21.972447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e4bb5-fec6-4f25-ab0a-6390859303a3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:21.972928 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e4bb5-fec6-4f25-ab0a-6390859303a3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:21.973235 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e4bb5-fec6-4f25-ab0a-6390859303a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:21.992637 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-654e4bb5-fec6-4f25-ab0a-6390859303a3 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:21.993967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-654e4bb5-fec6-4f25-ab0a-6390859303a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:22.002854 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 687/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:22.049813 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e085ccc-ff4d-4da5-8b0b-f3801ecc3a75 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:09:22.065621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e085ccc-ff4d-4da5-8b0b-f3801ecc3a75 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:09:22.071270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d0bad-dc35-4bf9-828a-521edf6cb5f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:09:22.072049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d0bad-dc35-4bf9-828a-521edf6cb5f4 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:22.072440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d0bad-dc35-4bf9-828a-521edf6cb5f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:22.072825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d0bad-dc35-4bf9-828a-521edf6cb5f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:22.081794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d0bad-dc35-4bf9-828a-521edf6cb5f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:09:22.083545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d0bad-dc35-4bf9-828a-521edf6cb5f4 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:09:22.094315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 684/1371] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:09:22.564127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51f2b8-db8f-42d7-b9ce-dc894cb23593 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:22.564865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51f2b8-db8f-42d7-b9ce-dc894cb23593 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:22.565271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51f2b8-db8f-42d7-b9ce-dc894cb23593 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:22.567078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 688/1372] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:09:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:22.572237 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a59a0-fefc-4838-8a4d-6b8e660a9a53 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:22.572533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a59a0-fefc-4838-8a4d-6b8e660a9a53 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:22.572816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a59a0-fefc-4838-8a4d-6b8e660a9a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:22.592083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-bf5a59a0-fefc-4838-8a4d-6b8e660a9a53 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:22.593290 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bf5a59a0-fefc-4838-8a4d-6b8e660a9a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:22.602462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 685/1373] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:22.887037 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03679d5a-cd2a-4c35-ae60-ac4843f698c2 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:22.887344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03679d5a-cd2a-4c35-ae60-ac4843f698c2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:22.887628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03679d5a-cd2a-4c35-ae60-ac4843f698c2 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:22.888994 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 689/1374] 10.222.0.48 () {54 vars in 963 bytes} [Thu Jun 16 16:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:22.894526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2e4d5-4b7a-4902-be78-b6c436c10c0e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:22.894935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2e4d5-4b7a-4902-be78-b6c436c10c0e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:22.895317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2e4d5-4b7a-4902-be78-b6c436c10c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:22.904467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:09:22.956100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-85e2e4d5-4b7a-4902-be78-b6c436c10c0e None None] MFA Rules not processed for user `65e8905bab4c47f9a5fb374ef0377983`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:22.957658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-85e2e4d5-4b7a-4902-be78-b6c436c10c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:23.028546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 686/1375] 10.222.0.48 () {58 vars in 1060 bytes} [Thu Jun 16 16:09:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:09:23.038075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03679d5a-cd2a-4c35-ae60-ac4843f698c2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:09:23.051000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03679d5a-cd2a-4c35-ae60-ac4843f698c2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:09:23.056300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c954b-5426-4c3f-8d99-b21e8ab3cca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:09:23.058493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c954b-5426-4c3f-8d99-b21e8ab3cca4 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:23.059044 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c954b-5426-4c3f-8d99-b21e8ab3cca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:23.063631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c954b-5426-4c3f-8d99-b21e8ab3cca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:23.075495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c954b-5426-4c3f-8d99-b21e8ab3cca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:09:23.076932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c954b-5426-4c3f-8d99-b21e8ab3cca4 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:09:23.087134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 690/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:09:24.353344 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac575ca5-6103-4e41-b103-4cd9466c10b4 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:24.353959 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac575ca5-6103-4e41-b103-4cd9466c10b4 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:24.353959 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac575ca5-6103-4e41-b103-4cd9466c10b4 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:24.355325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 687/1377] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:24.361441 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce792990-5cb4-4ca5-a51d-34c8af7ed64e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:24.361892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce792990-5cb4-4ca5-a51d-34c8af7ed64e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:24.362098 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce792990-5cb4-4ca5-a51d-34c8af7ed64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:24.382184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ce792990-5cb4-4ca5-a51d-34c8af7ed64e None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:24.383575 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ce792990-5cb4-4ca5-a51d-34c8af7ed64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:24.393064 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 691/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:09:24.452054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac575ca5-6103-4e41-b103-4cd9466c10b4 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:09:24.479725 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac575ca5-6103-4e41-b103-4cd9466c10b4 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:09:24.487731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf20ae-3153-4667-800c-0cd22b847a1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:09:24.488400 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf20ae-3153-4667-800c-0cd22b847a1c service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:24.488685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf20ae-3153-4667-800c-0cd22b847a1c service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:24.489020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf20ae-3153-4667-800c-0cd22b847a1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:24.499245 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf20ae-3153-4667-800c-0cd22b847a1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:09:24.501799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf20ae-3153-4667-800c-0cd22b847a1c service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:09:24.511748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 688/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:09:26.727298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb2c2b-be45-4274-aff2-39cd5c2783b4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:26.728121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb2c2b-be45-4274-aff2-39cd5c2783b4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:26.728582 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb2c2b-be45-4274-aff2-39cd5c2783b4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:26.731230 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 692/1380] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:09:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:26.742552 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb663958-bde5-4203-8ffe-154b30601a63 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:26.743473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb663958-bde5-4203-8ffe-154b30601a63 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:26.744526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb663958-bde5-4203-8ffe-154b30601a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:26.773858 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-cb663958-bde5-4203-8ffe-154b30601a63 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:26.775818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cb663958-bde5-4203-8ffe-154b30601a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:26.797678 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 689/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:26.836747 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb2c2b-be45-4274-aff2-39cd5c2783b4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:09:26.858746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb2c2b-be45-4274-aff2-39cd5c2783b4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:09:26.869068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd10545-b0f6-4330-92d6-89ecc66ea66a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:09:26.869732 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd10545-b0f6-4330-92d6-89ecc66ea66a service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:26.870275 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd10545-b0f6-4330-92d6-89ecc66ea66a service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:26.870610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd10545-b0f6-4330-92d6-89ecc66ea66a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:26.880421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd10545-b0f6-4330-92d6-89ecc66ea66a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:09:26.882015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd10545-b0f6-4330-92d6-89ecc66ea66a service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:09:26.893775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 693/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:09:29.113236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbebd9-d8a2-406d-8b7b-6d6e0e44065a None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:29.113780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbebd9-d8a2-406d-8b7b-6d6e0e44065a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:29.113780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbebd9-d8a2-406d-8b7b-6d6e0e44065a None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:29.115103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 690/1383] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:29.120300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4676bd-4c68-414a-9b97-f279bfbdae76 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:29.120742 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4676bd-4c68-414a-9b97-f279bfbdae76 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:29.120866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4676bd-4c68-414a-9b97-f279bfbdae76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:29.139689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6e4676bd-4c68-414a-9b97-f279bfbdae76 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:29.141091 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6e4676bd-4c68-414a-9b97-f279bfbdae76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:29.149121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 694/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:29.193877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbebd9-d8a2-406d-8b7b-6d6e0e44065a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:09:29.209122 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbebd9-d8a2-406d-8b7b-6d6e0e44065a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:09:29.214719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c87209-b2b6-4139-b272-4593867ff979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:09:29.215368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c87209-b2b6-4139-b272-4593867ff979 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:29.215655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c87209-b2b6-4139-b272-4593867ff979 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:29.215938 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c87209-b2b6-4139-b272-4593867ff979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:29.225437 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c87209-b2b6-4139-b272-4593867ff979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:09:29.227070 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c87209-b2b6-4139-b272-4593867ff979 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:09:29.238207 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 691/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:09:31.419883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d990d8-06bd-4d2b-bb17-368c49371d49 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:31.420564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d990d8-06bd-4d2b-bb17-368c49371d49 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:31.420564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d990d8-06bd-4d2b-bb17-368c49371d49 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:31.421799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 695/1386] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:31.428292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad028d5-7da4-476f-a23a-00ce0e38a5c7 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:31.428784 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad028d5-7da4-476f-a23a-00ce0e38a5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:31.429333 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad028d5-7da4-476f-a23a-00ce0e38a5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:31.466790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5ad028d5-7da4-476f-a23a-00ce0e38a5c7 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:31.474158 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5ad028d5-7da4-476f-a23a-00ce0e38a5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:31.485181 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 692/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:31.535076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d990d8-06bd-4d2b-bb17-368c49371d49 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:09:31.552500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d990d8-06bd-4d2b-bb17-368c49371d49 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:09:31.559041 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb1739-e622-4408-b447-37c3adbf84b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:09:31.559940 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb1739-e622-4408-b447-37c3adbf84b3 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:31.560363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb1739-e622-4408-b447-37c3adbf84b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:31.560770 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb1739-e622-4408-b447-37c3adbf84b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:31.573574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb1739-e622-4408-b447-37c3adbf84b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:09:31.575995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb1739-e622-4408-b447-37c3adbf84b3 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:09:31.589912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 696/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:09:34.267883 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc8077-2a16-4ab4-ada9-f9cf802dee4c None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:34.268417 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc8077-2a16-4ab4-ada9-f9cf802dee4c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:34.268586 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc8077-2a16-4ab4-ada9-f9cf802dee4c None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:34.270401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 693/1389] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:09:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:34.276037 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e421b5-b4ae-498c-b18b-8f1b511e584e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:34.276515 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e421b5-b4ae-498c-b18b-8f1b511e584e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:34.276601 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e421b5-b4ae-498c-b18b-8f1b511e584e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:34.299329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-97e421b5-b4ae-498c-b18b-8f1b511e584e None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:34.300614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-97e421b5-b4ae-498c-b18b-8f1b511e584e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:34.308886 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 697/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:34.355173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc8077-2a16-4ab4-ada9-f9cf802dee4c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:09:34.372707 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc8077-2a16-4ab4-ada9-f9cf802dee4c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:09:34.379430 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af839ea3-50a3-48cf-b74b-df1a3e240f23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:09:34.380089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af839ea3-50a3-48cf-b74b-df1a3e240f23 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:34.380377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af839ea3-50a3-48cf-b74b-df1a3e240f23 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:34.380659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af839ea3-50a3-48cf-b74b-df1a3e240f23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:34.389426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af839ea3-50a3-48cf-b74b-df1a3e240f23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:09:34.391654 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af839ea3-50a3-48cf-b74b-df1a3e240f23 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:09:34.402335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 694/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:09:36.641999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb26bb-84b9-47ed-8fc9-bfc3e82a2f2e None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:36.642616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb26bb-84b9-47ed-8fc9-bfc3e82a2f2e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:36.642616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb26bb-84b9-47ed-8fc9-bfc3e82a2f2e None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:36.643868 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 698/1392] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:36.649117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766aae3-371f-450e-82e9-f80fecb3d6df None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:36.649537 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766aae3-371f-450e-82e9-f80fecb3d6df None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:36.649747 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766aae3-371f-450e-82e9-f80fecb3d6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:36.668041 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2766aae3-371f-450e-82e9-f80fecb3d6df None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:36.669539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2766aae3-371f-450e-82e9-f80fecb3d6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:36.678383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 695/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:36.723337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb26bb-84b9-47ed-8fc9-bfc3e82a2f2e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:09:36.738758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb26bb-84b9-47ed-8fc9-bfc3e82a2f2e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:09:36.744294 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56d33e-012b-4722-ab18-2aa52e5ad8ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:09:36.744939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56d33e-012b-4722-ab18-2aa52e5ad8ab service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:36.745846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56d33e-012b-4722-ab18-2aa52e5ad8ab service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:36.746406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56d33e-012b-4722-ab18-2aa52e5ad8ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:36.755706 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56d33e-012b-4722-ab18-2aa52e5ad8ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:09:36.757358 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56d33e-012b-4722-ab18-2aa52e5ad8ab service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:09:36.767685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 699/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:09:38.753680 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69992e-f14e-4312-b661-b1f57bfb9a52 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:38.754222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69992e-f14e-4312-b661-b1f57bfb9a52 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:38.754222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69992e-f14e-4312-b661-b1f57bfb9a52 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:38.755793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 696/1395] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:38.760887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bee5b-9f2c-4c19-99be-10242e566dd7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:38.761297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bee5b-9f2c-4c19-99be-10242e566dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:38.761519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bee5b-9f2c-4c19-99be-10242e566dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:38.779919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5f2bee5b-9f2c-4c19-99be-10242e566dd7 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:38.781793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5f2bee5b-9f2c-4c19-99be-10242e566dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:38.789694 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 700/1396] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:38.845372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca91a1-7114-438b-b253-f70d13a21c1d None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:38.845660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca91a1-7114-438b-b253-f70d13a21c1d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:38.845940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca91a1-7114-438b-b253-f70d13a21c1d None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:38.847331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 697/1397] 10.222.0.48 () {54 vars in 962 bytes} [Thu Jun 16 16:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:38.852772 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48298e05-dcbc-465f-a5be-e0c5a269f5bc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:38.853066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48298e05-dcbc-465f-a5be-e0c5a269f5bc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:38.853350 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48298e05-dcbc-465f-a5be-e0c5a269f5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:38.859551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=55 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:09:38.911185 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-48298e05-dcbc-465f-a5be-e0c5a269f5bc None None] MFA Rules not processed for user `59174974208c469b8bb44d94d0e55427`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:38.912401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-48298e05-dcbc-465f-a5be-e0c5a269f5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:38.950149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8c612-d2e9-44b4-9733-c24b000c9d91 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:38.950506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8c612-d2e9-44b4-9733-c24b000c9d91 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:38.950786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8c612-d2e9-44b4-9733-c24b000c9d91 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:38.952304 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 698/1398] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:09:38.958543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95fec0-1431-4b1e-a273-ec4f0cf301e5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:38.958844 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95fec0-1431-4b1e-a273-ec4f0cf301e5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:38.959129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95fec0-1431-4b1e-a273-ec4f0cf301e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:38.975201 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 701/1399] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Jun 16 16:09:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:38.977629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6b95fec0-1431-4b1e-a273-ec4f0cf301e5 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:38.978877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6b95fec0-1431-4b1e-a273-ec4f0cf301e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:38.982670 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48298e05-dcbc-465f-a5be-e0c5a269f5bc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:09:38.987091 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 699/1400] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:09:38.993768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48298e05-dcbc-465f-a5be-e0c5a269f5bc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:09:38.997356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426af971-238c-47a8-8a79-30c6fb3b0439 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59174974208c469b8bb44d94d0e55427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:09:38.997979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426af971-238c-47a8-8a79-30c6fb3b0439 service glance] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:38.998258 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426af971-238c-47a8-8a79-30c6fb3b0439 service glance] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:38.998570 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426af971-238c-47a8-8a79-30c6fb3b0439 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:39.008167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426af971-238c-47a8-8a79-30c6fb3b0439 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:09:39.009541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426af971-238c-47a8-8a79-30c6fb3b0439 service glance] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:09:39.019742 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 702/1401] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:09:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:09:39.032208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95fec0-1431-4b1e-a273-ec4f0cf301e5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:09:39.044898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95fec0-1431-4b1e-a273-ec4f0cf301e5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:09:39.050729 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705eb8d-4567-4096-a486-dc01e8305c5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:09:39.051416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705eb8d-4567-4096-a486-dc01e8305c5f service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:39.051701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705eb8d-4567-4096-a486-dc01e8305c5f service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:39.051980 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705eb8d-4567-4096-a486-dc01e8305c5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:39.062266 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705eb8d-4567-4096-a486-dc01e8305c5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:09:39.064062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705eb8d-4567-4096-a486-dc01e8305c5f service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:09:39.075101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 700/1402] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:09:39.765350 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dda00-98be-4e5b-8cfb-5c07a58bf24e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:39.765910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dda00-98be-4e5b-8cfb-5c07a58bf24e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:39.765910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dda00-98be-4e5b-8cfb-5c07a58bf24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:39.816463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6b0dda00-98be-4e5b-8cfb-5c07a58bf24e None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:39.817774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6b0dda00-98be-4e5b-8cfb-5c07a58bf24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:39.881977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 703/1403] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 16 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:39.923915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798a8d8-ab31-464a-9889-e6213892fd1d None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:39.924429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798a8d8-ab31-464a-9889-e6213892fd1d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:39.924526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798a8d8-ab31-464a-9889-e6213892fd1d None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:39.925934 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 701/1404] 10.222.0.48 () {54 vars in 942 bytes} [Thu Jun 16 16:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:39.937325 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecc656-63a4-4094-a554-cb633c5d586d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:39.937620 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecc656-63a4-4094-a554-cb633c5d586d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:39.937898 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecc656-63a4-4094-a554-cb633c5d586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:40.001491 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-62ecc656-63a4-4094-a554-cb633c5d586d None None] MFA Rules not processed for user `a8527cbb8efe43d7bb297d779929a50e`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:40.003296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-62ecc656-63a4-4094-a554-cb633c5d586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:40.015642 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:09:40.086085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 704/1405] 10.222.0.48 () {58 vars in 1039 bytes} [Thu Jun 16 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:40.096025 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798a8d8-ab31-464a-9889-e6213892fd1d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:09:40.114164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798a8d8-ab31-464a-9889-e6213892fd1d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:09:40.119302 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c96d6-61e4-4d25-b43d-cea49b51c7df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:09:40.119947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c96d6-61e4-4d25-b43d-cea49b51c7df service swift] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:40.120238 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c96d6-61e4-4d25-b43d-cea49b51c7df service swift] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:40.120521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c96d6-61e4-4d25-b43d-cea49b51c7df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:40.129860 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c96d6-61e4-4d25-b43d-cea49b51c7df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:09:40.131483 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c96d6-61e4-4d25-b43d-cea49b51c7df service swift] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:09:40.139709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 702/1406] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:09:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 16:09:41.332504 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af028e3c-1a5d-420b-8577-019a1856b2b8 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:41.333288 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af028e3c-1a5d-420b-8577-019a1856b2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:41.333798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af028e3c-1a5d-420b-8577-019a1856b2b8 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:41.335469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 705/1407] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:09:41.340492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a6bff-6829-4c42-9f42-0453ae60fef6 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:41.341296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a6bff-6829-4c42-9f42-0453ae60fef6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:41.341576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a6bff-6829-4c42-9f42-0453ae60fef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:41.366488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a91a6bff-6829-4c42-9f42-0453ae60fef6 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:09:41.366488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a91a6bff-6829-4c42-9f42-0453ae60fef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:09:41.378841 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 703/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:09:41.419871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af028e3c-1a5d-420b-8577-019a1856b2b8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:09:41.437723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af028e3c-1a5d-420b-8577-019a1856b2b8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:09:41.443611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a92218-f2f9-4d62-84c9-c3f3109f2800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:09:41.444372 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a92218-f2f9-4d62-84c9-c3f3109f2800 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:09:41.444731 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a92218-f2f9-4d62-84c9-c3f3109f2800 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:09:41.445086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a92218-f2f9-4d62-84c9-c3f3109f2800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:09:41.454286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a92218-f2f9-4d62-84c9-c3f3109f2800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:09:41.455988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a92218-f2f9-4d62-84c9-c3f3109f2800 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:09:41.467845 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 706/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:09:51.355084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=81 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:09:51.462112 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=33 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:10:02.688661 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59c35a-1f40-4e11-86be-211b88340d6b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:02.689226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59c35a-1f40-4e11-86be-211b88340d6b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:02.689226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59c35a-1f40-4e11-86be-211b88340d6b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:02.690691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 704/1410] 10.222.0.48 () {54 vars in 918 bytes} [Thu Jun 16 16:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:02.695666 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559f9c6-17ce-430b-83d6-30f1bbc9a4c8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:02.696160 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559f9c6-17ce-430b-83d6-30f1bbc9a4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:02.696272 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559f9c6-17ce-430b-83d6-30f1bbc9a4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:02.714288 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7559f9c6-17ce-430b-83d6-30f1bbc9a4c8 None None] MFA Rules not processed for user `9e8222d303aa487ca2b5c5bed6124f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:02.715675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7559f9c6-17ce-430b-83d6-30f1bbc9a4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:02.728114 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 707/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Jun 16 16:10:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:02.743706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd489a-2214-4114-b9d7-bb51430c3325 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:02.743995 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd489a-2214-4114-b9d7-bb51430c3325 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:02.744274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd489a-2214-4114-b9d7-bb51430c3325 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:02.745639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 705/1412] 10.222.0.48 () {54 vars in 918 bytes} [Thu Jun 16 16:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:02.750595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d639e-8f33-4984-94be-4d0292e24efe None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:02.750884 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d639e-8f33-4984-94be-4d0292e24efe None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:02.751162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d639e-8f33-4984-94be-4d0292e24efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:02.774118 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-984d639e-8f33-4984-94be-4d0292e24efe None None] MFA Rules not processed for user `795c029cb14b42b5b0f3987e218d4239`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:02.775364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-984d639e-8f33-4984-94be-4d0292e24efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:02.785404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 708/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Jun 16 16:10:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:05.399869 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84416505-a115-4830-8882-b78d71b5d2ca None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:05.400363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84416505-a115-4830-8882-b78d71b5d2ca None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:05.400495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84416505-a115-4830-8882-b78d71b5d2ca None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:05.401801 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 16:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:05.407266 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec86a8f-2542-406c-a506-390092d06c7a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:05.407700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec86a8f-2542-406c-a506-390092d06c7a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:05.407815 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec86a8f-2542-406c-a506-390092d06c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:05.425920 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-aec86a8f-2542-406c-a506-390092d06c7a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:05.427146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aec86a8f-2542-406c-a506-390092d06c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:05.434773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 16:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:05.478694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84416505-a115-4830-8882-b78d71b5d2ca None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:05.493575 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84416505-a115-4830-8882-b78d71b5d2ca None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:05.499712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d638e8-61c7-4643-9466-8500598a3ee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:05.500346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d638e8-61c7-4643-9466-8500598a3ee3 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:05.500632 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d638e8-61c7-4643-9466-8500598a3ee3 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:05.500912 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d638e8-61c7-4643-9466-8500598a3ee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:05.509415 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d638e8-61c7-4643-9466-8500598a3ee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:05.511077 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d638e8-61c7-4643-9466-8500598a3ee3 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:05.521933 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 707/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:06.501602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5c745-1b47-4d0e-b331-2502c1197690 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:06.502155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5c745-1b47-4d0e-b331-2502c1197690 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:06.502155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5c745-1b47-4d0e-b331-2502c1197690 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:06.503573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 16:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:06.508425 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf82fd9-6289-426b-832d-74d658901289 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:06.508805 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf82fd9-6289-426b-832d-74d658901289 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:06.508990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf82fd9-6289-426b-832d-74d658901289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:06.527562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0bf82fd9-6289-426b-832d-74d658901289 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:06.528780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0bf82fd9-6289-426b-832d-74d658901289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:06.536650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 16:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:06.690001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5c745-1b47-4d0e-b331-2502c1197690 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:06.704427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5c745-1b47-4d0e-b331-2502c1197690 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:06.709681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e9c6f-8c49-4db2-bf0f-83a8803af3f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:06.710312 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e9c6f-8c49-4db2-bf0f-83a8803af3f8 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:06.710622 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e9c6f-8c49-4db2-bf0f-83a8803af3f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:06.710901 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e9c6f-8c49-4db2-bf0f-83a8803af3f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:06.719201 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e9c6f-8c49-4db2-bf0f-83a8803af3f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:06.720778 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e9c6f-8c49-4db2-bf0f-83a8803af3f8 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:06.730021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 711/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:07.664208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1517f06-1260-4b2f-b609-d29fb00bc411 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:07.664738 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1517f06-1260-4b2f-b609-d29fb00bc411 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:07.664738 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1517f06-1260-4b2f-b609-d29fb00bc411 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:07.666053 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 16:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:10:07.671378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb09408-1ef3-4a4b-b57b-42bdadf34b32 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:07.671815 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb09408-1ef3-4a4b-b57b-42bdadf34b32 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:07.671958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb09408-1ef3-4a4b-b57b-42bdadf34b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:07.689962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fcb09408-1ef3-4a4b-b57b-42bdadf34b32 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:07.691176 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fcb09408-1ef3-4a4b-b57b-42bdadf34b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:07.698785 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 16:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:07.851040 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1517f06-1260-4b2f-b609-d29fb00bc411 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:07.865662 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1517f06-1260-4b2f-b609-d29fb00bc411 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:07.870951 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714fc79-6c33-45b5-82a7-49aa2004d53a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:07.871585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714fc79-6c33-45b5-82a7-49aa2004d53a service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:07.871866 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714fc79-6c33-45b5-82a7-49aa2004d53a service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:07.872138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714fc79-6c33-45b5-82a7-49aa2004d53a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:07.880302 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714fc79-6c33-45b5-82a7-49aa2004d53a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:07.881892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714fc79-6c33-45b5-82a7-49aa2004d53a service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:07.891416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 710/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:08.800042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee9beb-5e1f-4e76-9ab3-b309d7af47f4 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:08.800042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee9beb-5e1f-4e76-9ab3-b309d7af47f4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:08.800042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee9beb-5e1f-4e76-9ab3-b309d7af47f4 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:08.801452 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 16:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:08.806776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291b023-f2bd-4e87-8e47-33fb1895d6fe None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:08.807173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291b023-f2bd-4e87-8e47-33fb1895d6fe None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:08.807344 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291b023-f2bd-4e87-8e47-33fb1895d6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:08.826942 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b291b023-f2bd-4e87-8e47-33fb1895d6fe None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:08.828711 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b291b023-f2bd-4e87-8e47-33fb1895d6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:08.836623 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 16:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:08.995160 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee9beb-5e1f-4e76-9ab3-b309d7af47f4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:09.010075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee9beb-5e1f-4e76-9ab3-b309d7af47f4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:09.015624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f2ec1-4e3b-477f-8696-98cf748c9a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:09.016261 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f2ec1-4e3b-477f-8696-98cf748c9a8a service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:09.016548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f2ec1-4e3b-477f-8696-98cf748c9a8a service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:09.016825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f2ec1-4e3b-477f-8696-98cf748c9a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:09.025020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f2ec1-4e3b-477f-8696-98cf748c9a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:09.026631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f2ec1-4e3b-477f-8696-98cf748c9a8a service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:09.036321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 714/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:09.953932 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5959d-3171-4821-9353-5b365b4094a1 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:09.954549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5959d-3171-4821-9353-5b365b4094a1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:09.954662 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5959d-3171-4821-9353-5b365b4094a1 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:09.956487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 16:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:09.961603 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a237e72-6ad0-423a-94c9-f0dc16b89591 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:09.962113 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a237e72-6ad0-423a-94c9-f0dc16b89591 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:09.962230 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a237e72-6ad0-423a-94c9-f0dc16b89591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:09.980650 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4a237e72-6ad0-423a-94c9-f0dc16b89591 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:09.981841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4a237e72-6ad0-423a-94c9-f0dc16b89591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:09.991081 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 16:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:10.150809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5959d-3171-4821-9353-5b365b4094a1 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:10.165691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5959d-3171-4821-9353-5b365b4094a1 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:10.171935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b9404-6276-4a45-80fd-9e8a3a22edf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:10.172579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b9404-6276-4a45-80fd-9e8a3a22edf8 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:10.172866 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b9404-6276-4a45-80fd-9e8a3a22edf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:10.173148 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b9404-6276-4a45-80fd-9e8a3a22edf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:10.181268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b9404-6276-4a45-80fd-9e8a3a22edf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:10.182927 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b9404-6276-4a45-80fd-9e8a3a22edf8 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:10.192691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 713/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:11.073263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a33b42-c24d-4c90-bf37-4db995707bfd None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:11.073908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a33b42-c24d-4c90-bf37-4db995707bfd None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:11.073908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a33b42-c24d-4c90-bf37-4db995707bfd None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:11.075242 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 16:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:11.080502 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5329a8-74c3-4973-b73f-a8fe114b90f6 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:11.080945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5329a8-74c3-4973-b73f-a8fe114b90f6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:11.081072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5329a8-74c3-4973-b73f-a8fe114b90f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:11.098848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-4f5329a8-74c3-4973-b73f-a8fe114b90f6 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:11.100046 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4f5329a8-74c3-4973-b73f-a8fe114b90f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:11.108508 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 16:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:11.272935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a33b42-c24d-4c90-bf37-4db995707bfd None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:11.290309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a33b42-c24d-4c90-bf37-4db995707bfd None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:11.297141 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306ff94-e522-45ef-9c38-381efd9bfe83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:11.297772 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306ff94-e522-45ef-9c38-381efd9bfe83 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:11.298057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306ff94-e522-45ef-9c38-381efd9bfe83 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:11.298336 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306ff94-e522-45ef-9c38-381efd9bfe83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:11.308368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306ff94-e522-45ef-9c38-381efd9bfe83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:11.309964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306ff94-e522-45ef-9c38-381efd9bfe83 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:11.321167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 717/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:12.183608 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44883575-42e9-4794-b8ed-94d9172f0cc6 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:12.184176 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44883575-42e9-4794-b8ed-94d9172f0cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:12.184176 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44883575-42e9-4794-b8ed-94d9172f0cc6 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:12.186166 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 16:10:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:12.191553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213973e-7a44-4496-be01-a515efc9ee35 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:12.191975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213973e-7a44-4496-be01-a515efc9ee35 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:12.192104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213973e-7a44-4496-be01-a515efc9ee35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:12.210217 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9213973e-7a44-4496-be01-a515efc9ee35 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:12.211432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9213973e-7a44-4496-be01-a515efc9ee35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:12.219140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 16:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:12.370136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44883575-42e9-4794-b8ed-94d9172f0cc6 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:12.385796 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44883575-42e9-4794-b8ed-94d9172f0cc6 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:12.392286 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561f5a2-f709-4a5a-8550-a0721009002d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:12.392925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561f5a2-f709-4a5a-8550-a0721009002d service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:12.393215 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561f5a2-f709-4a5a-8550-a0721009002d service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:12.393497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561f5a2-f709-4a5a-8550-a0721009002d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:12.401826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561f5a2-f709-4a5a-8550-a0721009002d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:12.403448 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561f5a2-f709-4a5a-8550-a0721009002d service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:12.413437 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 716/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:13.267138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d6e6c-5d3a-4169-b211-57709769b437 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:13.267665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d6e6c-5d3a-4169-b211-57709769b437 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:13.267665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d6e6c-5d3a-4169-b211-57709769b437 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:13.268991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 16:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:13.274064 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079289c0-5253-468d-aaab-0259c28af7a0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:13.274479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079289c0-5253-468d-aaab-0259c28af7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:13.274659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079289c0-5253-468d-aaab-0259c28af7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:13.293001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-079289c0-5253-468d-aaab-0259c28af7a0 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:13.294209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-079289c0-5253-468d-aaab-0259c28af7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:13.303174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 16:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:13.455554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d6e6c-5d3a-4169-b211-57709769b437 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:13.469975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d6e6c-5d3a-4169-b211-57709769b437 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:13.475577 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc2a0c-f328-45de-b82b-3f65be929822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:13.476217 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc2a0c-f328-45de-b82b-3f65be929822 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:13.476501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc2a0c-f328-45de-b82b-3f65be929822 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:13.476779 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc2a0c-f328-45de-b82b-3f65be929822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:13.485901 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc2a0c-f328-45de-b82b-3f65be929822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:13.487528 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc2a0c-f328-45de-b82b-3f65be929822 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:13.496971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 720/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:14.351958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dae52-7446-4050-915a-5c606bf75334 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:14.352492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dae52-7446-4050-915a-5c606bf75334 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:14.352492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dae52-7446-4050-915a-5c606bf75334 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:14.353828 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 16:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:14.358806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f22d4-c62b-4e15-8fcb-6b1049312ea5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:14.359214 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f22d4-c62b-4e15-8fcb-6b1049312ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:14.359364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f22d4-c62b-4e15-8fcb-6b1049312ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:14.378129 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f98f22d4-c62b-4e15-8fcb-6b1049312ea5 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:14.379392 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f98f22d4-c62b-4e15-8fcb-6b1049312ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:14.387420 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 16:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:14.537194 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dae52-7446-4050-915a-5c606bf75334 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:14.551537 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dae52-7446-4050-915a-5c606bf75334 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:14.556965 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360d662-4eb5-4e01-ae8e-257fb08c7e54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:14.557605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360d662-4eb5-4e01-ae8e-257fb08c7e54 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:14.557895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360d662-4eb5-4e01-ae8e-257fb08c7e54 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:14.558176 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360d662-4eb5-4e01-ae8e-257fb08c7e54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:14.567368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360d662-4eb5-4e01-ae8e-257fb08c7e54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:14.568952 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360d662-4eb5-4e01-ae8e-257fb08c7e54 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:14.579348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 719/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:16.733761 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ae354-6a82-4376-870f-0578282f1643 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:16.734389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ae354-6a82-4376-870f-0578282f1643 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:16.734389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ae354-6a82-4376-870f-0578282f1643 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:16.735819 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 16:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:16.741009 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e687b-dcb2-4f63-a6ec-7454ee7a68af None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:16.741475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e687b-dcb2-4f63-a6ec-7454ee7a68af None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:16.741584 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e687b-dcb2-4f63-a6ec-7454ee7a68af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:16.759095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-068e687b-dcb2-4f63-a6ec-7454ee7a68af None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:16.760289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-068e687b-dcb2-4f63-a6ec-7454ee7a68af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:16.769030 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 16:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:16.807678 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ae354-6a82-4376-870f-0578282f1643 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:16.819115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ae354-6a82-4376-870f-0578282f1643 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:16.822697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469f173-706d-431a-96be-36b653decdc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:16.823341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469f173-706d-431a-96be-36b653decdc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:16.823627 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469f173-706d-431a-96be-36b653decdc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:16.823995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469f173-706d-431a-96be-36b653decdc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:16.834196 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469f173-706d-431a-96be-36b653decdc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:16.835673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469f173-706d-431a-96be-36b653decdc1 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:16.845832 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 723/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:19.161325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d12946-369f-4015-9e6d-31b667f42d82 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:19.161888 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d12946-369f-4015-9e6d-31b667f42d82 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:19.161888 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d12946-369f-4015-9e6d-31b667f42d82 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:19.163317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 16:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:19.168485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4649b0c-99cd-4c39-ba92-9b04ce1eb5c5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:19.168922 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4649b0c-99cd-4c39-ba92-9b04ce1eb5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:19.169196 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4649b0c-99cd-4c39-ba92-9b04ce1eb5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:19.188709 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a4649b0c-99cd-4c39-ba92-9b04ce1eb5c5 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:19.189900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a4649b0c-99cd-4c39-ba92-9b04ce1eb5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:19.197620 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 16:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:19.235484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d12946-369f-4015-9e6d-31b667f42d82 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:19.246144 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d12946-369f-4015-9e6d-31b667f42d82 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:19.252101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd41c5-eef6-4157-90ae-c7e23efd8868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:19.253239 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd41c5-eef6-4157-90ae-c7e23efd8868 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:19.253564 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd41c5-eef6-4157-90ae-c7e23efd8868 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:19.253854 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd41c5-eef6-4157-90ae-c7e23efd8868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:19.267001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd41c5-eef6-4157-90ae-c7e23efd8868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:19.272139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd41c5-eef6-4157-90ae-c7e23efd8868 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:19.278767 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 722/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:21.784379 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493c93f-a248-4409-a72b-d917d6312012 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:21.784949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493c93f-a248-4409-a72b-d917d6312012 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:21.784949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493c93f-a248-4409-a72b-d917d6312012 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:21.786377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 16:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:21.791699 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41910c17-249f-49b3-82c5-bee60f86bfe8 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:21.792128 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41910c17-249f-49b3-82c5-bee60f86bfe8 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:21.792258 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41910c17-249f-49b3-82c5-bee60f86bfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:21.810251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-41910c17-249f-49b3-82c5-bee60f86bfe8 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:21.811737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-41910c17-249f-49b3-82c5-bee60f86bfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:21.819504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 16:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:21.858959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493c93f-a248-4409-a72b-d917d6312012 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:21.869427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493c93f-a248-4409-a72b-d917d6312012 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:21.872932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741fdf0-81eb-4ac8-a8ee-2bcb0bb8b0f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:21.873556 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741fdf0-81eb-4ac8-a8ee-2bcb0bb8b0f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:21.873834 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741fdf0-81eb-4ac8-a8ee-2bcb0bb8b0f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:21.874106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741fdf0-81eb-4ac8-a8ee-2bcb0bb8b0f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:21.882813 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741fdf0-81eb-4ac8-a8ee-2bcb0bb8b0f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:21.884227 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741fdf0-81eb-4ac8-a8ee-2bcb0bb8b0f7 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:21.894029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 726/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:24.159726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b456e-5bb4-4bb1-914d-b8cd5c954ebb None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:24.160280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b456e-5bb4-4bb1-914d-b8cd5c954ebb None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:24.160280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b456e-5bb4-4bb1-914d-b8cd5c954ebb None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:24.161662 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 16:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:24.166857 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e92880-6b14-4668-9526-950f86d2766a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:24.167297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e92880-6b14-4668-9526-950f86d2766a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:24.167405 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e92880-6b14-4668-9526-950f86d2766a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:24.187557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b8e92880-6b14-4668-9526-950f86d2766a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:24.188776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b8e92880-6b14-4668-9526-950f86d2766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:24.196548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 16:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:24.236544 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b456e-5bb4-4bb1-914d-b8cd5c954ebb None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:24.247413 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b456e-5bb4-4bb1-914d-b8cd5c954ebb None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:24.251928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa3f99-7a1d-49c9-bafd-4a76c83756da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:24.252603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa3f99-7a1d-49c9-bafd-4a76c83756da service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:24.252885 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa3f99-7a1d-49c9-bafd-4a76c83756da service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:24.253158 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa3f99-7a1d-49c9-bafd-4a76c83756da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:24.262733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa3f99-7a1d-49c9-bafd-4a76c83756da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:24.264683 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa3f99-7a1d-49c9-bafd-4a76c83756da service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:24.275108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 725/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:10:26.589806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddee1e-7fa3-40b5-81f9-eb11d79ec895 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:26.590336 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddee1e-7fa3-40b5-81f9-eb11d79ec895 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:26.590481 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddee1e-7fa3-40b5-81f9-eb11d79ec895 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:26.592353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 16:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:26.597917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e24c58-9239-4756-b4b5-3541187be48b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:26.598326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e24c58-9239-4756-b4b5-3541187be48b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:26.598518 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e24c58-9239-4756-b4b5-3541187be48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:26.615941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-01e24c58-9239-4756-b4b5-3541187be48b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:26.617145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-01e24c58-9239-4756-b4b5-3541187be48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:26.625095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 16:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:26.663870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddee1e-7fa3-40b5-81f9-eb11d79ec895 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:26.674647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddee1e-7fa3-40b5-81f9-eb11d79ec895 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:26.678079 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d9f36-42f1-4679-a3d4-f1202f824d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:26.678750 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d9f36-42f1-4679-a3d4-f1202f824d5a service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:26.679035 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d9f36-42f1-4679-a3d4-f1202f824d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:26.679311 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d9f36-42f1-4679-a3d4-f1202f824d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:26.688355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d9f36-42f1-4679-a3d4-f1202f824d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:26.689777 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d9f36-42f1-4679-a3d4-f1202f824d5a service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:26.699017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 729/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:28.890028 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc1738-4e64-4245-a2ac-31db5e4392c3 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:28.890656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc1738-4e64-4245-a2ac-31db5e4392c3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:28.890656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc1738-4e64-4245-a2ac-31db5e4392c3 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:28.891978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 16:10:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:28.897125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd163c47-d011-4822-8fb2-cbcd894f1948 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:28.897504 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd163c47-d011-4822-8fb2-cbcd894f1948 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:28.897685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd163c47-d011-4822-8fb2-cbcd894f1948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:28.916142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bd163c47-d011-4822-8fb2-cbcd894f1948 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:28.917339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bd163c47-d011-4822-8fb2-cbcd894f1948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:28.925434 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 16:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:28.963959 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc1738-4e64-4245-a2ac-31db5e4392c3 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:28.975464 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc1738-4e64-4245-a2ac-31db5e4392c3 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:28.979007 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85475377-544b-41ae-b6b6-571968c8266c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:28.979645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85475377-544b-41ae-b6b6-571968c8266c service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:28.979929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85475377-544b-41ae-b6b6-571968c8266c service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:28.980208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85475377-544b-41ae-b6b6-571968c8266c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:28.989641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85475377-544b-41ae-b6b6-571968c8266c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:28.991106 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85475377-544b-41ae-b6b6-571968c8266c service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:29.001252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 728/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:31.227883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd365b69-330c-46f3-bd26-ce82ddcc8513 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:31.228467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd365b69-330c-46f3-bd26-ce82ddcc8513 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:31.228467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd365b69-330c-46f3-bd26-ce82ddcc8513 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:31.229802 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 16:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:31.236141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b68d8-83f1-4863-be11-7f887b1066d2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:31.236589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b68d8-83f1-4863-be11-7f887b1066d2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:31.236700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b68d8-83f1-4863-be11-7f887b1066d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:31.254626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b59b68d8-83f1-4863-be11-7f887b1066d2 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:31.255811 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b59b68d8-83f1-4863-be11-7f887b1066d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:31.263502 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 16:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:10:31.301013 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd365b69-330c-46f3-bd26-ce82ddcc8513 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:31.312248 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd365b69-330c-46f3-bd26-ce82ddcc8513 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:31.315697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1771edd-6c6c-4d92-8a01-cddfffa5eb17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:31.316333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1771edd-6c6c-4d92-8a01-cddfffa5eb17 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:31.316608 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1771edd-6c6c-4d92-8a01-cddfffa5eb17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:31.316878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1771edd-6c6c-4d92-8a01-cddfffa5eb17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:31.325835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1771edd-6c6c-4d92-8a01-cddfffa5eb17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:31.327394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1771edd-6c6c-4d92-8a01-cddfffa5eb17 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:31.336859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 732/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:33.536791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8fd12-156e-45e3-a982-65031dfb6f33 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:33.537344 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8fd12-156e-45e3-a982-65031dfb6f33 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:33.537344 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8fd12-156e-45e3-a982-65031dfb6f33 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:33.538762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 16:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:33.543934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0233a-6357-4991-ba93-e6732ed64e4f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:33.544362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0233a-6357-4991-ba93-e6732ed64e4f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:33.544611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0233a-6357-4991-ba93-e6732ed64e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:33.550722 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=79 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:10:33.564092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-47f0233a-6357-4991-ba93-e6732ed64e4f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:33.565300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-47f0233a-6357-4991-ba93-e6732ed64e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:33.573074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 16:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:33.612038 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8fd12-156e-45e3-a982-65031dfb6f33 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:33.617419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=73 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:10:33.624217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8fd12-156e-45e3-a982-65031dfb6f33 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:33.627654 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed7cdf-1789-4669-a34f-a40a142e861f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:33.628298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed7cdf-1789-4669-a34f-a40a142e861f service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:33.628583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed7cdf-1789-4669-a34f-a40a142e861f service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:33.628860 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed7cdf-1789-4669-a34f-a40a142e861f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:33.638519 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed7cdf-1789-4669-a34f-a40a142e861f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:33.639660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed7cdf-1789-4669-a34f-a40a142e861f service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:33.649133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 731/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:35.821686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db467b06-44f2-4e37-bfe8-de92f9792789 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:35.822215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db467b06-44f2-4e37-bfe8-de92f9792789 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:35.822215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db467b06-44f2-4e37-bfe8-de92f9792789 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:35.823665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 16:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:35.829062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca1aec-7ccc-4921-9b41-d729cda2fead None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:35.829484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca1aec-7ccc-4921-9b41-d729cda2fead None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:35.829635 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca1aec-7ccc-4921-9b41-d729cda2fead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:35.848493 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-4cca1aec-7ccc-4921-9b41-d729cda2fead None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:35.849693 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4cca1aec-7ccc-4921-9b41-d729cda2fead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:35.858111 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 16:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:35.893668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db467b06-44f2-4e37-bfe8-de92f9792789 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:35.904775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db467b06-44f2-4e37-bfe8-de92f9792789 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:35.908263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc35058-0934-48a4-94ba-2f382e433d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:35.908895 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc35058-0934-48a4-94ba-2f382e433d1a service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:35.909179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc35058-0934-48a4-94ba-2f382e433d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:35.909456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc35058-0934-48a4-94ba-2f382e433d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:35.918199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc35058-0934-48a4-94ba-2f382e433d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:35.920378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc35058-0934-48a4-94ba-2f382e433d1a service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:35.929627 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 735/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:38.053914 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2935a-3b6a-49b1-828a-e93e4e891427 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:38.054415 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2935a-3b6a-49b1-828a-e93e4e891427 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:38.054555 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2935a-3b6a-49b1-828a-e93e4e891427 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:38.055867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 16:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:38.061614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534b021-ca9d-496e-8355-7bdef3636803 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:38.062140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534b021-ca9d-496e-8355-7bdef3636803 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:38.062140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534b021-ca9d-496e-8355-7bdef3636803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:38.080897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e534b021-ca9d-496e-8355-7bdef3636803 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:38.082090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e534b021-ca9d-496e-8355-7bdef3636803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:38.089791 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 16:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:38.125992 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2935a-3b6a-49b1-828a-e93e4e891427 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:38.136737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2935a-3b6a-49b1-828a-e93e4e891427 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:38.140387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a378994-3e95-45c4-82a0-d517b7ab3733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:38.141035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a378994-3e95-45c4-82a0-d517b7ab3733 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:38.141322 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a378994-3e95-45c4-82a0-d517b7ab3733 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:38.141602 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a378994-3e95-45c4-82a0-d517b7ab3733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:38.150548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a378994-3e95-45c4-82a0-d517b7ab3733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:38.152062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a378994-3e95-45c4-82a0-d517b7ab3733 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:38.162164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 734/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:10:48.075918 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=11 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:10:48.157939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=14 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:10:58.341321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdaa23-a8bb-45ce-a8f1-0bc45e976593 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:58.341855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdaa23-a8bb-45ce-a8f1-0bc45e976593 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:58.341855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdaa23-a8bb-45ce-a8f1-0bc45e976593 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:58.343268 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 737/1471] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:58.348624 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64f3d4-cd1f-45e4-bdd4-4f0bc3aacfce None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:58.349068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64f3d4-cd1f-45e4-bdd4-4f0bc3aacfce None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:58.349173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64f3d4-cd1f-45e4-bdd4-4f0bc3aacfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:58.366955 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ea64f3d4-cd1f-45e4-bdd4-4f0bc3aacfce None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:58.368168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ea64f3d4-cd1f-45e4-bdd4-4f0bc3aacfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:58.376915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 735/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:58.425106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cf6d8-1960-421a-a7a6-690b2485ca2c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:58.425401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cf6d8-1960-421a-a7a6-690b2485ca2c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:58.425684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cf6d8-1960-421a-a7a6-690b2485ca2c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:58.427081 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 738/1473] 10.222.0.48 () {54 vars in 962 bytes} [Thu Jun 16 16:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:10:58.432097 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21717c75-c336-4dfa-a6db-240d74d641b2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:58.432391 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21717c75-c336-4dfa-a6db-240d74d641b2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:58.432673 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21717c75-c336-4dfa-a6db-240d74d641b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:58.451909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-21717c75-c336-4dfa-a6db-240d74d641b2 None None] MFA Rules not processed for user `59174974208c469b8bb44d94d0e55427`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:10:58.453099 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-21717c75-c336-4dfa-a6db-240d74d641b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:10:58.459522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 736/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Jun 16 16:10:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:10:58.467419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cf6d8-1960-421a-a7a6-690b2485ca2c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:10:58.478184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cf6d8-1960-421a-a7a6-690b2485ca2c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:10:58.481850 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8ce2a-61e0-452c-8774-5142c298d94b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59174974208c469b8bb44d94d0e55427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:10:58.482526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8ce2a-61e0-452c-8774-5142c298d94b service glance] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:10:58.482816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8ce2a-61e0-452c-8774-5142c298d94b service glance] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:10:58.483095 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8ce2a-61e0-452c-8774-5142c298d94b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:10:58.492121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8ce2a-61e0-452c-8774-5142c298d94b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:10:58.493541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8ce2a-61e0-452c-8774-5142c298d94b service glance] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:10:58.503550 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 739/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:11:00.769491 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25dfe1-a9b2-441f-a5c5-8c3ca36f91e0 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:00.770073 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25dfe1-a9b2-441f-a5c5-8c3ca36f91e0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:00.770073 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25dfe1-a9b2-441f-a5c5-8c3ca36f91e0 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:00.771522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 737/1476] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:11:00.776854 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3408ef-2f1d-427d-b97f-0262f075d2aa None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:00.777304 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3408ef-2f1d-427d-b97f-0262f075d2aa None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:00.777410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3408ef-2f1d-427d-b97f-0262f075d2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:00.795879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4e3408ef-2f1d-427d-b97f-0262f075d2aa None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:11:00.797066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4e3408ef-2f1d-427d-b97f-0262f075d2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:11:00.804747 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 740/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:11:00.831332 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25dfe1-a9b2-441f-a5c5-8c3ca36f91e0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:11:00.844598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25dfe1-a9b2-441f-a5c5-8c3ca36f91e0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:11:00.849100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91d5ef-f97f-4a92-8da2-39eba1d3b946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:11:00.849753 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91d5ef-f97f-4a92-8da2-39eba1d3b946 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:00.850069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91d5ef-f97f-4a92-8da2-39eba1d3b946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:00.850349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91d5ef-f97f-4a92-8da2-39eba1d3b946 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:00.851114 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91d5ef-f97f-4a92-8da2-39eba1d3b946 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:11:00.852890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: WARNING py.warnings [None req-dd91d5ef-f97f-4a92-8da2-39eba1d3b946 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:11:00.852890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: warnings.warn(msg) Jun 16 16:11:00.852890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: Jun 16 16:11:00.854043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91d5ef-f97f-4a92-8da2-39eba1d3b946 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:11:00.873843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 738/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 16 16:11:00 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:11:03.075909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e4ba6-2aea-4574-a993-89b704a6b62c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:03.076441 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e4ba6-2aea-4574-a993-89b704a6b62c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:03.076538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e4ba6-2aea-4574-a993-89b704a6b62c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:03.077887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 741/1479] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:11:03.083212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7192881-d5ea-4cb6-ad93-f5ec08c792dc None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:03.083614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7192881-d5ea-4cb6-ad93-f5ec08c792dc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:03.083772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7192881-d5ea-4cb6-ad93-f5ec08c792dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:03.101911 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b7192881-d5ea-4cb6-ad93-f5ec08c792dc None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:11:03.103157 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b7192881-d5ea-4cb6-ad93-f5ec08c792dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:11:03.111776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 739/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:11:03.154983 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e4ba6-2aea-4574-a993-89b704a6b62c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:11:03.169937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e4ba6-2aea-4574-a993-89b704a6b62c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:11:03.175322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484a769-eb70-4f52-a269-7bd1afbb4e7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:11:03.175961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484a769-eb70-4f52-a269-7bd1afbb4e7b service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:03.176244 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484a769-eb70-4f52-a269-7bd1afbb4e7b service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:03.176523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484a769-eb70-4f52-a269-7bd1afbb4e7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:03.184760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484a769-eb70-4f52-a269-7bd1afbb4e7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:11:03.186651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484a769-eb70-4f52-a269-7bd1afbb4e7b service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:11:03.195937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 742/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:11:05.516160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eddf9-5e7f-4a5f-996c-b4d94ccc4878 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:05.516723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eddf9-5e7f-4a5f-996c-b4d94ccc4878 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:05.516723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eddf9-5e7f-4a5f-996c-b4d94ccc4878 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:05.518079 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 740/1482] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:11:05.523386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efb18a-bdb7-476d-888c-2e05e1234764 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:05.523821 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efb18a-bdb7-476d-888c-2e05e1234764 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:05.523937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efb18a-bdb7-476d-888c-2e05e1234764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:05.542004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-11efb18a-bdb7-476d-888c-2e05e1234764 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:11:05.543355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-11efb18a-bdb7-476d-888c-2e05e1234764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:11:05.551939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 743/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:11:05.588515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9eddf9-5e7f-4a5f-996c-b4d94ccc4878 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:11:05.599412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9eddf9-5e7f-4a5f-996c-b4d94ccc4878 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:11:05.602888 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71aa58-6ba1-4687-b95f-0e864ca6867d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:11:05.603529 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71aa58-6ba1-4687-b95f-0e864ca6867d service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:05.603812 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71aa58-6ba1-4687-b95f-0e864ca6867d service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:05.604089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71aa58-6ba1-4687-b95f-0e864ca6867d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:05.613804 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71aa58-6ba1-4687-b95f-0e864ca6867d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:11:05.615253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71aa58-6ba1-4687-b95f-0e864ca6867d service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:11:05.625136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 741/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:11:07.872966 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd07ee8-f219-46af-adc2-e8a002831f74 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:07.873539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd07ee8-f219-46af-adc2-e8a002831f74 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:07.873539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd07ee8-f219-46af-adc2-e8a002831f74 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:07.874946 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 744/1485] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:11:07.880269 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ff5fb-af89-44dd-93e0-24d22c50bb68 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:07.880716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ff5fb-af89-44dd-93e0-24d22c50bb68 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:07.880846 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ff5fb-af89-44dd-93e0-24d22c50bb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:07.898243 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-cc0ff5fb-af89-44dd-93e0-24d22c50bb68 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:11:07.899473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cc0ff5fb-af89-44dd-93e0-24d22c50bb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:11:07.907714 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 742/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:11:07.945522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd07ee8-f219-46af-adc2-e8a002831f74 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:11:07.957048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd07ee8-f219-46af-adc2-e8a002831f74 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:11:07.960606 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab9a6b-e86c-431a-afc3-02b87d868074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:11:07.961245 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab9a6b-e86c-431a-afc3-02b87d868074 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:07.961530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab9a6b-e86c-431a-afc3-02b87d868074 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:07.961809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab9a6b-e86c-431a-afc3-02b87d868074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:07.972064 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab9a6b-e86c-431a-afc3-02b87d868074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:11:07.973503 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab9a6b-e86c-431a-afc3-02b87d868074 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:11:07.984167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 745/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:11:10.217437 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f096f-86a8-4259-b401-fd67afb68e3b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:10.218004 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f096f-86a8-4259-b401-fd67afb68e3b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:10.218004 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f096f-86a8-4259-b401-fd67afb68e3b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:10.219419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 743/1488] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:11:10.224837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ae375-7c4e-44f0-8cf7-2e82f67cd18e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:10.225302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ae375-7c4e-44f0-8cf7-2e82f67cd18e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:10.225459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ae375-7c4e-44f0-8cf7-2e82f67cd18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:10.244025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-aa5ae375-7c4e-44f0-8cf7-2e82f67cd18e None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:11:10.245235 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aa5ae375-7c4e-44f0-8cf7-2e82f67cd18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:11:10.254179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 746/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:11:10.293324 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f096f-86a8-4259-b401-fd67afb68e3b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:11:10.305283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f096f-86a8-4259-b401-fd67afb68e3b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:11:10.308805 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9d531-ec90-4dcf-a7af-87e3fbd741b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:11:10.309452 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9d531-ec90-4dcf-a7af-87e3fbd741b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:10.309769 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9d531-ec90-4dcf-a7af-87e3fbd741b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:10.311198 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9d531-ec90-4dcf-a7af-87e3fbd741b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:10.320567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9d531-ec90-4dcf-a7af-87e3fbd741b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:11:10.322002 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9d531-ec90-4dcf-a7af-87e3fbd741b3 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:11:10.332009 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 744/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:11:12.695136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b26ef-de17-4e42-bb0f-26f11a5c6236 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:12.695659 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b26ef-de17-4e42-bb0f-26f11a5c6236 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:12.695777 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b26ef-de17-4e42-bb0f-26f11a5c6236 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:12.697064 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 747/1491] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 16 16:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:11:12.702286 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cd654-cd8f-4c4a-8a92-b3483649b97c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:12.702776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cd654-cd8f-4c4a-8a92-b3483649b97c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:12.702885 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cd654-cd8f-4c4a-8a92-b3483649b97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:12.721186 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3e3cd654-cd8f-4c4a-8a92-b3483649b97c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:11:12.722384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3e3cd654-cd8f-4c4a-8a92-b3483649b97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:11:12.730113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 745/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 16 16:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:11:12.770183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b26ef-de17-4e42-bb0f-26f11a5c6236 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:11:12.781439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b26ef-de17-4e42-bb0f-26f11a5c6236 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:11:12.786300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734026f-e5aa-460b-86c5-23ebae4dbc03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:11:12.786979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734026f-e5aa-460b-86c5-23ebae4dbc03 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:11:12.787266 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734026f-e5aa-460b-86c5-23ebae4dbc03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:11:12.787539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734026f-e5aa-460b-86c5-23ebae4dbc03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:11:12.797522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734026f-e5aa-460b-86c5-23ebae4dbc03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:11:12.798990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734026f-e5aa-460b-86c5-23ebae4dbc03 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:11:12.808246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 748/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:11:22.715176 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=33 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:11:22.804107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=33 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:38.435809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9193b-edbe-4012-b878-ee8e6514e284 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:38.436362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9193b-edbe-4012-b878-ee8e6514e284 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:38.436362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9193b-edbe-4012-b878-ee8e6514e284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:38.454941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-02a9193b-edbe-4012-b878-ee8e6514e284 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:12:38.456138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-02a9193b-edbe-4012-b878-ee8e6514e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:12:38.464962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 746/1494] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:12:38.474267 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce30e9-5547-4112-bfdd-e5fa4d6d3e71 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:38.474806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce30e9-5547-4112-bfdd-e5fa4d6d3e71 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:38.474911 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce30e9-5547-4112-bfdd-e5fa4d6d3e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:38.492680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0cce30e9-5547-4112-bfdd-e5fa4d6d3e71 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:12:38.494618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0cce30e9-5547-4112-bfdd-e5fa4d6d3e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:12:38.502320 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 749/1495] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:12:38.506834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9193b-edbe-4012-b878-ee8e6514e284 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:12:38.517103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9193b-edbe-4012-b878-ee8e6514e284 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:12:38.521532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c798ebd-7ae0-487b-8f31-731475f5e0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:12:38.522185 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798ebd-7ae0-487b-8f31-731475f5e0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:38.522493 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798ebd-7ae0-487b-8f31-731475f5e0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:38.522774 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798ebd-7ae0-487b-8f31-731475f5e0f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:38.523492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c798ebd-7ae0-487b-8f31-731475f5e0f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:12:38.523799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c798ebd-7ae0-487b-8f31-731475f5e0f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:12:38.524824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: WARNING py.warnings [None req-6c798ebd-7ae0-487b-8f31-731475f5e0f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:12:38.524824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: warnings.warn(msg) Jun 16 16:12:38.524824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: Jun 16 16:12:38.525702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c798ebd-7ae0-487b-8f31-731475f5e0f5 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:12:38.537373 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 747/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:12:38.545882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce30e9-5547-4112-bfdd-e5fa4d6d3e71 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:12:38.554939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce30e9-5547-4112-bfdd-e5fa4d6d3e71 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:12:38.560299 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06da3d-d065-4501-9e52-432c9351593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:12:38.560945 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06da3d-d065-4501-9e52-432c9351593a admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:38.561225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06da3d-d065-4501-9e52-432c9351593a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:38.561500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06da3d-d065-4501-9e52-432c9351593a admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:38.562178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06da3d-d065-4501-9e52-432c9351593a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:12:38.563969 dv-cinder-837355-2-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-de06da3d-d065-4501-9e52-432c9351593a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:12:38.563969 dv-cinder-837355-2-smb devstack@keystone.service[80323]: warnings.warn(msg) Jun 16 16:12:38.563969 dv-cinder-837355-2-smb devstack@keystone.service[80323]: Jun 16 16:12:38.565149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06da3d-d065-4501-9e52-432c9351593a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:12:38.601276 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 750/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:12:38 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:12:38.606143 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c798ebd-7ae0-487b-8f31-731475f5e0f5 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:12:38.615925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c798ebd-7ae0-487b-8f31-731475f5e0f5 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:12:38.671334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24098c-b586-4d34-b355-51531782a17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:12:38.672009 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24098c-b586-4d34-b355-51531782a17b admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:38.672293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24098c-b586-4d34-b355-51531782a17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:38.672572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24098c-b586-4d34-b355-51531782a17b admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:38.673265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24098c-b586-4d34-b355-51531782a17b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:12:38.674280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: WARNING py.warnings [None req-1c24098c-b586-4d34-b355-51531782a17b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:12:38.674280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: warnings.warn(msg) Jun 16 16:12:38.674280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: Jun 16 16:12:38.675543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24098c-b586-4d34-b355-51531782a17b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:12:38.696619 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 748/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:12:38 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:12:38.700765 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06da3d-d065-4501-9e52-432c9351593a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:12:38.710758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06da3d-d065-4501-9e52-432c9351593a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:12:38.715540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fac2e-810e-4fd2-b997-e1e8b3b9b73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:12:38.716199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fac2e-810e-4fd2-b997-e1e8b3b9b73a admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:38.716484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fac2e-810e-4fd2-b997-e1e8b3b9b73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:38.716760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fac2e-810e-4fd2-b997-e1e8b3b9b73a admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:38.717487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fac2e-810e-4fd2-b997-e1e8b3b9b73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:12:38.718587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-5e5fac2e-810e-4fd2-b997-e1e8b3b9b73a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:12:38.718587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: warnings.warn(msg) Jun 16 16:12:38.718587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: Jun 16 16:12:38.719474 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fac2e-810e-4fd2-b997-e1e8b3b9b73a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:12:38.733015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 751/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:12:38.737000 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24098c-b586-4d34-b355-51531782a17b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:12:38.747644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24098c-b586-4d34-b355-51531782a17b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:12:38.752315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9b569-d785-47e9-9788-da6fc70d3829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:12:38.752973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9b569-d785-47e9-9788-da6fc70d3829 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:38.753260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9b569-d785-47e9-9788-da6fc70d3829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:38.753540 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9b569-d785-47e9-9788-da6fc70d3829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:38.754262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9b569-d785-47e9-9788-da6fc70d3829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:12:38.755305 dv-cinder-837355-2-smb devstack@keystone.service[80324]: WARNING py.warnings [None req-62b9b569-d785-47e9-9788-da6fc70d3829 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:12:38.755305 dv-cinder-837355-2-smb devstack@keystone.service[80324]: warnings.warn(msg) Jun 16 16:12:38.755305 dv-cinder-837355-2-smb devstack@keystone.service[80324]: Jun 16 16:12:38.756199 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9b569-d785-47e9-9788-da6fc70d3829 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:12:38.770105 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 749/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:12:38.774212 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fac2e-810e-4fd2-b997-e1e8b3b9b73a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:12:38.784151 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fac2e-810e-4fd2-b997-e1e8b3b9b73a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:12:38.788593 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da6ceb-ca7a-433c-9908-18dc7851a0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:12:38.789483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da6ceb-ca7a-433c-9908-18dc7851a0ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:38.789746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da6ceb-ca7a-433c-9908-18dc7851a0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:38.790019 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da6ceb-ca7a-433c-9908-18dc7851a0ad admin admin] PATH_INFO: `/v3/projects/c8b2ca22303c47ae9fd38de822168971/users/481e9eb5275b4b639c007629eb770ce5/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:38.805142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da6ceb-ca7a-433c-9908-18dc7851a0ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b2ca22303c47ae9fd38de822168971, user_id=481e9eb5275b4b639c007629eb770ce5, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:12:38.806764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-53da6ceb-ca7a-433c-9908-18dc7851a0ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:12:38.806764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: warnings.warn(msg) Jun 16 16:12:38.806764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: Jun 16 16:12:38.808963 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da6ceb-ca7a-433c-9908-18dc7851a0ad admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:12:38.823967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 752/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:12:38 2022] PUT /identity/v3/projects/c8b2ca22303c47ae9fd38de822168971/users/481e9eb5275b4b639c007629eb770ce5/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:12:38.835424 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca76b85-6019-48f9-860b-1e87675556bf None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:38.835724 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca76b85-6019-48f9-860b-1e87675556bf None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:38.835993 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca76b85-6019-48f9-860b-1e87675556bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:38.863697 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7ca76b85-6019-48f9-860b-1e87675556bf None None] MFA Rules not processed for user `481e9eb5275b4b639c007629eb770ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:12:38.864919 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7ca76b85-6019-48f9-860b-1e87675556bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:12:38.930123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 750/1502] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:12:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:12:38.944605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c1ca9-c903-45c4-9a2c-e7c59b8264c1 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:38.944900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c1ca9-c903-45c4-9a2c-e7c59b8264c1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:38.945184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c1ca9-c903-45c4-9a2c-e7c59b8264c1 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:38.946610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 753/1503] 10.222.0.48 () {54 vars in 963 bytes} [Thu Jun 16 16:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:12:38.951647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384155a-cfaf-4723-8e75-8e3fd2b9b82d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:38.951969 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384155a-cfaf-4723-8e75-8e3fd2b9b82d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:38.952245 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384155a-cfaf-4723-8e75-8e3fd2b9b82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:38.971580 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0384155a-cfaf-4723-8e75-8e3fd2b9b82d None None] MFA Rules not processed for user `65e8905bab4c47f9a5fb374ef0377983`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:12:38.972782 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0384155a-cfaf-4723-8e75-8e3fd2b9b82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:12:39.016909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:39.026804 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 751/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Thu Jun 16 16:12:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:12:39.034501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c1ca9-c903-45c4-9a2c-e7c59b8264c1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:12:39.045380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c1ca9-c903-45c4-9a2c-e7c59b8264c1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:12:39.048897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926bde9-dee2-4ccf-86fd-2748631059cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:12:39.049528 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926bde9-dee2-4ccf-86fd-2748631059cd service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:39.049810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926bde9-dee2-4ccf-86fd-2748631059cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:39.050087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926bde9-dee2-4ccf-86fd-2748631059cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:39.059576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926bde9-dee2-4ccf-86fd-2748631059cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:12:39.061019 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926bde9-dee2-4ccf-86fd-2748631059cd service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:12:39.069925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 754/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:12:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:12:39.113895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062b2a7-c710-4bbd-978c-93a84f14d171 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:39.114192 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062b2a7-c710-4bbd-978c-93a84f14d171 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:39.114509 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062b2a7-c710-4bbd-978c-93a84f14d171 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:39.115836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 752/1506] 10.222.0.48 () {52 vars in 829 bytes} [Thu Jun 16 16:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:12:39.120138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926bde9-dee2-4ccf-86fd-2748631059cd service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:12:39.191577 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926bde9-dee2-4ccf-86fd-2748631059cd service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:12:39.198907 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93906e-2123-462e-af21-e5db0084a3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:12:39.199787 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93906e-2123-462e-af21-e5db0084a3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:39.200073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93906e-2123-462e-af21-e5db0084a3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:39.200353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93906e-2123-462e-af21-e5db0084a3eb admin admin] PATH_INFO: `/v3/users/481e9eb5275b4b639c007629eb770ce5` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:39.202477 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93906e-2123-462e-af21-e5db0084a3eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=481e9eb5275b4b639c007629eb770ce5)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:12:39.203498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-1f93906e-2123-462e-af21-e5db0084a3eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:12:39.203498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: warnings.warn(msg) Jun 16 16:12:39.203498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: Jun 16 16:12:39.204711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93906e-2123-462e-af21-e5db0084a3eb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:12:39.271281 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1f93906e-2123-462e-af21-e5db0084a3eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481e9eb5275b4b639c007629eb770ce5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:12:39.271950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1f93906e-2123-462e-af21-e5db0084a3eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481e9eb5275b4b639c007629eb770ce5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:12:39.290483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1f93906e-2123-462e-af21-e5db0084a3eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481e9eb5275b4b639c007629eb770ce5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:12:39.291392 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1f93906e-2123-462e-af21-e5db0084a3eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481e9eb5275b4b639c007629eb770ce5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:12:39.303609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1f93906e-2123-462e-af21-e5db0084a3eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481e9eb5275b4b639c007629eb770ce5'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:12:39.308609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:39.322825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 755/1507] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:12:39 2022] DELETE /identity/v3/users/481e9eb5275b4b639c007629eb770ce5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:12:39.327678 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d187c-4024-45c4-93d5-c66fbd271fbc None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:39.328015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d187c-4024-45c4-93d5-c66fbd271fbc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:39.328341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d187c-4024-45c4-93d5-c66fbd271fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:39.346374 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7b1d187c-4024-45c4-93d5-c66fbd271fbc None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:12:39.347621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7b1d187c-4024-45c4-93d5-c66fbd271fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:12:39.408456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 753/1508] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:12:39.418711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93906e-2123-462e-af21-e5db0084a3eb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:12:39.420151 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1f93906e-2123-462e-af21-e5db0084a3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:12:39.477515 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93906e-2123-462e-af21-e5db0084a3eb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:12:39.481828 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bfa84-e542-4a5e-a258-e69ba39a13e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:12:39.482513 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bfa84-e542-4a5e-a258-e69ba39a13e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:39.482802 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bfa84-e542-4a5e-a258-e69ba39a13e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:39.483079 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bfa84-e542-4a5e-a258-e69ba39a13e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:39.492089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bfa84-e542-4a5e-a258-e69ba39a13e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:12:39.494162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27bfa84-e542-4a5e-a258-e69ba39a13e5 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:12:39.503558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 756/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:12:39.835015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d187c-4024-45c4-93d5-c66fbd271fbc None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:12:39.836588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7b1d187c-4024-45c4-93d5-c66fbd271fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:12:39.848334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d187c-4024-45c4-93d5-c66fbd271fbc None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:12:39.852889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:12:39.853761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:12:39.854043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:12:39.858900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b admin admin] PATH_INFO: `/v3/projects/c8b2ca22303c47ae9fd38de822168971` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:12:39.860152 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b2ca22303c47ae9fd38de822168971)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:12:39.861204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: WARNING py.warnings [None req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:12:39.861204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: warnings.warn(msg) Jun 16 16:12:39.861204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: Jun 16 16:12:39.862404 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:12:39.922787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b2ca22303c47ae9fd38de822168971', 'request_id': 'req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:12:39.928807 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b2ca22303c47ae9fd38de822168971', 'request_id': 'req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:12:39.939915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b2ca22303c47ae9fd38de822168971', 'request_id': 'req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:12:39.958805 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b admin admin] The token cache is being invalidate because project c8b2ca22303c47ae9fd38de822168971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:12:39.959095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:12:39.959746 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-66484f50-2f54-46c5-8f05-c5e57e7c9f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:12:39.961398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 754/1510] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:12:39 2022] DELETE /identity/v3/projects/c8b2ca22303c47ae9fd38de822168971 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:12:49.499395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:12:49.955780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:25.353067 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04887c3f-5b27-4a6c-b0ff-92c4923d44b6 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:25.353749 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04887c3f-5b27-4a6c-b0ff-92c4923d44b6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:25.353749 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04887c3f-5b27-4a6c-b0ff-92c4923d44b6 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:25.355087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 16:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:14:25.359941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d725341-2b80-4c2e-a09a-c67ac2ccdccb None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:25.360407 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d725341-2b80-4c2e-a09a-c67ac2ccdccb None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:25.360526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d725341-2b80-4c2e-a09a-c67ac2ccdccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:25.380567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1d725341-2b80-4c2e-a09a-c67ac2ccdccb None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:14:25.381798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1d725341-2b80-4c2e-a09a-c67ac2ccdccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:14:25.441033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 16:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:14:25.614799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04887c3f-5b27-4a6c-b0ff-92c4923d44b6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:14:25.616539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-04887c3f-5b27-4a6c-b0ff-92c4923d44b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:14:25.696230 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04887c3f-5b27-4a6c-b0ff-92c4923d44b6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:14:25.702196 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fa335-6fa1-4ae4-8236-f35eb8372e2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:14:25.702872 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fa335-6fa1-4ae4-8236-f35eb8372e2f service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:25.703154 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fa335-6fa1-4ae4-8236-f35eb8372e2f service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:25.703427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fa335-6fa1-4ae4-8236-f35eb8372e2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:25.713491 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fa335-6fa1-4ae4-8236-f35eb8372e2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:14:25.715182 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fa335-6fa1-4ae4-8236-f35eb8372e2f service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:14:25.725809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 758/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:14:26.610630 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b28de1-a918-4a48-b256-e2181df89d64 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:26.611165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b28de1-a918-4a48-b256-e2181df89d64 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:26.611165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b28de1-a918-4a48-b256-e2181df89d64 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:26.612486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 16:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:14:26.617328 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492f4b8-9267-47c2-8686-cd90a6094b11 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:26.617732 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492f4b8-9267-47c2-8686-cd90a6094b11 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:26.617879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492f4b8-9267-47c2-8686-cd90a6094b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:26.636330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8492f4b8-9267-47c2-8686-cd90a6094b11 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:14:26.637524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8492f4b8-9267-47c2-8686-cd90a6094b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:14:26.645213 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 16:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:14:26.781938 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113a3de-e975-4eb8-9e1b-6ed9d2db3352 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:26.782230 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113a3de-e975-4eb8-9e1b-6ed9d2db3352 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:26.782665 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113a3de-e975-4eb8-9e1b-6ed9d2db3352 None None] PATH_INFO: `/v3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:26.783984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 757/1516] 10.222.0.67 () {54 vars in 925 bytes} [Thu Jun 16 16:14:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:14:26.790356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c3443-ea6c-46dd-96f3-b412866cdd1f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:26.790686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c3443-ea6c-46dd-96f3-b412866cdd1f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:26.790971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c3443-ea6c-46dd-96f3-b412866cdd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:26.801774 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113a3de-e975-4eb8-9e1b-6ed9d2db3352 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:14:26.810342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e93c3443-ea6c-46dd-96f3-b412866cdd1f None None] MFA Rules not processed for user `9e8222d303aa487ca2b5c5bed6124f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:14:26.811599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e93c3443-ea6c-46dd-96f3-b412866cdd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:14:26.817227 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113a3de-e975-4eb8-9e1b-6ed9d2db3352 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:14:26.823462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13b1cf-bb5d-4c0a-bc21-aeded443e531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:14:26.824084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13b1cf-bb5d-4c0a-bc21-aeded443e531 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:26.824370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13b1cf-bb5d-4c0a-bc21-aeded443e531 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:26.824646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13b1cf-bb5d-4c0a-bc21-aeded443e531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:26.833050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13b1cf-bb5d-4c0a-bc21-aeded443e531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:14:26.834699 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13b1cf-bb5d-4c0a-bc21-aeded443e531 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:14:26.844117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 758/1517] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:14:26.878185 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 760/1518] 10.222.0.67 () {58 vars in 1015 bytes} [Thu Jun 16 16:14:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:14:35.643217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839bc58-7baa-4132-902c-31fa366b085b None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:35.643742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839bc58-7baa-4132-902c-31fa366b085b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:35.643742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839bc58-7baa-4132-902c-31fa366b085b None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:35.645057 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 759/1519] 10.222.0.48 () {54 vars in 960 bytes} [Thu Jun 16 16:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:14:35.651168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898717b-6c6d-4a44-a0d2-3c841a6fb6a3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:35.651667 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898717b-6c6d-4a44-a0d2-3c841a6fb6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:35.651769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898717b-6c6d-4a44-a0d2-3c841a6fb6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:35.670312 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f898717b-6c6d-4a44-a0d2-3c841a6fb6a3 None None] MFA Rules not processed for user `9e8222d303aa487ca2b5c5bed6124f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:14:35.671662 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f898717b-6c6d-4a44-a0d2-3c841a6fb6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:14:35.680502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 761/1520] 10.222.0.48 () {58 vars in 1057 bytes} [Thu Jun 16 16:14:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:14:35.688425 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839bc58-7baa-4132-902c-31fa366b085b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:14:35.702674 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839bc58-7baa-4132-902c-31fa366b085b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:14:35.708429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa6209-e694-44f0-9cf1-3c77364d9af7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e8222d303aa487ca2b5c5bed6124f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:14:35.709317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6209-e694-44f0-9cf1-3c77364d9af7 service placement] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:35.710108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6209-e694-44f0-9cf1-3c77364d9af7 service placement] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:35.710523 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6209-e694-44f0-9cf1-3c77364d9af7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:35.725414 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa6209-e694-44f0-9cf1-3c77364d9af7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:14:35.727046 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa6209-e694-44f0-9cf1-3c77364d9af7 service placement] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:14:35.737481 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 760/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:14:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:14:38.136752 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60416320-1fc9-4feb-934f-8c1e1c1b3614 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:38.137353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60416320-1fc9-4feb-934f-8c1e1c1b3614 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:38.137353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60416320-1fc9-4feb-934f-8c1e1c1b3614 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:38.138742 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 16:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:14:38.143501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16d751-9016-4d49-909f-13dd1375f537 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:38.143918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16d751-9016-4d49-909f-13dd1375f537 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:38.144077 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16d751-9016-4d49-909f-13dd1375f537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:38.162950 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-4a16d751-9016-4d49-909f-13dd1375f537 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:14:38.164170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4a16d751-9016-4d49-909f-13dd1375f537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:14:38.172090 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 16:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:14:38.329363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60416320-1fc9-4feb-934f-8c1e1c1b3614 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:14:38.344284 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60416320-1fc9-4feb-934f-8c1e1c1b3614 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:14:38.349889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67dcfe-d2e4-4cd4-8ad5-3f61673a822d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:14:38.350580 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67dcfe-d2e4-4cd4-8ad5-3f61673a822d service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:38.350869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67dcfe-d2e4-4cd4-8ad5-3f61673a822d service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:38.351151 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67dcfe-d2e4-4cd4-8ad5-3f61673a822d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:38.360514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67dcfe-d2e4-4cd4-8ad5-3f61673a822d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:14:38.362121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67dcfe-d2e4-4cd4-8ad5-3f61673a822d service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:14:38.373143 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 763/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:14:39.243294 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b826dcf-040e-4b58-98b0-063da4888436 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:39.244389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b826dcf-040e-4b58-98b0-063da4888436 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:39.244509 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b826dcf-040e-4b58-98b0-063da4888436 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:39.245946 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 16:14:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:14:39.250890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accddd16-f53e-4dfc-b9cf-f12bb4db5587 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:39.251301 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accddd16-f53e-4dfc-b9cf-f12bb4db5587 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:39.251450 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accddd16-f53e-4dfc-b9cf-f12bb4db5587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:39.269489 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-accddd16-f53e-4dfc-b9cf-f12bb4db5587 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:14:39.270713 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-accddd16-f53e-4dfc-b9cf-f12bb4db5587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:14:39.278594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 16:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:14:39.434394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b826dcf-040e-4b58-98b0-063da4888436 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:14:39.448817 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b826dcf-040e-4b58-98b0-063da4888436 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:14:39.454417 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd133b1a-e87a-4c97-9573-0f2b84aac1ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:14:39.455180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd133b1a-e87a-4c97-9573-0f2b84aac1ce service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:39.455466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd133b1a-e87a-4c97-9573-0f2b84aac1ce service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:39.455750 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd133b1a-e87a-4c97-9573-0f2b84aac1ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:39.464328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd133b1a-e87a-4c97-9573-0f2b84aac1ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:14:39.465941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd133b1a-e87a-4c97-9573-0f2b84aac1ce service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:14:39.475682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 763/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:14:43.695182 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d078a-4590-4d87-836c-af81d16446df None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:43.695746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d078a-4590-4d87-836c-af81d16446df None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:43.695746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d078a-4590-4d87-836c-af81d16446df None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:43.697776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 16:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:14:43.703522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40434c-bba1-49e2-b993-a5a766e50d2f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:43.703930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40434c-bba1-49e2-b993-a5a766e50d2f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:43.704097 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40434c-bba1-49e2-b993-a5a766e50d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:43.722942 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3d40434c-bba1-49e2-b993-a5a766e50d2f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:14:43.724141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3d40434c-bba1-49e2-b993-a5a766e50d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:14:43.732629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 16:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:14:43.770169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d078a-4590-4d87-836c-af81d16446df None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:14:43.771883 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-020d078a-4590-4d87-836c-af81d16446df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:14:43.832253 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:43.836754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d078a-4590-4d87-836c-af81d16446df None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:14:43.840986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a6285-3f57-4b4d-9207-07d34dd064f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:14:43.841628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6285-3f57-4b4d-9207-07d34dd064f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:43.841908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6285-3f57-4b4d-9207-07d34dd064f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:43.842181 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6285-3f57-4b4d-9207-07d34dd064f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:43.851057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a6285-3f57-4b4d-9207-07d34dd064f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:14:43.852515 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a6285-3f57-4b4d-9207-07d34dd064f0 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:14:43.861827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 766/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:14:46.004115 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424a15e-4c67-4686-a286-4d343e68ae94 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:46.004709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424a15e-4c67-4686-a286-4d343e68ae94 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:46.004709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424a15e-4c67-4686-a286-4d343e68ae94 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:46.006071 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 16:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:14:46.011417 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3da067-5b27-4c28-a922-bc1ea6583ac2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:46.011836 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3da067-5b27-4c28-a922-bc1ea6583ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:46.012006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3da067-5b27-4c28-a922-bc1ea6583ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:46.029438 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0c3da067-5b27-4c28-a922-bc1ea6583ac2 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:14:46.030669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0c3da067-5b27-4c28-a922-bc1ea6583ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:14:46.038308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 16:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:14:46.079091 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424a15e-4c67-4686-a286-4d343e68ae94 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:14:46.091139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424a15e-4c67-4686-a286-4d343e68ae94 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:14:46.094713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b48b0c-928b-4546-b564-0366670372d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:14:46.095304 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b48b0c-928b-4546-b564-0366670372d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:46.095586 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b48b0c-928b-4546-b564-0366670372d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:46.095861 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b48b0c-928b-4546-b564-0366670372d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:46.106242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b48b0c-928b-4546-b564-0366670372d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:14:46.107708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b48b0c-928b-4546-b564-0366670372d7 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:14:46.117181 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 766/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:14:49.949173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23313571-86ba-4470-ae99-b9647fe1354f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:49.949756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23313571-86ba-4470-ae99-b9647fe1354f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:49.949756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23313571-86ba-4470-ae99-b9647fe1354f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:49.951142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 16:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:14:49.956443 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a70fa3-9c34-4d2f-a1f5-f7c2a7ebe450 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:49.956860 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a70fa3-9c34-4d2f-a1f5-f7c2a7ebe450 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:49.957015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a70fa3-9c34-4d2f-a1f5-f7c2a7ebe450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:49.964893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=59 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:14:49.976398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-81a70fa3-9c34-4d2f-a1f5-f7c2a7ebe450 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:14:49.978189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-81a70fa3-9c34-4d2f-a1f5-f7c2a7ebe450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:14:49.986358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 16:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:14:50.256081 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23313571-86ba-4470-ae99-b9647fe1354f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:14:50.258628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-23313571-86ba-4470-ae99-b9647fe1354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:14:50.324884 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23313571-86ba-4470-ae99-b9647fe1354f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:14:50.328399 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6f822-51c1-4d6c-ae3b-04dcfdbae77f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:14:50.329048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6f822-51c1-4d6c-ae3b-04dcfdbae77f service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:50.329429 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6f822-51c1-4d6c-ae3b-04dcfdbae77f service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:50.329705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6f822-51c1-4d6c-ae3b-04dcfdbae77f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:50.339164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6f822-51c1-4d6c-ae3b-04dcfdbae77f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:14:50.340606 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6f822-51c1-4d6c-ae3b-04dcfdbae77f service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:14:50.351867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 769/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:14:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:14:52.520702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6366db-3191-4f85-aa1b-7224a1816119 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:52.521292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6366db-3191-4f85-aa1b-7224a1816119 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:52.521292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6366db-3191-4f85-aa1b-7224a1816119 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:52.522633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 16:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:14:52.528496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bc8b5-0faa-4202-bead-c1a462308268 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:52.528968 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bc8b5-0faa-4202-bead-c1a462308268 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:52.529073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bc8b5-0faa-4202-bead-c1a462308268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:52.547773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ca9bc8b5-0faa-4202-bead-c1a462308268 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:14:52.549030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ca9bc8b5-0faa-4202-bead-c1a462308268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:14:52.557297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 16:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:14:52.819548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6366db-3191-4f85-aa1b-7224a1816119 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:14:52.821745 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bb6366db-3191-4f85-aa1b-7224a1816119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:14:52.834867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6366db-3191-4f85-aa1b-7224a1816119 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:14:52.839184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee11901-d458-4bd2-a5a0-cbd20b5023ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:14:52.839826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee11901-d458-4bd2-a5a0-cbd20b5023ca service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:14:52.840112 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee11901-d458-4bd2-a5a0-cbd20b5023ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:14:52.840391 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee11901-d458-4bd2-a5a0-cbd20b5023ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:14:52.849272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee11901-d458-4bd2-a5a0-cbd20b5023ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:14:52.850737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee11901-d458-4bd2-a5a0-cbd20b5023ca service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:14:52.860117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 769/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:14:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:15:02.542901 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=36 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:15:02.856036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=7 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:23.169784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e78b32-f03d-4ba9-b3d9-2ace386ccd79 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.170881 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e78b32-f03d-4ba9-b3d9-2ace386ccd79 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.171369 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e78b32-f03d-4ba9-b3d9-2ace386ccd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.196503 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-29e78b32-f03d-4ba9-b3d9-2ace386ccd79 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:23.198066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-29e78b32-f03d-4ba9-b3d9-2ace386ccd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:23.211309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 771/1540] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:23.225898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e052d9-af96-4059-815c-e91859865a16 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.226958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e052d9-af96-4059-815c-e91859865a16 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.227462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e052d9-af96-4059-815c-e91859865a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.267991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-30e052d9-af96-4059-815c-e91859865a16 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:23.270303 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-30e052d9-af96-4059-815c-e91859865a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:23.284257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 770/1541] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:23.291361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e78b32-f03d-4ba9-b3d9-2ace386ccd79 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:23.307461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e78b32-f03d-4ba9-b3d9-2ace386ccd79 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:23.315430 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689d92b-21da-4468-a1b5-93dec12d21d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:23.316474 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689d92b-21da-4468-a1b5-93dec12d21d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.316967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689d92b-21da-4468-a1b5-93dec12d21d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.317445 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689d92b-21da-4468-a1b5-93dec12d21d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.319373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689d92b-21da-4468-a1b5-93dec12d21d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:16:23.320167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689d92b-21da-4468-a1b5-93dec12d21d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:23.321409 dv-cinder-837355-2-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-3689d92b-21da-4468-a1b5-93dec12d21d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:16:23.321409 dv-cinder-837355-2-smb devstack@keystone.service[80323]: warnings.warn(msg) Jun 16 16:16:23.321409 dv-cinder-837355-2-smb devstack@keystone.service[80323]: Jun 16 16:16:23.322722 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689d92b-21da-4468-a1b5-93dec12d21d1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:23.339958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 772/1542] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:16:23.351230 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e052d9-af96-4059-815c-e91859865a16 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:23.363054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e052d9-af96-4059-815c-e91859865a16 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:23.372770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee1701-df2f-4c2b-838f-b794b1b44b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:23.373462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee1701-df2f-4c2b-838f-b794b1b44b59 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.373752 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee1701-df2f-4c2b-838f-b794b1b44b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.374039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee1701-df2f-4c2b-838f-b794b1b44b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.375023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee1701-df2f-4c2b-838f-b794b1b44b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:23.376327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: WARNING py.warnings [None req-aeee1701-df2f-4c2b-838f-b794b1b44b59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:16:23.376327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: warnings.warn(msg) Jun 16 16:16:23.376327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: Jun 16 16:16:23.377548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee1701-df2f-4c2b-838f-b794b1b44b59 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:23.421384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 771/1543] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:23 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:23.425707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689d92b-21da-4468-a1b5-93dec12d21d1 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:23.440101 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689d92b-21da-4468-a1b5-93dec12d21d1 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:23.522616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99c744-41ea-4ebf-acf8-6f36ea9b1c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:23.523322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c744-41ea-4ebf-acf8-6f36ea9b1c80 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.523610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c744-41ea-4ebf-acf8-6f36ea9b1c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.523889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99c744-41ea-4ebf-acf8-6f36ea9b1c80 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.524606 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99c744-41ea-4ebf-acf8-6f36ea9b1c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:23.525792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-ce99c744-41ea-4ebf-acf8-6f36ea9b1c80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:16:23.525792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: warnings.warn(msg) Jun 16 16:16:23.525792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: Jun 16 16:16:23.527043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99c744-41ea-4ebf-acf8-6f36ea9b1c80 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:23.550645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e9c84-8e9c-4cb3-a0a0-25e3410cec68 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.551267 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e9c84-8e9c-4cb3-a0a0-25e3410cec68 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.551610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e9c84-8e9c-4cb3-a0a0-25e3410cec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.559167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 773/1544] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:23 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:23.563612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99c744-41ea-4ebf-acf8-6f36ea9b1c80 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:23.580353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99c744-41ea-4ebf-acf8-6f36ea9b1c80 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:23.597021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6bbf7-ec8f-44e2-a679-4c5bd5c2a290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:23.597277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e74e9c84-8e9c-4cb3-a0a0-25e3410cec68 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:23.597723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6bbf7-ec8f-44e2-a679-4c5bd5c2a290 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.598092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6bbf7-ec8f-44e2-a679-4c5bd5c2a290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.598368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e74e9c84-8e9c-4cb3-a0a0-25e3410cec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:23.598508 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6bbf7-ec8f-44e2-a679-4c5bd5c2a290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.599683 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6bbf7-ec8f-44e2-a679-4c5bd5c2a290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:23.601490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6bbf7-ec8f-44e2-a679-4c5bd5c2a290 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:23.623073 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 772/1545] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:16:23.633655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 774/1546] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:16:23.639157 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e9c84-8e9c-4cb3-a0a0-25e3410cec68 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:23.653414 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5013bb-648f-415c-bcca-871c05c570d6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.653760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5013bb-648f-415c-bcca-871c05c570d6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.653984 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5013bb-648f-415c-bcca-871c05c570d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.659709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e9c84-8e9c-4cb3-a0a0-25e3410cec68 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:23.671564 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830f62e-3f73-43bd-b87f-da7897f78aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:23.672900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830f62e-3f73-43bd-b87f-da7897f78aeb admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.673192 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830f62e-3f73-43bd-b87f-da7897f78aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.673486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830f62e-3f73-43bd-b87f-da7897f78aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.674365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830f62e-3f73-43bd-b87f-da7897f78aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:23.676531 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830f62e-3f73-43bd-b87f-da7897f78aeb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:23.696240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 773/1547] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:23.700493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9a5013bb-648f-415c-bcca-871c05c570d6 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:23.700731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830f62e-3f73-43bd-b87f-da7897f78aeb admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:23.701736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9a5013bb-648f-415c-bcca-871c05c570d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:23.717237 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830f62e-3f73-43bd-b87f-da7897f78aeb admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:23.727175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf520ba-dca0-4aee-9c2c-0e7b0e8c7471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:23.728122 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf520ba-dca0-4aee-9c2c-0e7b0e8c7471 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.728415 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf520ba-dca0-4aee-9c2c-0e7b0e8c7471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.728700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf520ba-dca0-4aee-9c2c-0e7b0e8c7471 admin admin] PATH_INFO: `/v3/projects/fdbbf35cd82648878dc957fe3bf4ed5a/users/f48deebede4d485b9a7824b0be6e281e/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.739442 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 775/1548] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:16:23.755973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5013bb-648f-415c-bcca-871c05c570d6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:23.758379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf520ba-dca0-4aee-9c2c-0e7b0e8c7471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbbf35cd82648878dc957fe3bf4ed5a, user_id=f48deebede4d485b9a7824b0be6e281e, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:23.759483 dv-cinder-837355-2-smb devstack@keystone.service[80324]: WARNING py.warnings [None req-2cf520ba-dca0-4aee-9c2c-0e7b0e8c7471 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:16:23.759483 dv-cinder-837355-2-smb devstack@keystone.service[80324]: warnings.warn(msg) Jun 16 16:16:23.759483 dv-cinder-837355-2-smb devstack@keystone.service[80324]: Jun 16 16:16:23.761643 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf520ba-dca0-4aee-9c2c-0e7b0e8c7471 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:23.784950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5013bb-648f-415c-bcca-871c05c570d6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:23.789594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 774/1549] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:23 2022] PUT /identity/v3/projects/fdbbf35cd82648878dc957fe3bf4ed5a/users/f48deebede4d485b9a7824b0be6e281e/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:23.795305 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ff2ed-b335-4dd0-90e9-a7c9c44a1adc None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.795637 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ff2ed-b335-4dd0-90e9-a7c9c44a1adc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.795937 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ff2ed-b335-4dd0-90e9-a7c9c44a1adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.831693 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d56ff2ed-b335-4dd0-90e9-a7c9c44a1adc None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:23.834354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d56ff2ed-b335-4dd0-90e9-a7c9c44a1adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:23.920115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28369b-bea7-42cf-9c7c-eaa222050e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:23.920799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28369b-bea7-42cf-9c7c-eaa222050e3f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.921084 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28369b-bea7-42cf-9c7c-eaa222050e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.921360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28369b-bea7-42cf-9c7c-eaa222050e3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.922157 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28369b-bea7-42cf-9c7c-eaa222050e3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:16:23.922279 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 775/1550] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:23.922507 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28369b-bea7-42cf-9c7c-eaa222050e3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:23.923814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6d77f-383c-49d0-8ccd-79bad5736204 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.924208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28369b-bea7-42cf-9c7c-eaa222050e3f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:23.924403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6d77f-383c-49d0-8ccd-79bad5736204 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.924651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6d77f-383c-49d0-8ccd-79bad5736204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.939212 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 776/1551] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:16:23.940962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2903a40-15ca-411f-9d6a-3d61c2bc1ad3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.941321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2903a40-15ca-411f-9d6a-3d61c2bc1ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.941600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2903a40-15ca-411f-9d6a-3d61c2bc1ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.954477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-04d6d77f-383c-49d0-8ccd-79bad5736204 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:23.956010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-04d6d77f-383c-49d0-8ccd-79bad5736204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:23.961939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e2903a40-15ca-411f-9d6a-3d61c2bc1ad3 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:23.963273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e2903a40-15ca-411f-9d6a-3d61c2bc1ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:23.967153 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 776/1552] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:23.970484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976470d-154b-4cbe-bfd5-d80ed2b355a4 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.970484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976470d-154b-4cbe-bfd5-d80ed2b355a4 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.970484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976470d-154b-4cbe-bfd5-d80ed2b355a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.983354 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 777/1553] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:23.984780 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fe8b9-7903-41a1-a3ce-1eccc47f2782 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:23.985072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fe8b9-7903-41a1-a3ce-1eccc47f2782 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:23.985485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fe8b9-7903-41a1-a3ce-1eccc47f2782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:23.995914 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5976470d-154b-4cbe-bfd5-d80ed2b355a4 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:23.997129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5976470d-154b-4cbe-bfd5-d80ed2b355a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:24.005115 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 777/1554] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:24.007123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bc8f0-01e8-42ef-a5a1-a43681f2e9b8 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.007348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bc8f0-01e8-42ef-a5a1-a43681f2e9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.007628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bc8f0-01e8-42ef-a5a1-a43681f2e9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.009463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-848fe8b9-7903-41a1-a3ce-1eccc47f2782 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:24.010706 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-848fe8b9-7903-41a1-a3ce-1eccc47f2782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:24.019313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 778/1555] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:24.020185 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fe8b9-7903-41a1-a3ce-1eccc47f2782 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.022636 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-848fe8b9-7903-41a1-a3ce-1eccc47f2782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:24.028244 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-799bc8f0-01e8-42ef-a5a1-a43681f2e9b8 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:24.030415 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-799bc8f0-01e8-42ef-a5a1-a43681f2e9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:24.039713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 778/1556] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:24.040739 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bc8f0-01e8-42ef-a5a1-a43681f2e9b8 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.051978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bc8f0-01e8-42ef-a5a1-a43681f2e9b8 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.057994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9938a6-fae0-45a2-8cb6-7c91c659c7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.058653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:24.058806 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9938a6-fae0-45a2-8cb6-7c91c659c7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.059036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9938a6-fae0-45a2-8cb6-7c91c659c7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.059318 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9938a6-fae0-45a2-8cb6-7c91c659c7e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.060059 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9938a6-fae0-45a2-8cb6-7c91c659c7e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.062232 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9938a6-fae0-45a2-8cb6-7c91c659c7e4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.083541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fe8b9-7903-41a1-a3ce-1eccc47f2782 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.088084 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4cea6-3c33-4674-a590-c97a9cc051ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.088744 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4cea6-3c33-4674-a590-c97a9cc051ef service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.089057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4cea6-3c33-4674-a590-c97a9cc051ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.089349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4cea6-3c33-4674-a590-c97a9cc051ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.090412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 779/1557] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:24.091808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cfc36-86ef-4d56-8b74-c83ab6add6d8 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.092110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cfc36-86ef-4d56-8b74-c83ab6add6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.092394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cfc36-86ef-4d56-8b74-c83ab6add6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.101545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4cea6-3c33-4674-a590-c97a9cc051ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.103070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4cea6-3c33-4674-a590-c97a9cc051ef service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.111684 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e72cfc36-86ef-4d56-8b74-c83ab6add6d8 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:24.112976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e72cfc36-86ef-4d56-8b74-c83ab6add6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:24.114279 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 779/1558] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:24.115822 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637e53c-3689-40ba-a4ad-3ea93e3a6e85 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.116180 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637e53c-3689-40ba-a4ad-3ea93e3a6e85 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.116459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637e53c-3689-40ba-a4ad-3ea93e3a6e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.135085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2637e53c-3689-40ba-a4ad-3ea93e3a6e85 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:24.136543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2637e53c-3689-40ba-a4ad-3ea93e3a6e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:24.165015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:24.185127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 780/1559] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:24.186595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d74a6-c8a8-4f18-9d69-f6079c78b986 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.186959 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d74a6-c8a8-4f18-9d69-f6079c78b986 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.187359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d74a6-c8a8-4f18-9d69-f6079c78b986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.211342 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b76d74a6-c8a8-4f18-9d69-f6079c78b986 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:24.212679 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b76d74a6-c8a8-4f18-9d69-f6079c78b986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:24.221500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 780/1560] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:24.222558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 781/1561] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:24.222917 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1d4d0-c57f-45da-83ff-edb10ffd3d19 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.223214 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1d4d0-c57f-45da-83ff-edb10ffd3d19 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.223495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1d4d0-c57f-45da-83ff-edb10ffd3d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.227905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a89665-85d4-420d-80d0-d02522254ac5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.228462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a89665-85d4-420d-80d0-d02522254ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.228462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a89665-85d4-420d-80d0-d02522254ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.245470 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-77a1d4d0-c57f-45da-83ff-edb10ffd3d19 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:24.246930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-77a1d4d0-c57f-45da-83ff-edb10ffd3d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:24.249151 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b5a89665-85d4-420d-80d0-d02522254ac5 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:24.250519 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b5a89665-85d4-420d-80d0-d02522254ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:24.257912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 781/1562] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:24.259502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdb5ee-4bab-4b30-92d4-86cabb16047b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.259966 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdb5ee-4bab-4b30-92d4-86cabb16047b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.260455 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdb5ee-4bab-4b30-92d4-86cabb16047b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.260939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 782/1563] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:24.262131 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a89665-85d4-420d-80d0-d02522254ac5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.272833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a89665-85d4-420d-80d0-d02522254ac5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.279147 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e467c9b-5365-445e-b14a-67a6cbf74df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.279960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e467c9b-5365-445e-b14a-67a6cbf74df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.280340 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e467c9b-5365-445e-b14a-67a6cbf74df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.280718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e467c9b-5365-445e-b14a-67a6cbf74df7 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.281503 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e467c9b-5365-445e-b14a-67a6cbf74df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.282070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-17cdb5ee-4bab-4b30-92d4-86cabb16047b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:24.283376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-17cdb5ee-4bab-4b30-92d4-86cabb16047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:24.283778 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e467c9b-5365-445e-b14a-67a6cbf74df7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.292222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 782/1564] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:24.293312 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdb5ee-4bab-4b30-92d4-86cabb16047b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.307571 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdb5ee-4bab-4b30-92d4-86cabb16047b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.310353 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 783/1565] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:24.311939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56eb91-ceca-4926-ae94-625726d236ad None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.312083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56eb91-ceca-4926-ae94-625726d236ad None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.312262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56eb91-ceca-4926-ae94-625726d236ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.319262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f47382-95e5-47a2-a2f0-a2a71d2571c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.323102 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f47382-95e5-47a2-a2f0-a2a71d2571c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.323102 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f47382-95e5-47a2-a2f0-a2a71d2571c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.323102 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f47382-95e5-47a2-a2f0-a2a71d2571c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.327373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f47382-95e5-47a2-a2f0-a2a71d2571c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:16:24.327726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f47382-95e5-47a2-a2f0-a2a71d2571c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.329387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f47382-95e5-47a2-a2f0-a2a71d2571c9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.342751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7f56eb91-ceca-4926-ae94-625726d236ad None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:24.343456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 783/1566] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:16:24.344463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f47382-95e5-47a2-a2f0-a2a71d2571c9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.344939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7f56eb91-ceca-4926-ae94-625726d236ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:24.357300 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 784/1567] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:24.358628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56eb91-ceca-4926-ae94-625726d236ad None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.370963 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f47382-95e5-47a2-a2f0-a2a71d2571c9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.376475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c847c1f-beb3-49a4-9705-112494dbda44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.377250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c847c1f-beb3-49a4-9705-112494dbda44 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.377595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c847c1f-beb3-49a4-9705-112494dbda44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.377708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56eb91-ceca-4926-ae94-625726d236ad None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.378023 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c847c1f-beb3-49a4-9705-112494dbda44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.378859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c847c1f-beb3-49a4-9705-112494dbda44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:16:24.379232 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c847c1f-beb3-49a4-9705-112494dbda44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.381471 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c847c1f-beb3-49a4-9705-112494dbda44 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.384632 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db070c3c-2465-4b93-a8cd-a5ebd6054920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.385416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070c3c-2465-4b93-a8cd-a5ebd6054920 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.385763 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070c3c-2465-4b93-a8cd-a5ebd6054920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.386109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070c3c-2465-4b93-a8cd-a5ebd6054920 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.386961 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db070c3c-2465-4b93-a8cd-a5ebd6054920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:16:24.387644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db070c3c-2465-4b93-a8cd-a5ebd6054920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.389276 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db070c3c-2465-4b93-a8cd-a5ebd6054920 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.394277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 784/1568] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:16:24.401095 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c847c1f-beb3-49a4-9705-112494dbda44 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.402603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 785/1569] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:16:24.403658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db070c3c-2465-4b93-a8cd-a5ebd6054920 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.417021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c847c1f-beb3-49a4-9705-112494dbda44 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.421903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db070c3c-2465-4b93-a8cd-a5ebd6054920 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.422640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a066f-d971-462a-a283-233e12af54d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.423370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a066f-d971-462a-a283-233e12af54d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.423618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a066f-d971-462a-a283-233e12af54d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.423891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a066f-d971-462a-a283-233e12af54d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.424724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a066f-d971-462a-a283-233e12af54d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:16:24.425130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a066f-d971-462a-a283-233e12af54d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.427666 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a066f-d971-462a-a283-233e12af54d5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.429341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20242653-98a8-451b-bd91-e354574539be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.429689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20242653-98a8-451b-bd91-e354574539be admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.429911 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20242653-98a8-451b-bd91-e354574539be admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.430193 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20242653-98a8-451b-bd91-e354574539be admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.431362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20242653-98a8-451b-bd91-e354574539be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:16:24.431362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20242653-98a8-451b-bd91-e354574539be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.433394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20242653-98a8-451b-bd91-e354574539be admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.449835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 785/1570] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:16:24.449835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a066f-d971-462a-a283-233e12af54d5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.458106 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 786/1571] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:16:24.459723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20242653-98a8-451b-bd91-e354574539be admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.460265 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a066f-d971-462a-a283-233e12af54d5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.465188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadb6b6-c40c-4955-9d6b-162768c1a1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.465866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadb6b6-c40c-4955-9d6b-162768c1a1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.466140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadb6b6-c40c-4955-9d6b-162768c1a1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.466416 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadb6b6-c40c-4955-9d6b-162768c1a1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.467168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadb6b6-c40c-4955-9d6b-162768c1a1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.468796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadb6b6-c40c-4955-9d6b-162768c1a1d4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.471498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20242653-98a8-451b-bd91-e354574539be admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.476570 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e99d9-393e-491c-8ef1-b7bc75f071ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.477235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e99d9-393e-491c-8ef1-b7bc75f071ca admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.477522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e99d9-393e-491c-8ef1-b7bc75f071ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.478137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e99d9-393e-491c-8ef1-b7bc75f071ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.479254 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e99d9-393e-491c-8ef1-b7bc75f071ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.481012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e99d9-393e-491c-8ef1-b7bc75f071ca admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.481666 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 786/1572] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:24.484964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadb6b6-c40c-4955-9d6b-162768c1a1d4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.503792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadb6b6-c40c-4955-9d6b-162768c1a1d4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.512484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abd42f-e15d-45a4-b919-0606a369f58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.514239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abd42f-e15d-45a4-b919-0606a369f58e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.514588 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abd42f-e15d-45a4-b919-0606a369f58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.514871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abd42f-e15d-45a4-b919-0606a369f58e admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.515707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abd42f-e15d-45a4-b919-0606a369f58e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:16:24.516087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abd42f-e15d-45a4-b919-0606a369f58e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.518104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abd42f-e15d-45a4-b919-0606a369f58e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.526013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 787/1573] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/projects => generated 401 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:24.527253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e99d9-393e-491c-8ef1-b7bc75f071ca admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.533764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 787/1574] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:16:24.534782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abd42f-e15d-45a4-b919-0606a369f58e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.546000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abd42f-e15d-45a4-b919-0606a369f58e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.601137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e99d9-393e-491c-8ef1-b7bc75f071ca admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.607033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476125a0-46ad-4f5d-b1a9-190d40a4b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.607636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476125a0-46ad-4f5d-b1a9-190d40a4b8cf admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.607895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476125a0-46ad-4f5d-b1a9-190d40a4b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.608201 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476125a0-46ad-4f5d-b1a9-190d40a4b8cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.608973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476125a0-46ad-4f5d-b1a9-190d40a4b8cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.611012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476125a0-46ad-4f5d-b1a9-190d40a4b8cf admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.620932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd9c79-dd12-4b6f-96d1-be50cd83d62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.622082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd9c79-dd12-4b6f-96d1-be50cd83d62d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.622370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd9c79-dd12-4b6f-96d1-be50cd83d62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.622676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd9c79-dd12-4b6f-96d1-be50cd83d62d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.623381 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd9c79-dd12-4b6f-96d1-be50cd83d62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.625427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd9c79-dd12-4b6f-96d1-be50cd83d62d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.629959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:24.644054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 788/1575] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/projects => generated 355 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:24.648999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476125a0-46ad-4f5d-b1a9-190d40a4b8cf admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.661274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 788/1576] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:24.662146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd9c79-dd12-4b6f-96d1-be50cd83d62d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.712739 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:24.728547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476125a0-46ad-4f5d-b1a9-190d40a4b8cf admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.740790 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd9c79-dd12-4b6f-96d1-be50cd83d62d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.746927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5e129-0df6-4f61-b401-3ca3aafbe2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.748117 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5e129-0df6-4f61-b401-3ca3aafbe2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.748735 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5e129-0df6-4f61-b401-3ca3aafbe2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.749193 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5e129-0df6-4f61-b401-3ca3aafbe2e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.750232 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5e129-0df6-4f61-b401-3ca3aafbe2e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.752903 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5e129-0df6-4f61-b401-3ca3aafbe2e6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.787611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 789/1577] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:24.787611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5e129-0df6-4f61-b401-3ca3aafbe2e6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.804316 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0656e37-0962-418b-bb8a-2e8576c7461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.805139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0656e37-0962-418b-bb8a-2e8576c7461a admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.805517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0656e37-0962-418b-bb8a-2e8576c7461a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.805897 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0656e37-0962-418b-bb8a-2e8576c7461a admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.806737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0656e37-0962-418b-bb8a-2e8576c7461a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.809263 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0656e37-0962-418b-bb8a-2e8576c7461a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.841328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 789/1578] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/projects => generated 389 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:24.841328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0656e37-0962-418b-bb8a-2e8576c7461a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.869283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5e129-0df6-4f61-b401-3ca3aafbe2e6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.920948 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0656e37-0962-418b-bb8a-2e8576c7461a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.928292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ed316-dd75-45e2-82a3-70ca64370707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.929653 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ed316-dd75-45e2-82a3-70ca64370707 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.929802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ed316-dd75-45e2-82a3-70ca64370707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.930020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ed316-dd75-45e2-82a3-70ca64370707 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.930810 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ed316-dd75-45e2-82a3-70ca64370707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.932834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ed316-dd75-45e2-82a3-70ca64370707 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.957129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 790/1579] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/users => generated 301 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:24.958231 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ed316-dd75-45e2-82a3-70ca64370707 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:24.969079 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0344e-2c1f-4033-8938-e4e059b36650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.969985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0344e-2c1f-4033-8938-e4e059b36650 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.970135 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ed316-dd75-45e2-82a3-70ca64370707 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:24.970600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0344e-2c1f-4033-8938-e4e059b36650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.971126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0344e-2c1f-4033-8938-e4e059b36650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.972126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0344e-2c1f-4033-8938-e4e059b36650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.976090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0344e-2c1f-4033-8938-e4e059b36650 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.977444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896bcbf-94e7-4ad1-8872-95e2188f1513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:24.981587 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896bcbf-94e7-4ad1-8872-95e2188f1513 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:24.982148 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896bcbf-94e7-4ad1-8872-95e2188f1513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:24.983304 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896bcbf-94e7-4ad1-8872-95e2188f1513 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:24.983921 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896bcbf-94e7-4ad1-8872-95e2188f1513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:24.986174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896bcbf-94e7-4ad1-8872-95e2188f1513 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:24.996677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 790/1580] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:24.998551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0344e-2c1f-4033-8938-e4e059b36650 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.014573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0344e-2c1f-4033-8938-e4e059b36650 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.020673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7daf7-08e8-4925-ad01-c0b1ecab2cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.022780 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7daf7-08e8-4925-ad01-c0b1ecab2cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.023267 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7daf7-08e8-4925-ad01-c0b1ecab2cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.023750 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7daf7-08e8-4925-ad01-c0b1ecab2cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.024774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7daf7-08e8-4925-ad01-c0b1ecab2cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.029986 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 791/1581] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:25.029986 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896bcbf-94e7-4ad1-8872-95e2188f1513 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.030985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7daf7-08e8-4925-ad01-c0b1ecab2cb4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.042756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:25.057663 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 791/1582] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:24 2022] POST /identity/v3/users => generated 278 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:25.058981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7daf7-08e8-4925-ad01-c0b1ecab2cb4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.072661 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7daf7-08e8-4925-ad01-c0b1ecab2cb4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.090415 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:25.108871 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896bcbf-94e7-4ad1-8872-95e2188f1513 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.114381 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb88df1-d541-4859-894c-efff66cec6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.115692 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb88df1-d541-4859-894c-efff66cec6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.115956 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb88df1-d541-4859-894c-efff66cec6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.116531 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb88df1-d541-4859-894c-efff66cec6d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.117228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb88df1-d541-4859-894c-efff66cec6d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.119274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb88df1-d541-4859-894c-efff66cec6d6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.144976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 792/1583] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:25 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:25.147204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb88df1-d541-4859-894c-efff66cec6d6 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.164826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb88df1-d541-4859-894c-efff66cec6d6 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.165818 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee02633-3e99-4eb8-9a62-61daec2fb197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.166900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee02633-3e99-4eb8-9a62-61daec2fb197 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.167412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee02633-3e99-4eb8-9a62-61daec2fb197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.168455 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee02633-3e99-4eb8-9a62-61daec2fb197 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.169701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee02633-3e99-4eb8-9a62-61daec2fb197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.172089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee02633-3e99-4eb8-9a62-61daec2fb197 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.173155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e214cd-52ed-459c-a9cd-2eeee53f5830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.173949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e214cd-52ed-459c-a9cd-2eeee53f5830 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.174266 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e214cd-52ed-459c-a9cd-2eeee53f5830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.174749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e214cd-52ed-459c-a9cd-2eeee53f5830 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.178558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e214cd-52ed-459c-a9cd-2eeee53f5830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.180668 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e214cd-52ed-459c-a9cd-2eeee53f5830 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.196313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 792/1584] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:25 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:25.199965 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee02633-3e99-4eb8-9a62-61daec2fb197 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.209404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee02633-3e99-4eb8-9a62-61daec2fb197 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.210069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 793/1585] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:25 2022] POST /identity/v3/users => generated 295 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:25.211005 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e214cd-52ed-459c-a9cd-2eeee53f5830 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.215439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10a968-e2c3-49cf-81ec-3e1e6ca17923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.216130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10a968-e2c3-49cf-81ec-3e1e6ca17923 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.216587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10a968-e2c3-49cf-81ec-3e1e6ca17923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.216878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10a968-e2c3-49cf-81ec-3e1e6ca17923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.217619 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10a968-e2c3-49cf-81ec-3e1e6ca17923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.219472 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10a968-e2c3-49cf-81ec-3e1e6ca17923 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.222516 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e214cd-52ed-459c-a9cd-2eeee53f5830 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.228243 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509f06e-1a43-4d79-84f9-7ae93dd998e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.230390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509f06e-1a43-4d79-84f9-7ae93dd998e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.230982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509f06e-1a43-4d79-84f9-7ae93dd998e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.231515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509f06e-1a43-4d79-84f9-7ae93dd998e8 admin admin] PATH_INFO: `/v3/projects/595c1599f6f04ab0a1ac33fb61f107ff/users/c5d0829ddcfe4116a0d180ff6d89bd20/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.232430 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 793/1586] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:25.233527 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10a968-e2c3-49cf-81ec-3e1e6ca17923 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.245999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10a968-e2c3-49cf-81ec-3e1e6ca17923 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.252865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568f2ee-ad85-43b3-8f29-4e6b3ed8bb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.253469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509f06e-1a43-4d79-84f9-7ae93dd998e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=595c1599f6f04ab0a1ac33fb61f107ff, user_id=c5d0829ddcfe4116a0d180ff6d89bd20, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.253605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568f2ee-ad85-43b3-8f29-4e6b3ed8bb07 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.253826 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568f2ee-ad85-43b3-8f29-4e6b3ed8bb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.254113 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568f2ee-ad85-43b3-8f29-4e6b3ed8bb07 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.254871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568f2ee-ad85-43b3-8f29-4e6b3ed8bb07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.257412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568f2ee-ad85-43b3-8f29-4e6b3ed8bb07 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.258675 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509f06e-1a43-4d79-84f9-7ae93dd998e8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.275962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 794/1587] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:25 2022] PUT /identity/v3/projects/595c1599f6f04ab0a1ac33fb61f107ff/users/c5d0829ddcfe4116a0d180ff6d89bd20/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:25.277184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509f06e-1a43-4d79-84f9-7ae93dd998e8 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.285473 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 794/1588] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:25 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:25.286389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568f2ee-ad85-43b3-8f29-4e6b3ed8bb07 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.298156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568f2ee-ad85-43b3-8f29-4e6b3ed8bb07 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.350764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509f06e-1a43-4d79-84f9-7ae93dd998e8 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.356032 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d263f-e92b-4910-92c0-a57b62dba5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.356843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d263f-e92b-4910-92c0-a57b62dba5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.357227 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d263f-e92b-4910-92c0-a57b62dba5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.357602 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d263f-e92b-4910-92c0-a57b62dba5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.358526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d263f-e92b-4910-92c0-a57b62dba5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.360436 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d263f-e92b-4910-92c0-a57b62dba5e6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.378218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 795/1589] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:25.378218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d263f-e92b-4910-92c0-a57b62dba5e6 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.382167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064cf97-4751-4e71-aef4-529142e6b9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.383163 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064cf97-4751-4e71-aef4-529142e6b9bf admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.383495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064cf97-4751-4e71-aef4-529142e6b9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.383781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064cf97-4751-4e71-aef4-529142e6b9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.384579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064cf97-4751-4e71-aef4-529142e6b9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.386921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064cf97-4751-4e71-aef4-529142e6b9bf admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.393709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d263f-e92b-4910-92c0-a57b62dba5e6 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.401515 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 795/1590] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:25.401515 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064cf97-4751-4e71-aef4-529142e6b9bf admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.402987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fdb08-6673-4490-a823-1e15882c726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.403846 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fdb08-6673-4490-a823-1e15882c726b admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.404142 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fdb08-6673-4490-a823-1e15882c726b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.404449 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fdb08-6673-4490-a823-1e15882c726b admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.405935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fdb08-6673-4490-a823-1e15882c726b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.408559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fdb08-6673-4490-a823-1e15882c726b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.411101 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064cf97-4751-4e71-aef4-529142e6b9bf admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.417801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e0873-07be-45bd-82f0-8fca3b807183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.418691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e0873-07be-45bd-82f0-8fca3b807183 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.419220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e0873-07be-45bd-82f0-8fca3b807183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.419567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e0873-07be-45bd-82f0-8fca3b807183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.420374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e0873-07be-45bd-82f0-8fca3b807183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.422063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e0873-07be-45bd-82f0-8fca3b807183 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.426867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 796/1591] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:25.429556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fdb08-6673-4490-a823-1e15882c726b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.440974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 796/1592] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:25.442488 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fa9a4-3d2c-450e-b776-c92d53b9bea7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.442924 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fa9a4-3d2c-450e-b776-c92d53b9bea7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.443679 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fa9a4-3d2c-450e-b776-c92d53b9bea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.444404 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fdb08-6673-4490-a823-1e15882c726b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.450596 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a60cc-db69-447a-84a9-617f3272583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.452645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a60cc-db69-447a-84a9-617f3272583a admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.453128 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a60cc-db69-447a-84a9-617f3272583a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.453570 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a60cc-db69-447a-84a9-617f3272583a admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.454788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a60cc-db69-447a-84a9-617f3272583a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.456812 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a60cc-db69-447a-84a9-617f3272583a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.469261 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-134fa9a4-3d2c-450e-b776-c92d53b9bea7 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:25.470804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-134fa9a4-3d2c-450e-b776-c92d53b9bea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:25.474976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 797/1593] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:25.474976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a60cc-db69-447a-84a9-617f3272583a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.485289 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 797/1594] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:25.485289 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fa9a4-3d2c-450e-b776-c92d53b9bea7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.487262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a60cc-db69-447a-84a9-617f3272583a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.493951 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc1dbf-9196-4ccf-9053-5de984ca306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.494748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc1dbf-9196-4ccf-9053-5de984ca306e admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.495112 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc1dbf-9196-4ccf-9053-5de984ca306e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.495525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc1dbf-9196-4ccf-9053-5de984ca306e admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.496327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc1dbf-9196-4ccf-9053-5de984ca306e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.498217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc1dbf-9196-4ccf-9053-5de984ca306e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.503436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fa9a4-3d2c-450e-b776-c92d53b9bea7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.509677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132c9e1-add0-43db-8a8f-e8cb5ba4ea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.510539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132c9e1-add0-43db-8a8f-e8cb5ba4ea52 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.510825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132c9e1-add0-43db-8a8f-e8cb5ba4ea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.511131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132c9e1-add0-43db-8a8f-e8cb5ba4ea52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.512046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132c9e1-add0-43db-8a8f-e8cb5ba4ea52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.513878 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 798/1595] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:25.514873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc1dbf-9196-4ccf-9053-5de984ca306e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.518059 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132c9e1-add0-43db-8a8f-e8cb5ba4ea52 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.530151 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc1dbf-9196-4ccf-9053-5de984ca306e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.533621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 798/1596] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:25.534461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132c9e1-add0-43db-8a8f-e8cb5ba4ea52 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.543879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b21929-7e43-4ea6-ad97-2ef041ef88a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.544692 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b21929-7e43-4ea6-ad97-2ef041ef88a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.545084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b21929-7e43-4ea6-ad97-2ef041ef88a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.545375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b21929-7e43-4ea6-ad97-2ef041ef88a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.545931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132c9e1-add0-43db-8a8f-e8cb5ba4ea52 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.546117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b21929-7e43-4ea6-ad97-2ef041ef88a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.548032 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b21929-7e43-4ea6-ad97-2ef041ef88a3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.551368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33333bb-f074-4e58-9a84-1b273c1605b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.552175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33333bb-f074-4e58-9a84-1b273c1605b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.552877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33333bb-f074-4e58-9a84-1b273c1605b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.553146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33333bb-f074-4e58-9a84-1b273c1605b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.553876 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33333bb-f074-4e58-9a84-1b273c1605b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.555620 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33333bb-f074-4e58-9a84-1b273c1605b4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.560891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 799/1597] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:25.562043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b21929-7e43-4ea6-ad97-2ef041ef88a3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.573557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b21929-7e43-4ea6-ad97-2ef041ef88a3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.578580 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 799/1598] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:25.578580 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33333bb-f074-4e58-9a84-1b273c1605b4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.583112 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78152e40-3a09-4604-a7ad-7ef361d202a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.584756 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78152e40-3a09-4604-a7ad-7ef361d202a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.585216 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78152e40-3a09-4604-a7ad-7ef361d202a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.585719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78152e40-3a09-4604-a7ad-7ef361d202a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.586710 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78152e40-3a09-4604-a7ad-7ef361d202a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.588570 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78152e40-3a09-4604-a7ad-7ef361d202a5 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.591544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33333bb-f074-4e58-9a84-1b273c1605b4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.598146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0fa8e-fb28-4f14-80b3-ed83a9ffa3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.600605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0fa8e-fb28-4f14-80b3-ed83a9ffa3d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.600995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0fa8e-fb28-4f14-80b3-ed83a9ffa3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.601402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0fa8e-fb28-4f14-80b3-ed83a9ffa3d5 admin admin] PATH_INFO: `/v3/projects/c8df3d2bdc8b44e7a86a5e56edb6b2ce/users/45b17abc760a41f685f75f508d735bcb/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.604827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 800/1599] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:25.605970 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78152e40-3a09-4604-a7ad-7ef361d202a5 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.622384 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:25.636395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0fa8e-fb28-4f14-80b3-ed83a9ffa3d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8df3d2bdc8b44e7a86a5e56edb6b2ce, user_id=45b17abc760a41f685f75f508d735bcb, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.640521 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0fa8e-fb28-4f14-80b3-ed83a9ffa3d5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.669456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 800/1600] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:25 2022] PUT /identity/v3/projects/c8df3d2bdc8b44e7a86a5e56edb6b2ce/users/45b17abc760a41f685f75f508d735bcb/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:25.669456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0fa8e-fb28-4f14-80b3-ed83a9ffa3d5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.675608 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:25.697712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78152e40-3a09-4604-a7ad-7ef361d202a5 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.786030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0fa8e-fb28-4f14-80b3-ed83a9ffa3d5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.792936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3dccd-54cc-4517-87b0-88a366410b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.793907 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3dccd-54cc-4517-87b0-88a366410b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.794090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3dccd-54cc-4517-87b0-88a366410b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.794357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3dccd-54cc-4517-87b0-88a366410b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.795725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3dccd-54cc-4517-87b0-88a366410b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.797402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3dccd-54cc-4517-87b0-88a366410b7b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.799487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299ed72-b20e-439e-9831-6ba949e5ea23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.800377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299ed72-b20e-439e-9831-6ba949e5ea23 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.800564 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299ed72-b20e-439e-9831-6ba949e5ea23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.800724 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299ed72-b20e-439e-9831-6ba949e5ea23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.810462 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 801/1601] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:25.814030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3dccd-54cc-4517-87b0-88a366410b7b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.814170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299ed72-b20e-439e-9831-6ba949e5ea23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.814955 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299ed72-b20e-439e-9831-6ba949e5ea23 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.826266 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 801/1602] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:25.827425 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299ed72-b20e-439e-9831-6ba949e5ea23 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.828617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3dccd-54cc-4517-87b0-88a366410b7b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.836480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6637d-b1e6-4915-bc3c-d2db141faeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.837748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6637d-b1e6-4915-bc3c-d2db141faeb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.838034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6637d-b1e6-4915-bc3c-d2db141faeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.838313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6637d-b1e6-4915-bc3c-d2db141faeb7 admin admin] PATH_INFO: `/v3/projects/7a8dec49cf33465993ab41c96ac16e84/users/fd3c802c51c34e05bc1fc3ee1be1c03f/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.840812 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299ed72-b20e-439e-9831-6ba949e5ea23 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:25.846890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08161edc-9340-4f82-929f-bb24c17d87fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:25.847978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08161edc-9340-4f82-929f-bb24c17d87fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:25.848387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08161edc-9340-4f82-929f-bb24c17d87fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:25.848817 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08161edc-9340-4f82-929f-bb24c17d87fc admin admin] PATH_INFO: `/v3/projects/ff05c8cec4f747f1b22d30f282403d68/users/f470ec09198d44e7b90d85a8d8fea79c/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:25.862247 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6637d-b1e6-4915-bc3c-d2db141faeb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8dec49cf33465993ab41c96ac16e84, user_id=fd3c802c51c34e05bc1fc3ee1be1c03f, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.865808 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6637d-b1e6-4915-bc3c-d2db141faeb7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.878897 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08161edc-9340-4f82-929f-bb24c17d87fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff05c8cec4f747f1b22d30f282403d68, user_id=f470ec09198d44e7b90d85a8d8fea79c, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:25.882356 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08161edc-9340-4f82-929f-bb24c17d87fc admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:25.891977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 802/1603] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:25 2022] PUT /identity/v3/projects/7a8dec49cf33465993ab41c96ac16e84/users/fd3c802c51c34e05bc1fc3ee1be1c03f/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:25.893185 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6637d-b1e6-4915-bc3c-d2db141faeb7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:25.914543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 802/1604] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:25 2022] PUT /identity/v3/projects/ff05c8cec4f747f1b22d30f282403d68/users/f470ec09198d44e7b90d85a8d8fea79c/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:25.917465 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08161edc-9340-4f82-929f-bb24c17d87fc admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:26.001000 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08161edc-9340-4f82-929f-bb24c17d87fc admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:26.008954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45a1da-1004-4acc-9a4f-fe6623d8aeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:26.008954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45a1da-1004-4acc-9a4f-fe6623d8aeb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:26.008954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45a1da-1004-4acc-9a4f-fe6623d8aeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:26.008954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45a1da-1004-4acc-9a4f-fe6623d8aeb5 admin admin] PATH_INFO: `/v3/projects/1ef76a1224a7440083db1884d9efb9d0/users/9b1d8005a49f4760ab587ca00edd2ae9/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:26.028594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45a1da-1004-4acc-9a4f-fe6623d8aeb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef76a1224a7440083db1884d9efb9d0, user_id=9b1d8005a49f4760ab587ca00edd2ae9, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:26.031477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45a1da-1004-4acc-9a4f-fe6623d8aeb5 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:26.110167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 803/1605] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:25 2022] PUT /identity/v3/projects/1ef76a1224a7440083db1884d9efb9d0/users/9b1d8005a49f4760ab587ca00edd2ae9/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:26.110167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cffee-7157-44f5-ad7f-4827443fa300 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:26.110167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cffee-7157-44f5-ad7f-4827443fa300 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:26.110167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cffee-7157-44f5-ad7f-4827443fa300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:26.111114 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6637d-b1e6-4915-bc3c-d2db141faeb7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:26.118087 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-be7cffee-7157-44f5-ad7f-4827443fa300 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:26.121952 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-be7cffee-7157-44f5-ad7f-4827443fa300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:26.181169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcdd79-5b92-4aec-99ee-56c0ce05d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:26.182572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcdd79-5b92-4aec-99ee-56c0ce05d660 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:26.184000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcdd79-5b92-4aec-99ee-56c0ce05d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:26.184530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcdd79-5b92-4aec-99ee-56c0ce05d660 admin admin] PATH_INFO: `/v3/projects/1b824fbfefad4fb39eba091100221eb0/users/a423bf6bcefb438887d7f726de0aca75/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:26.203354 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:26.209297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcdd79-5b92-4aec-99ee-56c0ce05d660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b824fbfefad4fb39eba091100221eb0, user_id=a423bf6bcefb438887d7f726de0aca75, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:26.213955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcdd79-5b92-4aec-99ee-56c0ce05d660 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:26.246479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 803/1606] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:25 2022] PUT /identity/v3/projects/1b824fbfefad4fb39eba091100221eb0/users/a423bf6bcefb438887d7f726de0aca75/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:26.246479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcdd79-5b92-4aec-99ee-56c0ce05d660 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:26.253772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:26.277338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 804/1607] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:26.278880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85a2ec-c86d-459c-b838-a225eaf2c309 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:26.279177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85a2ec-c86d-459c-b838-a225eaf2c309 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:26.279462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85a2ec-c86d-459c-b838-a225eaf2c309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:26.358173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcdd79-5b92-4aec-99ee-56c0ce05d660 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:26.359451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ff85a2ec-c86d-459c-b838-a225eaf2c309 None None] MFA Rules not processed for user `fd3c802c51c34e05bc1fc3ee1be1c03f`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:26.360824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ff85a2ec-c86d-459c-b838-a225eaf2c309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:26.372673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268c6f9-e872-4613-8953-40fd17fbbefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:26.373926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268c6f9-e872-4613-8953-40fd17fbbefa admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:26.374619 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268c6f9-e872-4613-8953-40fd17fbbefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:26.377332 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268c6f9-e872-4613-8953-40fd17fbbefa admin admin] PATH_INFO: `/v3/projects/fb6611b36fe8476b9bbf5379f0bc5cca/users/63d83f431b07411ea8a6d221a03a9d97/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:26.424746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268c6f9-e872-4613-8953-40fd17fbbefa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6611b36fe8476b9bbf5379f0bc5cca, user_id=63d83f431b07411ea8a6d221a03a9d97, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:26.429348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268c6f9-e872-4613-8953-40fd17fbbefa admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:26.447730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 804/1608] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:26 2022] PUT /identity/v3/projects/fb6611b36fe8476b9bbf5379f0bc5cca/users/63d83f431b07411ea8a6d221a03a9d97/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:26.449381 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4973226-f240-42ee-bd46-818320763a82 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:26.449812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4973226-f240-42ee-bd46-818320763a82 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:26.450261 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4973226-f240-42ee-bd46-818320763a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:26.491493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b4973226-f240-42ee-bd46-818320763a82 None None] MFA Rules not processed for user `f470ec09198d44e7b90d85a8d8fea79c`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:26.492906 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b4973226-f240-42ee-bd46-818320763a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:26.511889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 805/1609] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:26.513647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3a136-3476-4ec3-a917-4342a1c62a57 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:26.514097 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3a136-3476-4ec3-a917-4342a1c62a57 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:26.514563 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3a136-3476-4ec3-a917-4342a1c62a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:26.535413 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-11d3a136-3476-4ec3-a917-4342a1c62a57 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:26.538406 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-11d3a136-3476-4ec3-a917-4342a1c62a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:26.587322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 805/1610] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:26.587322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86241a02-8be5-4082-91d6-1502c284f96b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:26.587322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86241a02-8be5-4082-91d6-1502c284f96b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:26.587322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86241a02-8be5-4082-91d6-1502c284f96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:26.620136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 806/1611] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:26.621171 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3a136-3476-4ec3-a917-4342a1c62a57 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:26.622560 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-86241a02-8be5-4082-91d6-1502c284f96b None None] MFA Rules not processed for user `a423bf6bcefb438887d7f726de0aca75`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:26.623938 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-86241a02-8be5-4082-91d6-1502c284f96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:26.718086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:26.746508 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 806/1612] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:26.752738 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdceeb-24f0-4fe9-959e-966ea7f7a1a7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:26.753293 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdceeb-24f0-4fe9-959e-966ea7f7a1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:26.753689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdceeb-24f0-4fe9-959e-966ea7f7a1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:26.760646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3a136-3476-4ec3-a917-4342a1c62a57 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:26.781373 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91abedd-f412-4702-8e56-548981816f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:26.782057 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91abedd-f412-4702-8e56-548981816f91 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:26.782342 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91abedd-f412-4702-8e56-548981816f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:26.782666 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91abedd-f412-4702-8e56-548981816f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:26.795358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91abedd-f412-4702-8e56-548981816f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:26.797320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91abedd-f412-4702-8e56-548981816f91 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:26.804522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0bfdceeb-24f0-4fe9-959e-966ea7f7a1a7 None None] MFA Rules not processed for user `63d83f431b07411ea8a6d221a03a9d97`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:26.805893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0bfdceeb-24f0-4fe9-959e-966ea7f7a1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:26.813232 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 807/1613] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:26.816146 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91abedd-f412-4702-8e56-548981816f91 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:26.846997 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91abedd-f412-4702-8e56-548981816f91 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:26.865363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae0ac0-93fc-486f-bb40-33e168ba9232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:26.870081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae0ac0-93fc-486f-bb40-33e168ba9232 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:26.870461 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae0ac0-93fc-486f-bb40-33e168ba9232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:26.871065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae0ac0-93fc-486f-bb40-33e168ba9232 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:26.873606 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae0ac0-93fc-486f-bb40-33e168ba9232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:26.879033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae0ac0-93fc-486f-bb40-33e168ba9232 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:26.928974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 807/1614] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:26.928974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc2af3-2fc1-4580-ac58-4617ad605021 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:26.929279 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc2af3-2fc1-4580-ac58-4617ad605021 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:26.929928 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc2af3-2fc1-4580-ac58-4617ad605021 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:26.931948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 808/1615] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jun 16 16:16:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:16:26.933359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c78418-b4e9-4da7-bf4b-b8c1c7f38156 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:26.933639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c78418-b4e9-4da7-bf4b-b8c1c7f38156 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:26.934015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c78418-b4e9-4da7-bf4b-b8c1c7f38156 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:26.937001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 808/1616] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:26 2022] POST /identity/v3/projects => generated 357 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:26.937853 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae0ac0-93fc-486f-bb40-33e168ba9232 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:26.945034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 809/1617] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jun 16 16:16:26 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:16:26.946066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c78418-b4e9-4da7-bf4b-b8c1c7f38156 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:26.961025 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:27.044681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c78418-b4e9-4da7-bf4b-b8c1c7f38156 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:27.049879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41d418-b7d5-4eba-9f03-b033a62cf7fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:27.050711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41d418-b7d5-4eba-9f03-b033a62cf7fe service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:27.051263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41d418-b7d5-4eba-9f03-b033a62cf7fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:27.051538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41d418-b7d5-4eba-9f03-b033a62cf7fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:27.057010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae0ac0-93fc-486f-bb40-33e168ba9232 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:27.070391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41d418-b7d5-4eba-9f03-b033a62cf7fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:27.073126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41d418-b7d5-4eba-9f03-b033a62cf7fe service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:27.073910 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5176337-ed62-40af-b4e3-0418ffd7ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:27.074683 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5176337-ed62-40af-b4e3-0418ffd7ce2b admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:27.077954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5176337-ed62-40af-b4e3-0418ffd7ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:27.078341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5176337-ed62-40af-b4e3-0418ffd7ce2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:27.079024 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5176337-ed62-40af-b4e3-0418ffd7ce2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:27.081005 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5176337-ed62-40af-b4e3-0418ffd7ce2b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:27.100506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 810/1618] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:27.103973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a5e12-f8d0-4d64-a7b6-dbf5ca3bdff1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:27.104268 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a5e12-f8d0-4d64-a7b6-dbf5ca3bdff1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:27.104549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a5e12-f8d0-4d64-a7b6-dbf5ca3bdff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:27.132722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 809/1619] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:26 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:27.134009 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5176337-ed62-40af-b4e3-0418ffd7ce2b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:27.154250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-496a5e12-f8d0-4d64-a7b6-dbf5ca3bdff1 None None] MFA Rules not processed for user `795c029cb14b42b5b0f3987e218d4239`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:27.156544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-496a5e12-f8d0-4d64-a7b6-dbf5ca3bdff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:27.273661 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5176337-ed62-40af-b4e3-0418ffd7ce2b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:27.284276 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b690c-32d1-4e99-b34c-4ca24e307406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:27.287202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b690c-32d1-4e99-b34c-4ca24e307406 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:27.287669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b690c-32d1-4e99-b34c-4ca24e307406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:27.288015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b690c-32d1-4e99-b34c-4ca24e307406 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:27.288791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b690c-32d1-4e99-b34c-4ca24e307406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:27.293497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b690c-32d1-4e99-b34c-4ca24e307406 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:27.307115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 811/1620] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jun 16 16:16:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:27.308761 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612044ef-d1c0-46c5-8ec2-560d23f9b729 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:27.309052 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612044ef-d1c0-46c5-8ec2-560d23f9b729 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:27.309329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612044ef-d1c0-46c5-8ec2-560d23f9b729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:27.344333 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 810/1621] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:27 2022] POST /identity/v3/users => generated 285 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:27.344333 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b690c-32d1-4e99-b34c-4ca24e307406 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:27.368589 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-612044ef-d1c0-46c5-8ec2-560d23f9b729 None None] MFA Rules not processed for user `795c029cb14b42b5b0f3987e218d4239`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:27.372099 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-612044ef-d1c0-46c5-8ec2-560d23f9b729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:27.377643 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b690c-32d1-4e99-b34c-4ca24e307406 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:27.390895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b999e49-562c-4362-8dc2-c341f6a035bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:27.391613 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b999e49-562c-4362-8dc2-c341f6a035bc admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:27.391901 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b999e49-562c-4362-8dc2-c341f6a035bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:27.392571 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b999e49-562c-4362-8dc2-c341f6a035bc admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:27.394113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b999e49-562c-4362-8dc2-c341f6a035bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:27.398218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 812/1622] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jun 16 16:16:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:27.398218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612044ef-d1c0-46c5-8ec2-560d23f9b729 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:27.399051 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b999e49-562c-4362-8dc2-c341f6a035bc admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:27.424520 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612044ef-d1c0-46c5-8ec2-560d23f9b729 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:27.436809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a49ee-30fc-428e-93b2-3e985b86e62a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:27.439318 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a49ee-30fc-428e-93b2-3e985b86e62a service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:27.439605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a49ee-30fc-428e-93b2-3e985b86e62a service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:27.439880 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a49ee-30fc-428e-93b2-3e985b86e62a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:27.444844 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 811/1623] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:27 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:27.446747 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b999e49-562c-4362-8dc2-c341f6a035bc admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:27.459963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b999e49-562c-4362-8dc2-c341f6a035bc admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:27.463728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:27.465316 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22282419-6f2c-45d6-b915-da33d8f70e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:27.466168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22282419-6f2c-45d6-b915-da33d8f70e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:27.466578 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22282419-6f2c-45d6-b915-da33d8f70e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:27.467316 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22282419-6f2c-45d6-b915-da33d8f70e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:27.467855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22282419-6f2c-45d6-b915-da33d8f70e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:27.469954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22282419-6f2c-45d6-b915-da33d8f70e3a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:27.486358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 812/1624] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:27.486358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22282419-6f2c-45d6-b915-da33d8f70e3a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:27.502299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22282419-6f2c-45d6-b915-da33d8f70e3a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:27.510312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3d8ea-eedd-4cd0-8af2-f29d7681b49a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:27.510645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3d8ea-eedd-4cd0-8af2-f29d7681b49a service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:27.511149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3d8ea-eedd-4cd0-8af2-f29d7681b49a service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:27.511541 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3d8ea-eedd-4cd0-8af2-f29d7681b49a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:27.586263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a49ee-30fc-428e-93b2-3e985b86e62a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:27.589108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a49ee-30fc-428e-93b2-3e985b86e62a service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:27.603353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 813/1625] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:27.604673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a49ee-30fc-428e-93b2-3e985b86e62a service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:27.617660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a49ee-30fc-428e-93b2-3e985b86e62a service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:27.623320 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a814b-82e4-4a03-86d5-cecea3242f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:27.624524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a814b-82e4-4a03-86d5-cecea3242f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:27.624970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a814b-82e4-4a03-86d5-cecea3242f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:27.625805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a814b-82e4-4a03-86d5-cecea3242f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:27.626952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a814b-82e4-4a03-86d5-cecea3242f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:27.628788 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a814b-82e4-4a03-86d5-cecea3242f63 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:27.632508 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:27.649621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 814/1626] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:27.650822 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a814b-82e4-4a03-86d5-cecea3242f63 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:27.653374 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3d8ea-eedd-4cd0-8af2-f29d7681b49a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:27.655146 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3d8ea-eedd-4cd0-8af2-f29d7681b49a service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:27.668284 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a814b-82e4-4a03-86d5-cecea3242f63 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:27.681300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380afac-b255-4508-93b7-8ae5a95bb8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:27.683565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380afac-b255-4508-93b7-8ae5a95bb8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:27.684610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380afac-b255-4508-93b7-8ae5a95bb8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:27.685071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380afac-b255-4508-93b7-8ae5a95bb8ce admin admin] PATH_INFO: `/v3/projects/b75585fe51ca4b148230f32a723e5c4a/users/27deadd28c2f4d75a7f224fed925ee05/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:27.686087 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 813/1627] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:27.687074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3d8ea-eedd-4cd0-8af2-f29d7681b49a service nova] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:27.716277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3d8ea-eedd-4cd0-8af2-f29d7681b49a service nova] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:27.730636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13166c0-b0f9-493c-b1f0-d83bf68a0ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:27.730891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380afac-b255-4508-93b7-8ae5a95bb8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75585fe51ca4b148230f32a723e5c4a, user_id=27deadd28c2f4d75a7f224fed925ee05, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:27.731565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13166c0-b0f9-493c-b1f0-d83bf68a0ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:27.731851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13166c0-b0f9-493c-b1f0-d83bf68a0ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:27.732132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13166c0-b0f9-493c-b1f0-d83bf68a0ed8 admin admin] PATH_INFO: `/v3/projects/d87d30492a6e4f01aad6f65cbb4beae3/users/451124e8d2b74d029e20c6eb132114e0/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:27.736104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380afac-b255-4508-93b7-8ae5a95bb8ce admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:27.767969 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13166c0-b0f9-493c-b1f0-d83bf68a0ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d87d30492a6e4f01aad6f65cbb4beae3, user_id=451124e8d2b74d029e20c6eb132114e0, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:27.774002 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13166c0-b0f9-493c-b1f0-d83bf68a0ed8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:27.777354 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 815/1628] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:27 2022] PUT /identity/v3/projects/b75585fe51ca4b148230f32a723e5c4a/users/27deadd28c2f4d75a7f224fed925ee05/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:27.778887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380afac-b255-4508-93b7-8ae5a95bb8ce admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:27.805423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 814/1629] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:27 2022] PUT /identity/v3/projects/d87d30492a6e4f01aad6f65cbb4beae3/users/451124e8d2b74d029e20c6eb132114e0/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:27.809202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13166c0-b0f9-493c-b1f0-d83bf68a0ed8 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:27.923669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380afac-b255-4508-93b7-8ae5a95bb8ce admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:27.937570 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cf4ac-db6e-4e41-8d24-1246dfb14a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:27.938368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cf4ac-db6e-4e41-8d24-1246dfb14a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:27.939171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cf4ac-db6e-4e41-8d24-1246dfb14a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:27.939520 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cf4ac-db6e-4e41-8d24-1246dfb14a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:27.941184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13166c0-b0f9-493c-b1f0-d83bf68a0ed8 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:27.941745 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cf4ac-db6e-4e41-8d24-1246dfb14a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:27.945667 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cf4ac-db6e-4e41-8d24-1246dfb14a12 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:27.954250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117347f3-2a46-4270-b673-8aa7abeba762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:27.955216 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117347f3-2a46-4270-b673-8aa7abeba762 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:27.955890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117347f3-2a46-4270-b673-8aa7abeba762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:27.956278 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117347f3-2a46-4270-b673-8aa7abeba762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:27.957527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117347f3-2a46-4270-b673-8aa7abeba762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:27.962372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117347f3-2a46-4270-b673-8aa7abeba762 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:27.977491 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 816/1630] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:27.978639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cf4ac-db6e-4e41-8d24-1246dfb14a12 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:28.002310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 815/1631] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:16:28.007646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117347f3-2a46-4270-b673-8aa7abeba762 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:28.014039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cf4ac-db6e-4e41-8d24-1246dfb14a12 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:28.033476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117347f3-2a46-4270-b673-8aa7abeba762 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:28.044721 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05736b-3263-4162-bc39-a011575b814d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:28.049908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c4495-0197-4ab3-8802-39c7f4aba700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:28.051149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c4495-0197-4ab3-8802-39c7f4aba700 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:28.051406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c4495-0197-4ab3-8802-39c7f4aba700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:28.051677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c4495-0197-4ab3-8802-39c7f4aba700 admin admin] PATH_INFO: `/v3/projects/b75585fe51ca4b148230f32a723e5c4a/users/27deadd28c2f4d75a7f224fed925ee05/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:28.060792 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05736b-3263-4162-bc39-a011575b814d admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:28.061898 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c4495-0197-4ab3-8802-39c7f4aba700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75585fe51ca4b148230f32a723e5c4a, user_id=27deadd28c2f4d75a7f224fed925ee05, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:28.062534 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05736b-3263-4162-bc39-a011575b814d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:28.062843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05736b-3263-4162-bc39-a011575b814d admin admin] PATH_INFO: `/v3/projects/d87d30492a6e4f01aad6f65cbb4beae3/users/451124e8d2b74d029e20c6eb132114e0/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:28.075733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c4495-0197-4ab3-8802-39c7f4aba700 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:28.099413 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05736b-3263-4162-bc39-a011575b814d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d87d30492a6e4f01aad6f65cbb4beae3, user_id=451124e8d2b74d029e20c6eb132114e0, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:28.102716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05736b-3263-4162-bc39-a011575b814d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:28.125993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 817/1632] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:27 2022] PUT /identity/v3/projects/b75585fe51ca4b148230f32a723e5c4a/users/27deadd28c2f4d75a7f224fed925ee05/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:28.127813 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7deca-8292-47bd-8af1-7b388062333b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:28.128106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7deca-8292-47bd-8af1-7b388062333b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:28.128389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7deca-8292-47bd-8af1-7b388062333b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:28.149702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 816/1633] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:28 2022] PUT /identity/v3/projects/d87d30492a6e4f01aad6f65cbb4beae3/users/451124e8d2b74d029e20c6eb132114e0/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:28.162138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba837fd9-1c42-4071-a95b-21f3d113d760 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:28.162453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba837fd9-1c42-4071-a95b-21f3d113d760 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:28.162729 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba837fd9-1c42-4071-a95b-21f3d113d760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:28.215066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-54d7deca-8292-47bd-8af1-7b388062333b None None] MFA Rules not processed for user `27deadd28c2f4d75a7f224fed925ee05`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:28.218449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-54d7deca-8292-47bd-8af1-7b388062333b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:28.241698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ba837fd9-1c42-4071-a95b-21f3d113d760 None None] MFA Rules not processed for user `451124e8d2b74d029e20c6eb132114e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:28.242999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ba837fd9-1c42-4071-a95b-21f3d113d760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:28.395131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:28.444445 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 818/1634] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:28 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:28.446414 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c61f2-9c2e-4983-986a-0e5d9d56b82f None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:28.447192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c61f2-9c2e-4983-986a-0e5d9d56b82f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:28.447471 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c61f2-9c2e-4983-986a-0e5d9d56b82f None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:28.449082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 819/1635] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jun 16 16:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:16:28.450207 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e62dc-f057-4828-b647-a6933163e361 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:28.450540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e62dc-f057-4828-b647-a6933163e361 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:28.450819 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e62dc-f057-4828-b647-a6933163e361 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:28.457994 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 820/1636] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jun 16 16:16:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:16:28.460051 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c4b24-546c-40ea-b676-c0455dbe38d3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:28.460334 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c4b24-546c-40ea-b676-c0455dbe38d3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:28.460664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c4b24-546c-40ea-b676-c0455dbe38d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:28.500671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f25c4b24-546c-40ea-b676-c0455dbe38d3 None None] MFA Rules not processed for user `795c029cb14b42b5b0f3987e218d4239`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:28.504153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f25c4b24-546c-40ea-b676-c0455dbe38d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:28.506608 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 817/1637] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:28.508026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188bd76-6943-4c1d-ace7-bf06e1611654 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:28.508327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188bd76-6943-4c1d-ace7-bf06e1611654 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:28.508626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188bd76-6943-4c1d-ace7-bf06e1611654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:28.576048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b188bd76-6943-4c1d-ace7-bf06e1611654 None None] MFA Rules not processed for user `795c029cb14b42b5b0f3987e218d4239`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:28.577334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b188bd76-6943-4c1d-ace7-bf06e1611654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:28.658314 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:28.689833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 821/1638] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 16 16:16:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:28.690728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c4b24-546c-40ea-b676-c0455dbe38d3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:28.719037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 818/1639] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 16 16:16:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:28.719738 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188bd76-6943-4c1d-ace7-bf06e1611654 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:28.838231 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c4b24-546c-40ea-b676-c0455dbe38d3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:28.848146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fd4a6-3c9d-4e29-b388-43d7b93d2150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:28.848869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fd4a6-3c9d-4e29-b388-43d7b93d2150 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:28.849152 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fd4a6-3c9d-4e29-b388-43d7b93d2150 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:28.849349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188bd76-6943-4c1d-ace7-bf06e1611654 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:28.849476 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fd4a6-3c9d-4e29-b388-43d7b93d2150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:28.859043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8a69b-b17f-4501-af65-d3249f03bfe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:28.859515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8a69b-b17f-4501-af65-d3249f03bfe7 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:28.860517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8a69b-b17f-4501-af65-d3249f03bfe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:28.860517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8a69b-b17f-4501-af65-d3249f03bfe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:28.877804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fd4a6-3c9d-4e29-b388-43d7b93d2150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:28.879530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fd4a6-3c9d-4e29-b388-43d7b93d2150 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:28.904654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 822/1640] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:28 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:28.906080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f33f0-1959-46e9-b5af-cffd05ac8eef None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:28.906376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f33f0-1959-46e9-b5af-cffd05ac8eef None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:28.906689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f33f0-1959-46e9-b5af-cffd05ac8eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:28.957408 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a58f33f0-1959-46e9-b5af-cffd05ac8eef None None] MFA Rules not processed for user `45b17abc760a41f685f75f508d735bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:28.959784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a58f33f0-1959-46e9-b5af-cffd05ac8eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:29.045638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8a69b-b17f-4501-af65-d3249f03bfe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:29.047379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8a69b-b17f-4501-af65-d3249f03bfe7 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:29.071548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 819/1641] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:29.074329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8a69b-b17f-4501-af65-d3249f03bfe7 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:29.095726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8a69b-b17f-4501-af65-d3249f03bfe7 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:29.108373 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf117c-bee4-4109-b037-1e16246b92d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:29.109421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf117c-bee4-4109-b037-1e16246b92d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:29.109941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf117c-bee4-4109-b037-1e16246b92d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:29.110469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf117c-bee4-4109-b037-1e16246b92d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:29.135271 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf117c-bee4-4109-b037-1e16246b92d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:29.137151 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf117c-bee4-4109-b037-1e16246b92d5 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:29.143231 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 823/1642] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:29.143865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f33f0-1959-46e9-b5af-cffd05ac8eef None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:29.162618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:29.169765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 820/1643] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:29.347495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f33f0-1959-46e9-b5af-cffd05ac8eef None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:29.362212 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbdf61-e3fb-4cc1-a0f7-d386c0c2fff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:29.366155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbdf61-e3fb-4cc1-a0f7-d386c0c2fff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:29.366155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbdf61-e3fb-4cc1-a0f7-d386c0c2fff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:29.366155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbdf61-e3fb-4cc1-a0f7-d386c0c2fff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:29.366155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbdf61-e3fb-4cc1-a0f7-d386c0c2fff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:29.374279 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbdf61-e3fb-4cc1-a0f7-d386c0c2fff3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:29.469416 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 824/1644] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:29 2022] POST /identity/v3/projects => generated 403 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:29.472408 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf117c-bee4-4109-b037-1e16246b92d5 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:29.500511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf117c-bee4-4109-b037-1e16246b92d5 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:29.658304 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cffd5-8dc0-4895-8131-b275a9dcbff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:29.659053 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cffd5-8dc0-4895-8131-b275a9dcbff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:29.659405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cffd5-8dc0-4895-8131-b275a9dcbff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:29.659759 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cffd5-8dc0-4895-8131-b275a9dcbff7 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:29.660905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cffd5-8dc0-4895-8131-b275a9dcbff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:29.663259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cffd5-8dc0-4895-8131-b275a9dcbff7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:29.727532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:29.742624 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 821/1645] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:29 2022] POST /identity/v3/users => generated 308 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:29.747387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbdf61-e3fb-4cc1-a0f7-d386c0c2fff3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:29.796416 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbdf61-e3fb-4cc1-a0f7-d386c0c2fff3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:29.827040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c7d70-699d-4ba4-9109-24035dd9b162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:29.827740 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c7d70-699d-4ba4-9109-24035dd9b162 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:29.828025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c7d70-699d-4ba4-9109-24035dd9b162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:29.828300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c7d70-699d-4ba4-9109-24035dd9b162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:29.829034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c7d70-699d-4ba4-9109-24035dd9b162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:29.831250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c7d70-699d-4ba4-9109-24035dd9b162 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:29.856337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cffd5-8dc0-4895-8131-b275a9dcbff7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:29.857455 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 825/1646] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:29.871788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cffd5-8dc0-4895-8131-b275a9dcbff7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:29.889844 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36ee89-d364-44b4-ab25-112c21a5d19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:29.890818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36ee89-d364-44b4-ab25-112c21a5d19a admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:29.891106 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36ee89-d364-44b4-ab25-112c21a5d19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:29.894688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36ee89-d364-44b4-ab25-112c21a5d19a admin admin] PATH_INFO: `/v3/projects/93fedee99b1f489c871a8805b2f3f35d/users/5a1ea478030b4a4688822d9b8c09b9de/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:29.945827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36ee89-d364-44b4-ab25-112c21a5d19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=93fedee99b1f489c871a8805b2f3f35d, user_id=5a1ea478030b4a4688822d9b8c09b9de, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:29.949167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36ee89-d364-44b4-ab25-112c21a5d19a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:29.998596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c7d70-699d-4ba4-9109-24035dd9b162 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:30.013180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 822/1647] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:29 2022] PUT /identity/v3/projects/93fedee99b1f489c871a8805b2f3f35d/users/5a1ea478030b4a4688822d9b8c09b9de/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:16:30.023133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c7d70-699d-4ba4-9109-24035dd9b162 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:30.217564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16982f6b-ceae-40a2-b809-32549268330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:30.218272 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16982f6b-ceae-40a2-b809-32549268330f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:30.218594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16982f6b-ceae-40a2-b809-32549268330f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:30.218877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16982f6b-ceae-40a2-b809-32549268330f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:30.219623 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16982f6b-ceae-40a2-b809-32549268330f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:30.227861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16982f6b-ceae-40a2-b809-32549268330f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:30.263670 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36ee89-d364-44b4-ab25-112c21a5d19a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:30.275914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 826/1648] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:30.280093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36ee89-d364-44b4-ab25-112c21a5d19a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:30.288916 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac90932-3833-492d-96ff-41d210c1da8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:30.289895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac90932-3833-492d-96ff-41d210c1da8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:30.290239 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac90932-3833-492d-96ff-41d210c1da8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:30.290626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac90932-3833-492d-96ff-41d210c1da8f admin admin] PATH_INFO: `/v3/projects/93fedee99b1f489c871a8805b2f3f35d/users/5a1ea478030b4a4688822d9b8c09b9de/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:30.294236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac90932-3833-492d-96ff-41d210c1da8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=93fedee99b1f489c871a8805b2f3f35d, user_id=5a1ea478030b4a4688822d9b8c09b9de, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:30.297106 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac90932-3833-492d-96ff-41d210c1da8f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:30.323992 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 823/1649] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:30 2022] PUT /identity/v3/projects/93fedee99b1f489c871a8805b2f3f35d/users/5a1ea478030b4a4688822d9b8c09b9de/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:30.580174 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16982f6b-ceae-40a2-b809-32549268330f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:30.675061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16982f6b-ceae-40a2-b809-32549268330f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:30.724411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:30.774281 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd633c5-9ec4-41a2-b0be-efd38bcaa234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:30.774997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd633c5-9ec4-41a2-b0be-efd38bcaa234 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:30.775334 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd633c5-9ec4-41a2-b0be-efd38bcaa234 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:30.775616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd633c5-9ec4-41a2-b0be-efd38bcaa234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:30.870362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd633c5-9ec4-41a2-b0be-efd38bcaa234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:30.871886 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd633c5-9ec4-41a2-b0be-efd38bcaa234 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:30.889408 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 827/1650] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:31.700003 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac90932-3833-492d-96ff-41d210c1da8f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:31.746781 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac90932-3833-492d-96ff-41d210c1da8f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:31.764004 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ede3d-03a8-46b3-9121-f8c92f62b78a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:31.764873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ede3d-03a8-46b3-9121-f8c92f62b78a service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:31.765262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ede3d-03a8-46b3-9121-f8c92f62b78a service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:31.765646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ede3d-03a8-46b3-9121-f8c92f62b78a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:31.946507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ede3d-03a8-46b3-9121-f8c92f62b78a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:31.948011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ede3d-03a8-46b3-9121-f8c92f62b78a service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:31.989927 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 824/1651] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:31 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:34.234361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd633c5-9ec4-41a2-b0be-efd38bcaa234 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:34.245375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd633c5-9ec4-41a2-b0be-efd38bcaa234 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:34.254189 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a3698-20b1-48f0-8e4e-37f1770afca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:34.256096 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a3698-20b1-48f0-8e4e-37f1770afca3 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:34.256647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a3698-20b1-48f0-8e4e-37f1770afca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:34.257082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a3698-20b1-48f0-8e4e-37f1770afca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:34.369946 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a3698-20b1-48f0-8e4e-37f1770afca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:34.372296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a3698-20b1-48f0-8e4e-37f1770afca3 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:34.405143 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 828/1652] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:35.276229 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbd1fb-c956-4bac-9d52-ce0e5cb48593 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:35.277844 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbd1fb-c956-4bac-9d52-ce0e5cb48593 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:35.278339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbd1fb-c956-4bac-9d52-ce0e5cb48593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:35.344206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a3698-20b1-48f0-8e4e-37f1770afca3 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:35.387391 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7cbbd1fb-c956-4bac-9d52-ce0e5cb48593 None None] MFA Rules not processed for user `5a1ea478030b4a4688822d9b8c09b9de`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:35.398186 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7cbbd1fb-c956-4bac-9d52-ce0e5cb48593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:35.556333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a3698-20b1-48f0-8e4e-37f1770afca3 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:35.570019 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b6c73-9e47-4e16-8be1-4fed9f4ae17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:35.570954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b6c73-9e47-4e16-8be1-4fed9f4ae17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:35.571237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b6c73-9e47-4e16-8be1-4fed9f4ae17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:35.571512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b6c73-9e47-4e16-8be1-4fed9f4ae17e admin admin] PATH_INFO: `/v3/users/f470ec09198d44e7b90d85a8d8fea79c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:35.573869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b6c73-9e47-4e16-8be1-4fed9f4ae17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f470ec09198d44e7b90d85a8d8fea79c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:35.579091 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b6c73-9e47-4e16-8be1-4fed9f4ae17e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:35.609611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:35.626493 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 825/1653] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:35.745599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a57b6c73-9e47-4e16-8be1-4fed9f4ae17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f470ec09198d44e7b90d85a8d8fea79c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:35.746991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a57b6c73-9e47-4e16-8be1-4fed9f4ae17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f470ec09198d44e7b90d85a8d8fea79c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:35.877282 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a57b6c73-9e47-4e16-8be1-4fed9f4ae17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f470ec09198d44e7b90d85a8d8fea79c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:35.880846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a57b6c73-9e47-4e16-8be1-4fed9f4ae17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f470ec09198d44e7b90d85a8d8fea79c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:35.921560 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a57b6c73-9e47-4e16-8be1-4fed9f4ae17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f470ec09198d44e7b90d85a8d8fea79c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:35.969917 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 829/1654] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:16:35 2022] DELETE /identity/v3/users/f470ec09198d44e7b90d85a8d8fea79c => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:35.971230 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ff067-15ef-4fca-b7fe-d94e63e9849c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:35.971779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ff067-15ef-4fca-b7fe-d94e63e9849c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:35.972274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ff067-15ef-4fca-b7fe-d94e63e9849c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:36.033598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b63ff067-15ef-4fca-b7fe-d94e63e9849c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:36.035492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b63ff067-15ef-4fca-b7fe-d94e63e9849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:36.171075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:36.220240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 826/1655] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:16:36.285807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b6c73-9e47-4e16-8be1-4fed9f4ae17e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:36.287663 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a57b6c73-9e47-4e16-8be1-4fed9f4ae17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:36.396925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b6c73-9e47-4e16-8be1-4fed9f4ae17e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:36.408758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f37aa9-d69a-451e-8b26-59c3f3f62e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:36.411815 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37aa9-d69a-451e-8b26-59c3f3f62e50 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:36.412421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37aa9-d69a-451e-8b26-59c3f3f62e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:36.413355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37aa9-d69a-451e-8b26-59c3f3f62e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:36.470178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f37aa9-d69a-451e-8b26-59c3f3f62e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:36.474663 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f37aa9-d69a-451e-8b26-59c3f3f62e50 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:36.506712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 830/1656] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:37.083059 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929048f-8835-4b0d-ae3d-19c01cdc9e60 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:37.083545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929048f-8835-4b0d-ae3d-19c01cdc9e60 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:37.083617 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929048f-8835-4b0d-ae3d-19c01cdc9e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:37.170728 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1929048f-8835-4b0d-ae3d-19c01cdc9e60 None None] MFA Rules not processed for user `9b1d8005a49f4760ab587ca00edd2ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:37.171453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1929048f-8835-4b0d-ae3d-19c01cdc9e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:37.244100 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f37aa9-d69a-451e-8b26-59c3f3f62e50 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:37.244573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-43f37aa9-d69a-451e-8b26-59c3f3f62e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:37.285353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f37aa9-d69a-451e-8b26-59c3f3f62e50 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:37.291057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e38ed-03e6-41a9-930e-543dbf7dea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:37.292128 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e38ed-03e6-41a9-930e-543dbf7dea1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:37.292487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e38ed-03e6-41a9-930e-543dbf7dea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:37.292844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e38ed-03e6-41a9-930e-543dbf7dea1c admin admin] PATH_INFO: `/v3/users/a423bf6bcefb438887d7f726de0aca75` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:37.294296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e38ed-03e6-41a9-930e-543dbf7dea1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a423bf6bcefb438887d7f726de0aca75)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:37.296411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e38ed-03e6-41a9-930e-543dbf7dea1c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:37.411920 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bc4e38ed-03e6-41a9-930e-543dbf7dea1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a423bf6bcefb438887d7f726de0aca75'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:37.412820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bc4e38ed-03e6-41a9-930e-543dbf7dea1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a423bf6bcefb438887d7f726de0aca75'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:37.432853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bc4e38ed-03e6-41a9-930e-543dbf7dea1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a423bf6bcefb438887d7f726de0aca75'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:37.433758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bc4e38ed-03e6-41a9-930e-543dbf7dea1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a423bf6bcefb438887d7f726de0aca75'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:37.444739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bc4e38ed-03e6-41a9-930e-543dbf7dea1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a423bf6bcefb438887d7f726de0aca75'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:37.450920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 827/1657] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:37.452480 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8602b-ff44-46dd-ab39-6065be5fa3fc None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:37.452800 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8602b-ff44-46dd-ab39-6065be5fa3fc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:37.453062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8602b-ff44-46dd-ab39-6065be5fa3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:37.484473 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 831/1658] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:16:37 2022] DELETE /identity/v3/users/a423bf6bcefb438887d7f726de0aca75 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:37.487109 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e38ed-03e6-41a9-930e-543dbf7dea1c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:37.491203 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bc4e38ed-03e6-41a9-930e-543dbf7dea1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:37.507912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:37.525334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-aab8602b-ff44-46dd-ab39-6065be5fa3fc None None] MFA Rules not processed for user `f48deebede4d485b9a7824b0be6e281e`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:37.528098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-aab8602b-ff44-46dd-ab39-6065be5fa3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:37.677200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 828/1659] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:37.677200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c41946-cf0b-4cbe-a5c6-683422de883f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:37.677200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c41946-cf0b-4cbe-a5c6-683422de883f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:37.677200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c41946-cf0b-4cbe-a5c6-683422de883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:37.698767 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e38ed-03e6-41a9-930e-543dbf7dea1c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:37.716057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467bd8a-4885-4f44-838c-4fa5a6e68bbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:37.716764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467bd8a-4885-4f44-838c-4fa5a6e68bbc service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:37.717059 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467bd8a-4885-4f44-838c-4fa5a6e68bbc service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:37.717345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467bd8a-4885-4f44-838c-4fa5a6e68bbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:37.733884 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c467bd8a-4885-4f44-838c-4fa5a6e68bbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:37.739833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a4c41946-cf0b-4cbe-a5c6-683422de883f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:37.750862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a4c41946-cf0b-4cbe-a5c6-683422de883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:37.860942 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 829/1660] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:37.862240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3346f-0e8c-4781-8829-d48eb7da8358 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:37.862683 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3346f-0e8c-4781-8829-d48eb7da8358 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:37.863060 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3346f-0e8c-4781-8829-d48eb7da8358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:37.872045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:37.910179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d4e3346f-0e8c-4781-8829-d48eb7da8358 None None] MFA Rules not processed for user `f48deebede4d485b9a7824b0be6e281e`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:37.916732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d4e3346f-0e8c-4781-8829-d48eb7da8358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:37.935478 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467bd8a-4885-4f44-838c-4fa5a6e68bbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:37.938380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467bd8a-4885-4f44-838c-4fa5a6e68bbc service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:37.945711 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 830/1661] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:37.945711 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3346f-0e8c-4781-8829-d48eb7da8358 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:37.946923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d4e3346f-0e8c-4781-8829-d48eb7da8358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:37.955344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 832/1662] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:37.956310 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467bd8a-4885-4f44-838c-4fa5a6e68bbc service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:37.958981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c467bd8a-4885-4f44-838c-4fa5a6e68bbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:37.995523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467bd8a-4885-4f44-838c-4fa5a6e68bbc service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:38.002400 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520722f-3e2d-4b0b-be90-6fd9d702baed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:38.003154 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520722f-3e2d-4b0b-be90-6fd9d702baed service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:38.003439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520722f-3e2d-4b0b-be90-6fd9d702baed service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:38.003727 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520722f-3e2d-4b0b-be90-6fd9d702baed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:38.020054 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520722f-3e2d-4b0b-be90-6fd9d702baed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:38.025056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520722f-3e2d-4b0b-be90-6fd9d702baed service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:38.043775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 833/1663] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:38.138573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3346f-0e8c-4781-8829-d48eb7da8358 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:38.159579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6ed01-fffb-44b0-9426-05579ae8d952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:38.160523 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6ed01-fffb-44b0-9426-05579ae8d952 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:38.161069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6ed01-fffb-44b0-9426-05579ae8d952 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:38.161518 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6ed01-fffb-44b0-9426-05579ae8d952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:38.194161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6ed01-fffb-44b0-9426-05579ae8d952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:38.195857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6ed01-fffb-44b0-9426-05579ae8d952 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:38.223073 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 831/1664] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:38.660119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1f2a4-22a5-42fd-b0bf-da75bd4ccead None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:38.660655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1f2a4-22a5-42fd-b0bf-da75bd4ccead None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:38.660725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1f2a4-22a5-42fd-b0bf-da75bd4ccead None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:38.664255 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 834/1665] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 16 16:16:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:16:38.675989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5e5ff-0336-4568-be41-a8f637da701b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:38.676310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5e5ff-0336-4568-be41-a8f637da701b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:38.677033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5e5ff-0336-4568-be41-a8f637da701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:38.721836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b0b5e5ff-0336-4568-be41-a8f637da701b None None] MFA Rules not processed for user `9e8222d303aa487ca2b5c5bed6124f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:38.724336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b0b5e5ff-0336-4568-be41-a8f637da701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:38.827655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 832/1666] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 16 16:16:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:38.864489 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcf3ea-5ebd-465a-bf78-cae4d580d569 None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:38.865311 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcf3ea-5ebd-465a-bf78-cae4d580d569 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:38.865827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcf3ea-5ebd-465a-bf78-cae4d580d569 None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:38.868836 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 835/1667] 10.222.0.48 () {54 vars in 960 bytes} [Thu Jun 16 16:16:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:16:38.883405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b77be7-218f-49dd-9c03-5d5a37a38894 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:38.883626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b77be7-218f-49dd-9c03-5d5a37a38894 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:38.884128 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b77be7-218f-49dd-9c03-5d5a37a38894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:38.916253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e9b77be7-218f-49dd-9c03-5d5a37a38894 None None] MFA Rules not processed for user `9e8222d303aa487ca2b5c5bed6124f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:38.918015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e9b77be7-218f-49dd-9c03-5d5a37a38894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:38.935259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 833/1668] 10.222.0.48 () {58 vars in 1057 bytes} [Thu Jun 16 16:16:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:38.944946 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcf3ea-5ebd-465a-bf78-cae4d580d569 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:38.967635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcf3ea-5ebd-465a-bf78-cae4d580d569 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:38.986241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626abef-d923-4704-a028-c7c3d0e4189a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e8222d303aa487ca2b5c5bed6124f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:38.987119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626abef-d923-4704-a028-c7c3d0e4189a service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:38.987599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626abef-d923-4704-a028-c7c3d0e4189a service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:38.988059 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626abef-d923-4704-a028-c7c3d0e4189a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:39.012988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626abef-d923-4704-a028-c7c3d0e4189a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:39.015407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626abef-d923-4704-a028-c7c3d0e4189a service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:39.039586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 836/1669] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:39.114590 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc220d-5f37-4199-8a07-eff4e3fc7d7a None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:39.115725 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc220d-5f37-4199-8a07-eff4e3fc7d7a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:39.116229 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc220d-5f37-4199-8a07-eff4e3fc7d7a None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:39.118859 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 834/1670] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jun 16 16:16:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:16:39.124548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47188e1-438d-44c1-9336-d228d662c1c2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:39.124842 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47188e1-438d-44c1-9336-d228d662c1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:39.125126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47188e1-438d-44c1-9336-d228d662c1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:39.152923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc220d-5f37-4199-8a07-eff4e3fc7d7a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:39.156205 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-35dc220d-5f37-4199-8a07-eff4e3fc7d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:39.194551 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc220d-5f37-4199-8a07-eff4e3fc7d7a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:39.201068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3c07f-4e62-4a46-8049-7de791ae2603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:39.203414 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3c07f-4e62-4a46-8049-7de791ae2603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:39.204656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3c07f-4e62-4a46-8049-7de791ae2603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:39.205178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3c07f-4e62-4a46-8049-7de791ae2603 admin admin] PATH_INFO: `/v3/projects/ff05c8cec4f747f1b22d30f282403d68` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:39.206716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3c07f-4e62-4a46-8049-7de791ae2603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff05c8cec4f747f1b22d30f282403d68)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:39.209872 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3c07f-4e62-4a46-8049-7de791ae2603 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:39.226378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b47188e1-438d-44c1-9336-d228d662c1c2 None None] MFA Rules not processed for user `087adcbf737843db97dabfa9708484c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:39.227926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b47188e1-438d-44c1-9336-d228d662c1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:39.238299 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 837/1671] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 16 16:16:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:39.328704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-03f3c07f-4e62-4a46-8049-7de791ae2603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff05c8cec4f747f1b22d30f282403d68', 'request_id': 'req-03f3c07f-4e62-4a46-8049-7de791ae2603'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:39.342789 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47188e1-438d-44c1-9336-d228d662c1c2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:39.351159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-03f3c07f-4e62-4a46-8049-7de791ae2603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff05c8cec4f747f1b22d30f282403d68', 'request_id': 'req-03f3c07f-4e62-4a46-8049-7de791ae2603'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:39.358231 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47188e1-438d-44c1-9336-d228d662c1c2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:39.379647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-03f3c07f-4e62-4a46-8049-7de791ae2603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff05c8cec4f747f1b22d30f282403d68', 'request_id': 'req-03f3c07f-4e62-4a46-8049-7de791ae2603'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:39.416933 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-03f3c07f-4e62-4a46-8049-7de791ae2603 admin admin] The token cache is being invalidate because project ff05c8cec4f747f1b22d30f282403d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:16:39.417228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-03f3c07f-4e62-4a46-8049-7de791ae2603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:39.426289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-03f3c07f-4e62-4a46-8049-7de791ae2603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:39.428616 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 835/1672] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:16:39 2022] DELETE /identity/v3/projects/ff05c8cec4f747f1b22d30f282403d68 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:39.437466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b746db-20dd-44e2-908d-2c42fc1f270c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:39.437767 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b746db-20dd-44e2-908d-2c42fc1f270c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:39.438050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b746db-20dd-44e2-908d-2c42fc1f270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:39.498390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-54b746db-20dd-44e2-908d-2c42fc1f270c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:39.500822 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a93104-f17b-41f9-9228-b1142046cf21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:39.501246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-54b746db-20dd-44e2-908d-2c42fc1f270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:39.501819 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a93104-f17b-41f9-9228-b1142046cf21 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:39.502306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a93104-f17b-41f9-9228-b1142046cf21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:39.503186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a93104-f17b-41f9-9228-b1142046cf21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:39.507824 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-36a93104-f17b-41f9-9228-b1142046cf21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:39.530782 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:39.531435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:39.536940 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a93104-f17b-41f9-9228-b1142046cf21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:39.540774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a93104-f17b-41f9-9228-b1142046cf21 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:39.557723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 838/1673] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:39.680928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 836/1674] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:39.690122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459de77-01fb-40c5-9152-e6653c0b7aa9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:39.690639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459de77-01fb-40c5-9152-e6653c0b7aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:39.690900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459de77-01fb-40c5-9152-e6653c0b7aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:39.737533 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c459de77-01fb-40c5-9152-e6653c0b7aa9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:39.743611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c459de77-01fb-40c5-9152-e6653c0b7aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:39.764072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 839/1675] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:39.768364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b746db-20dd-44e2-908d-2c42fc1f270c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:39.784160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b746db-20dd-44e2-908d-2c42fc1f270c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:39.802944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767fdb3-fad5-4dd7-b854-474162523160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:39.803792 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767fdb3-fad5-4dd7-b854-474162523160 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:39.805602 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767fdb3-fad5-4dd7-b854-474162523160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:39.805602 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767fdb3-fad5-4dd7-b854-474162523160 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:39.805602 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767fdb3-fad5-4dd7-b854-474162523160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:16:39.805602 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767fdb3-fad5-4dd7-b854-474162523160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:39.807802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767fdb3-fad5-4dd7-b854-474162523160 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:39.842129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 837/1676] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:16:39.851654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459de77-01fb-40c5-9152-e6653c0b7aa9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:39.888534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459de77-01fb-40c5-9152-e6653c0b7aa9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:39.922207 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e4a35-318d-4877-ad5b-91ba618f81b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:39.923398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e4a35-318d-4877-ad5b-91ba618f81b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:39.924006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e4a35-318d-4877-ad5b-91ba618f81b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:39.924501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e4a35-318d-4877-ad5b-91ba618f81b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:39.926006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e4a35-318d-4877-ad5b-91ba618f81b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:39.935523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e4a35-318d-4877-ad5b-91ba618f81b7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:40.051124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 840/1677] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:39 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:40.054557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767fdb3-fad5-4dd7-b854-474162523160 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:40.071073 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767fdb3-fad5-4dd7-b854-474162523160 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:40.254365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c2601-1d83-4c2d-bae8-9b25b575a6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:40.256182 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c2601-1d83-4c2d-bae8-9b25b575a6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:40.256475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c2601-1d83-4c2d-bae8-9b25b575a6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:40.256755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c2601-1d83-4c2d-bae8-9b25b575a6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:40.257470 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c2601-1d83-4c2d-bae8-9b25b575a6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:40.259506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c2601-1d83-4c2d-bae8-9b25b575a6d0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:40.311885 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 838/1678] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:40 2022] POST /identity/v3/users => generated 287 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:40.316246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e4a35-318d-4877-ad5b-91ba618f81b7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:40.332350 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e4a35-318d-4877-ad5b-91ba618f81b7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:40.340475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f7149-7263-4780-a6d0-d7d786cc7b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:40.341486 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f7149-7263-4780-a6d0-d7d786cc7b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:40.342030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f7149-7263-4780-a6d0-d7d786cc7b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:40.342319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f7149-7263-4780-a6d0-d7d786cc7b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:40.344164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f7149-7263-4780-a6d0-d7d786cc7b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:40.354029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f7149-7263-4780-a6d0-d7d786cc7b6b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:40.377846 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c2601-1d83-4c2d-bae8-9b25b575a6d0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:40.388857 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 841/1679] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:40.391213 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c2601-1d83-4c2d-bae8-9b25b575a6d0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:40.398552 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fadfb6-ae69-4b72-acba-e9dc1ba73ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:40.399329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fadfb6-ae69-4b72-acba-e9dc1ba73ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:40.399622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fadfb6-ae69-4b72-acba-e9dc1ba73ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:40.399912 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fadfb6-ae69-4b72-acba-e9dc1ba73ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:40.400922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fadfb6-ae69-4b72-acba-e9dc1ba73ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:40.403282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fadfb6-ae69-4b72-acba-e9dc1ba73ad7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:40.423087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f7149-7263-4780-a6d0-d7d786cc7b6b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:40.431901 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 839/1680] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:40.438638 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f7149-7263-4780-a6d0-d7d786cc7b6b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:40.449224 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fadfb6-ae69-4b72-acba-e9dc1ba73ad7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:40.451642 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-48fadfb6-ae69-4b72-acba-e9dc1ba73ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:40.463513 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed4cbc-d331-4f49-be75-319dc69a3e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:40.465886 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed4cbc-d331-4f49-be75-319dc69a3e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:40.466176 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed4cbc-d331-4f49-be75-319dc69a3e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:40.466507 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed4cbc-d331-4f49-be75-319dc69a3e9b admin admin] PATH_INFO: `/v3/projects/750032d92ac9487da4da75216fc533c9/users/f851df6cf8f7421ba4eba5246b38443c/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:40.474844 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fadfb6-ae69-4b72-acba-e9dc1ba73ad7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:40.484781 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485ba34-e4dd-4876-90c1-52c5f857e8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:40.486616 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485ba34-e4dd-4876-90c1-52c5f857e8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:40.487092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485ba34-e4dd-4876-90c1-52c5f857e8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:40.487545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485ba34-e4dd-4876-90c1-52c5f857e8a0 admin admin] PATH_INFO: `/v3/users/45b17abc760a41f685f75f508d735bcb` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:40.490014 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485ba34-e4dd-4876-90c1-52c5f857e8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b17abc760a41f685f75f508d735bcb)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:40.493033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: WARNING py.warnings [None req-8485ba34-e4dd-4876-90c1-52c5f857e8a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:16:40.493033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: warnings.warn(msg) Jun 16 16:16:40.493033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: Jun 16 16:16:40.495289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485ba34-e4dd-4876-90c1-52c5f857e8a0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:40.511748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed4cbc-d331-4f49-be75-319dc69a3e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=750032d92ac9487da4da75216fc533c9, user_id=f851df6cf8f7421ba4eba5246b38443c, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:40.520295 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed4cbc-d331-4f49-be75-319dc69a3e9b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:40.565127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 842/1681] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:40 2022] PUT /identity/v3/projects/750032d92ac9487da4da75216fc533c9/users/f851df6cf8f7421ba4eba5246b38443c/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:40.568138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b0889-83b5-4335-8b50-9da7e6eafd86 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:40.569552 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b0889-83b5-4335-8b50-9da7e6eafd86 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:40.569840 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b0889-83b5-4335-8b50-9da7e6eafd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:40.620656 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cd1b0889-83b5-4335-8b50-9da7e6eafd86 None None] MFA Rules not processed for user `f851df6cf8f7421ba4eba5246b38443c`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:40.624041 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cd1b0889-83b5-4335-8b50-9da7e6eafd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:40.651925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8485ba34-e4dd-4876-90c1-52c5f857e8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b17abc760a41f685f75f508d735bcb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:40.699261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8485ba34-e4dd-4876-90c1-52c5f857e8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b17abc760a41f685f75f508d735bcb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:40.700249 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8485ba34-e4dd-4876-90c1-52c5f857e8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b17abc760a41f685f75f508d735bcb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:40.701461 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8485ba34-e4dd-4876-90c1-52c5f857e8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b17abc760a41f685f75f508d735bcb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:40.712842 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8485ba34-e4dd-4876-90c1-52c5f857e8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b17abc760a41f685f75f508d735bcb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:40.718177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:40.741598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 840/1682] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:16:40 2022] DELETE /identity/v3/users/45b17abc760a41f685f75f508d735bcb => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:16:40.743385 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485ba34-e4dd-4876-90c1-52c5f857e8a0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:40.760565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8485ba34-e4dd-4876-90c1-52c5f857e8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:40.817662 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 843/1683] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:40.819270 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b0889-83b5-4335-8b50-9da7e6eafd86 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:40.824945 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cd1b0889-83b5-4335-8b50-9da7e6eafd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:41.017342 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485ba34-e4dd-4876-90c1-52c5f857e8a0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:41.046849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d9a68-aa8c-434d-af41-9d2300f719b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:41.048105 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d9a68-aa8c-434d-af41-9d2300f719b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:41.052876 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d9a68-aa8c-434d-af41-9d2300f719b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:41.053849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d9a68-aa8c-434d-af41-9d2300f719b0 admin admin] PATH_INFO: `/v3/projects/1b824fbfefad4fb39eba091100221eb0` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:41.059981 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d9a68-aa8c-434d-af41-9d2300f719b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b824fbfefad4fb39eba091100221eb0)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:41.070347 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d9a68-aa8c-434d-af41-9d2300f719b0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:41.151887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b0889-83b5-4335-8b50-9da7e6eafd86 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:41.188689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff261611-74f8-4535-ae7d-bac855da945e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:41.193997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff261611-74f8-4535-ae7d-bac855da945e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:41.194293 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff261611-74f8-4535-ae7d-bac855da945e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:41.194619 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff261611-74f8-4535-ae7d-bac855da945e admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:41.195316 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff261611-74f8-4535-ae7d-bac855da945e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:41.205372 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff261611-74f8-4535-ae7d-bac855da945e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:41.299460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 844/1684] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:40 2022] POST /identity/v3/projects => generated 373 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:41.301045 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff261611-74f8-4535-ae7d-bac855da945e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:41.309904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ff261611-74f8-4535-ae7d-bac855da945e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:41.355791 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:41.407123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-680d9a68-aa8c-434d-af41-9d2300f719b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b824fbfefad4fb39eba091100221eb0', 'request_id': 'req-680d9a68-aa8c-434d-af41-9d2300f719b0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:41.455221 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-680d9a68-aa8c-434d-af41-9d2300f719b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b824fbfefad4fb39eba091100221eb0', 'request_id': 'req-680d9a68-aa8c-434d-af41-9d2300f719b0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:41.488514 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-680d9a68-aa8c-434d-af41-9d2300f719b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b824fbfefad4fb39eba091100221eb0', 'request_id': 'req-680d9a68-aa8c-434d-af41-9d2300f719b0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:41.531334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-680d9a68-aa8c-434d-af41-9d2300f719b0 admin admin] The token cache is being invalidate because project 1b824fbfefad4fb39eba091100221eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:16:41.531628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-680d9a68-aa8c-434d-af41-9d2300f719b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:41.536895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-680d9a68-aa8c-434d-af41-9d2300f719b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:41.542839 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 841/1685] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:16:40 2022] DELETE /identity/v3/projects/1b824fbfefad4fb39eba091100221eb0 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:41.542839 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d9a68-aa8c-434d-af41-9d2300f719b0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:41.548052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-680d9a68-aa8c-434d-af41-9d2300f719b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:41.700609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff261611-74f8-4535-ae7d-bac855da945e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:41.820767 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d9a68-aa8c-434d-af41-9d2300f719b0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:41.845580 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00016111-a975-4667-8fa6-7e99c284530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:41.846398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00016111-a975-4667-8fa6-7e99c284530b admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:41.846712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00016111-a975-4667-8fa6-7e99c284530b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:41.846992 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00016111-a975-4667-8fa6-7e99c284530b admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:41.847694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00016111-a975-4667-8fa6-7e99c284530b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:41.867546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00016111-a975-4667-8fa6-7e99c284530b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:41.963007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1955b79-014f-491e-ac0d-32ad6d9ebc98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e8222d303aa487ca2b5c5bed6124f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:41.963809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1955b79-014f-491e-ac0d-32ad6d9ebc98 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:41.963809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1955b79-014f-491e-ac0d-32ad6d9ebc98 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:41.964107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1955b79-014f-491e-ac0d-32ad6d9ebc98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:41.964253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 842/1686] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:41 2022] POST /identity/v3/users => generated 293 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:41.965242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00016111-a975-4667-8fa6-7e99c284530b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:41.972373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d1955b79-014f-491e-ac0d-32ad6d9ebc98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:41.976151 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-00016111-a975-4667-8fa6-7e99c284530b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:42.018853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1955b79-014f-491e-ac0d-32ad6d9ebc98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:42.021221 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1955b79-014f-491e-ac0d-32ad6d9ebc98 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:42.038058 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00016111-a975-4667-8fa6-7e99c284530b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:42.057348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e87ec5-77c4-48af-bf90-6a8ca67afbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:42.058779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e87ec5-77c4-48af-bf90-6a8ca67afbff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:42.059160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e87ec5-77c4-48af-bf90-6a8ca67afbff admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:42.064859 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e87ec5-77c4-48af-bf90-6a8ca67afbff admin admin] PATH_INFO: `/v3/projects/c8df3d2bdc8b44e7a86a5e56edb6b2ce` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:42.064859 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e87ec5-77c4-48af-bf90-6a8ca67afbff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8df3d2bdc8b44e7a86a5e56edb6b2ce)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:42.076050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e87ec5-77c4-48af-bf90-6a8ca67afbff admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:42.086013 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 845/1687] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 786 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:42.092815 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b723161-27f1-44d1-b7f2-e7b7e62b5e48 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:42.093131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b723161-27f1-44d1-b7f2-e7b7e62b5e48 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:42.093407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b723161-27f1-44d1-b7f2-e7b7e62b5e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:42.116102 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:42.162845 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1b723161-27f1-44d1-b7f2-e7b7e62b5e48 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:42.164809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1b723161-27f1-44d1-b7f2-e7b7e62b5e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:42.215024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 846/1688] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:42.215024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b723161-27f1-44d1-b7f2-e7b7e62b5e48 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:42.246831 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b723161-27f1-44d1-b7f2-e7b7e62b5e48 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:42.281651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f3e87ec5-77c4-48af-bf90-6a8ca67afbff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8df3d2bdc8b44e7a86a5e56edb6b2ce', 'request_id': 'req-f3e87ec5-77c4-48af-bf90-6a8ca67afbff'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:42.312261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f3e87ec5-77c4-48af-bf90-6a8ca67afbff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8df3d2bdc8b44e7a86a5e56edb6b2ce', 'request_id': 'req-f3e87ec5-77c4-48af-bf90-6a8ca67afbff'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:42.339891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f3e87ec5-77c4-48af-bf90-6a8ca67afbff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8df3d2bdc8b44e7a86a5e56edb6b2ce', 'request_id': 'req-f3e87ec5-77c4-48af-bf90-6a8ca67afbff'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:42.374247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f3e87ec5-77c4-48af-bf90-6a8ca67afbff admin admin] The token cache is being invalidate because project c8df3d2bdc8b44e7a86a5e56edb6b2ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:16:42.375582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f3e87ec5-77c4-48af-bf90-6a8ca67afbff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:42.381029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f3e87ec5-77c4-48af-bf90-6a8ca67afbff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:42.389397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 843/1689] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:16:41 2022] DELETE /identity/v3/projects/c8df3d2bdc8b44e7a86a5e56edb6b2ce => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:42.393505 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64a768-567f-4b8e-8465-fa9031b96fa9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:42.394177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64a768-567f-4b8e-8465-fa9031b96fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:42.395616 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64a768-567f-4b8e-8465-fa9031b96fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:42.441330 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ca64a768-567f-4b8e-8465-fa9031b96fa9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:42.447739 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ca64a768-567f-4b8e-8465-fa9031b96fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:42.505944 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e61c76-c2bf-48d2-aa90-d2b4c8a9bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:42.506456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e61c76-c2bf-48d2-aa90-d2b4c8a9bda1 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:42.506753 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e61c76-c2bf-48d2-aa90-d2b4c8a9bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:42.507027 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e61c76-c2bf-48d2-aa90-d2b4c8a9bda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:42.509100 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e61c76-c2bf-48d2-aa90-d2b4c8a9bda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:42.528213 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e61c76-c2bf-48d2-aa90-d2b4c8a9bda1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:42.599817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 847/1690] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:42.600827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e61c76-c2bf-48d2-aa90-d2b4c8a9bda1 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:42.606490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f3e61c76-c2bf-48d2-aa90-d2b4c8a9bda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:42.624598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 844/1691] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:42.626181 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64a768-567f-4b8e-8465-fa9031b96fa9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:42.628446 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ca64a768-567f-4b8e-8465-fa9031b96fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:42.656102 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e61c76-c2bf-48d2-aa90-d2b4c8a9bda1 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:42.659550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64a768-567f-4b8e-8465-fa9031b96fa9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:42.663595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694636b5-fdd2-43a0-b84f-b03d92f9d13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:42.664621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694636b5-fdd2-43a0-b84f-b03d92f9d13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:42.665005 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694636b5-fdd2-43a0-b84f-b03d92f9d13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:42.665385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694636b5-fdd2-43a0-b84f-b03d92f9d13a admin admin] PATH_INFO: `/v3/users/5a1ea478030b4a4688822d9b8c09b9de` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:42.667893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694636b5-fdd2-43a0-b84f-b03d92f9d13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a1ea478030b4a4688822d9b8c09b9de)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:42.671744 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694636b5-fdd2-43a0-b84f-b03d92f9d13a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:42.672665 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de16c46-9613-4625-a770-40de033ac8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:42.674314 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de16c46-9613-4625-a770-40de033ac8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:42.675964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de16c46-9613-4625-a770-40de033ac8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:42.676082 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de16c46-9613-4625-a770-40de033ac8f7 admin admin] PATH_INFO: `/v3/projects/8cc097c7e23748218b33f065b37d731e/users/26db248e5171408295d797ea3da56bee/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:42.725617 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de16c46-9613-4625-a770-40de033ac8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc097c7e23748218b33f065b37d731e, user_id=26db248e5171408295d797ea3da56bee, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:42.730795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de16c46-9613-4625-a770-40de033ac8f7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:42.750222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:42.770834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 845/1692] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:42 2022] PUT /identity/v3/projects/8cc097c7e23748218b33f065b37d731e/users/26db248e5171408295d797ea3da56bee/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:42.771844 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de16c46-9613-4625-a770-40de033ac8f7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:42.820315 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-694636b5-fdd2-43a0-b84f-b03d92f9d13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a1ea478030b4a4688822d9b8c09b9de'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:42.822380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-694636b5-fdd2-43a0-b84f-b03d92f9d13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a1ea478030b4a4688822d9b8c09b9de'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:42.858513 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-694636b5-fdd2-43a0-b84f-b03d92f9d13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a1ea478030b4a4688822d9b8c09b9de'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:42.859516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-694636b5-fdd2-43a0-b84f-b03d92f9d13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a1ea478030b4a4688822d9b8c09b9de'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:42.875958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-694636b5-fdd2-43a0-b84f-b03d92f9d13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a1ea478030b4a4688822d9b8c09b9de'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:42.908962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 848/1693] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:16:42 2022] DELETE /identity/v3/users/5a1ea478030b4a4688822d9b8c09b9de => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:42.910075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694636b5-fdd2-43a0-b84f-b03d92f9d13a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:42.920731 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-694636b5-fdd2-43a0-b84f-b03d92f9d13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:42.968810 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de16c46-9613-4625-a770-40de033ac8f7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:43.010810 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:43.114329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694636b5-fdd2-43a0-b84f-b03d92f9d13a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:43.132496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e74f50-2e14-4f14-89e3-7f109d8a8c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:43.133202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e74f50-2e14-4f14-89e3-7f109d8a8c2d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:43.133489 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e74f50-2e14-4f14-89e3-7f109d8a8c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:43.133772 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e74f50-2e14-4f14-89e3-7f109d8a8c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:43.134549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e74f50-2e14-4f14-89e3-7f109d8a8c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:43.138334 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e74f50-2e14-4f14-89e3-7f109d8a8c2d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:43.144174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c842b-6fd3-49e1-8fe4-fe5721efed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:43.147235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c842b-6fd3-49e1-8fe4-fe5721efed02 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:43.147533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c842b-6fd3-49e1-8fe4-fe5721efed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:43.147821 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c842b-6fd3-49e1-8fe4-fe5721efed02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:43.148579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c842b-6fd3-49e1-8fe4-fe5721efed02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:16:43.148894 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c842b-6fd3-49e1-8fe4-fe5721efed02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:43.150639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c842b-6fd3-49e1-8fe4-fe5721efed02 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:43.168796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 849/1694] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:43.170303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287b966-35d1-4869-a723-0eb744e13b69 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:43.170621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287b966-35d1-4869-a723-0eb744e13b69 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:43.170904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287b966-35d1-4869-a723-0eb744e13b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:43.221967 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 846/1695] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:16:43.228184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c842b-6fd3-49e1-8fe4-fe5721efed02 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:43.247216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c287b966-35d1-4869-a723-0eb744e13b69 None None] MFA Rules not processed for user `c5d0829ddcfe4116a0d180ff6d89bd20`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:43.251616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c287b966-35d1-4869-a723-0eb744e13b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:43.261290 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c842b-6fd3-49e1-8fe4-fe5721efed02 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:43.269664 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26b486-27c6-4a02-8aa7-183d9ca90286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:43.283447 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26b486-27c6-4a02-8aa7-183d9ca90286 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:43.287995 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26b486-27c6-4a02-8aa7-183d9ca90286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:43.288492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26b486-27c6-4a02-8aa7-183d9ca90286 admin admin] PATH_INFO: `/v3/projects/8cc097c7e23748218b33f065b37d731e/users/26db248e5171408295d797ea3da56bee/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:43.296006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26b486-27c6-4a02-8aa7-183d9ca90286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc097c7e23748218b33f065b37d731e, user_id=26db248e5171408295d797ea3da56bee, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:43.306620 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26b486-27c6-4a02-8aa7-183d9ca90286 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:43.355789 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 847/1696] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:43 2022] PUT /identity/v3/projects/8cc097c7e23748218b33f065b37d731e/users/26db248e5171408295d797ea3da56bee/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:43.356939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26b486-27c6-4a02-8aa7-183d9ca90286 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:43.375811 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8d26b486-27c6-4a02-8aa7-183d9ca90286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:43.449243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 850/1697] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:43.450908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80dcaa-7c66-4357-80e1-f39bddec07f2 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:43.451458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80dcaa-7c66-4357-80e1-f39bddec07f2 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:43.452158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80dcaa-7c66-4357-80e1-f39bddec07f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:43.495791 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cd80dcaa-7c66-4357-80e1-f39bddec07f2 None None] MFA Rules not processed for user `26db248e5171408295d797ea3da56bee`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:43.499832 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cd80dcaa-7c66-4357-80e1-f39bddec07f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:43.538922 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:43.633364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26b486-27c6-4a02-8aa7-183d9ca90286 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:43.691721 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c503c-0d57-4ebb-bb0a-a9f558c62e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:43.695723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c503c-0d57-4ebb-bb0a-a9f558c62e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:43.696953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c503c-0d57-4ebb-bb0a-a9f558c62e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:43.710021 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c503c-0d57-4ebb-bb0a-a9f558c62e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:43.712177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c503c-0d57-4ebb-bb0a-a9f558c62e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:43.718513 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c503c-0d57-4ebb-bb0a-a9f558c62e44 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:43.724929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 851/1698] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:43.742028 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80dcaa-7c66-4357-80e1-f39bddec07f2 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:43.751311 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cd80dcaa-7c66-4357-80e1-f39bddec07f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:43.805512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80dcaa-7c66-4357-80e1-f39bddec07f2 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:43.810400 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 848/1699] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:43 2022] POST /identity/v3/projects => generated 365 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:43.814827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21fa1-8ae6-4c50-bf37-a74b9e80747b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:43.815227 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21fa1-8ae6-4c50-bf37-a74b9e80747b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:43.815613 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21fa1-8ae6-4c50-bf37-a74b9e80747b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:43.860189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ead21fa1-8ae6-4c50-bf37-a74b9e80747b None None] MFA Rules not processed for user `c5d0829ddcfe4116a0d180ff6d89bd20`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:43.863557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ead21fa1-8ae6-4c50-bf37-a74b9e80747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:43.995227 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 849/1700] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:43.996596 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead21fa1-8ae6-4c50-bf37-a74b9e80747b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:43.998546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ead21fa1-8ae6-4c50-bf37-a74b9e80747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:44.019250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:44.025264 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:44.025589 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:44.025882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] PATH_INFO: `/v3/projects/93fedee99b1f489c871a8805b2f3f35d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:44.032421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93fedee99b1f489c871a8805b2f3f35d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:44.053246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: WARNING py.warnings [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:16:44.053246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: warnings.warn(msg) Jun 16 16:16:44.053246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: Jun 16 16:16:44.057661 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:44.092238 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:44.227974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead21fa1-8ae6-4c50-bf37-a74b9e80747b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:44.244777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941f9b1-d785-4689-b7d4-80dabd16f6f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:44.249184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941f9b1-d785-4689-b7d4-80dabd16f6f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:44.249525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941f9b1-d785-4689-b7d4-80dabd16f6f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:44.249822 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941f9b1-d785-4689-b7d4-80dabd16f6f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:44.343410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93fedee99b1f489c871a8805b2f3f35d', 'request_id': 'req-8c10fe20-ac05-4d42-9571-c791849b5f86'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:44.371394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93fedee99b1f489c871a8805b2f3f35d', 'request_id': 'req-8c10fe20-ac05-4d42-9571-c791849b5f86'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:44.394503 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93fedee99b1f489c871a8805b2f3f35d', 'request_id': 'req-8c10fe20-ac05-4d42-9571-c791849b5f86'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:44.451621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] The token cache is being invalidate because project 93fedee99b1f489c871a8805b2f3f35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:16:44.452952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:44.456302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:44.458561 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 852/1701] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:16:43 2022] DELETE /identity/v3/projects/93fedee99b1f489c871a8805b2f3f35d => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:44.468498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:44.472199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:44.540650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941f9b1-d785-4689-b7d4-80dabd16f6f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:44.554423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941f9b1-d785-4689-b7d4-80dabd16f6f1 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:44.587152 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 850/1702] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:44.591163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941f9b1-d785-4689-b7d4-80dabd16f6f1 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:44.595395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c941f9b1-d785-4689-b7d4-80dabd16f6f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:44.649903 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:44.727852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10fe20-ac05-4d42-9571-c791849b5f86 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:44.741276 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb872d-ca9a-4cec-a2fd-13fa6b64e845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:44.742237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb872d-ca9a-4cec-a2fd-13fa6b64e845 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:44.742747 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb872d-ca9a-4cec-a2fd-13fa6b64e845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:44.745727 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb872d-ca9a-4cec-a2fd-13fa6b64e845 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:44.748236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb872d-ca9a-4cec-a2fd-13fa6b64e845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:44.750625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb872d-ca9a-4cec-a2fd-13fa6b64e845 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:44.812999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 853/1703] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:44 2022] POST /identity/v3/users => generated 283 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:44.815736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384db1e-c576-4348-8644-715adc2e097c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:44.816261 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384db1e-c576-4348-8644-715adc2e097c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:44.816842 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384db1e-c576-4348-8644-715adc2e097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:44.850107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7384db1e-c576-4348-8644-715adc2e097c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:44.852005 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7384db1e-c576-4348-8644-715adc2e097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:44.852230 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941f9b1-d785-4689-b7d4-80dabd16f6f1 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:44.871283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 854/1704] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:44.872982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08404df-63d9-4475-96cf-2411b92e70b8 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:44.873611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08404df-63d9-4475-96cf-2411b92e70b8 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:44.874025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08404df-63d9-4475-96cf-2411b92e70b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:44.903467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d08404df-63d9-4475-96cf-2411b92e70b8 None None] MFA Rules not processed for user `9b1d8005a49f4760ab587ca00edd2ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:44.905514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d08404df-63d9-4475-96cf-2411b92e70b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:45.024886 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 855/1705] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:45.025799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08404df-63d9-4475-96cf-2411b92e70b8 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:45.038367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d08404df-63d9-4475-96cf-2411b92e70b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:45.039559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38778b-276e-47b9-b622-1b3b7c6f6d69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:45.041081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38778b-276e-47b9-b622-1b3b7c6f6d69 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:45.042658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38778b-276e-47b9-b622-1b3b7c6f6d69 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:45.043879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38778b-276e-47b9-b622-1b3b7c6f6d69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:45.048383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1b38778b-276e-47b9-b622-1b3b7c6f6d69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:45.086808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:45.173575 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08404df-63d9-4475-96cf-2411b92e70b8 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:45.180276 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444d587-5730-48df-aa6f-6459f5a81a2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:45.181821 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444d587-5730-48df-aa6f-6459f5a81a2b service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:45.182525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444d587-5730-48df-aa6f-6459f5a81a2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:45.182837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444d587-5730-48df-aa6f-6459f5a81a2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:45.186202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a444d587-5730-48df-aa6f-6459f5a81a2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:45.269746 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38778b-276e-47b9-b622-1b3b7c6f6d69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:45.280989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38778b-276e-47b9-b622-1b3b7c6f6d69 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:45.333718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 851/1706] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:45.334831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38778b-276e-47b9-b622-1b3b7c6f6d69 service nova] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:45.393063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38778b-276e-47b9-b622-1b3b7c6f6d69 service nova] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:45.417508 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a9805-e3cb-4d31-a111-0c664d56eebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:45.418214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a9805-e3cb-4d31-a111-0c664d56eebb admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:45.418533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a9805-e3cb-4d31-a111-0c664d56eebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:45.418814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a9805-e3cb-4d31-a111-0c664d56eebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:45.419561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a9805-e3cb-4d31-a111-0c664d56eebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:45.422833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a9805-e3cb-4d31-a111-0c664d56eebb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:45.461821 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 852/1707] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:45.464722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ca583-f0ad-4edc-a653-346b60f7df09 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:45.465022 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ca583-f0ad-4edc-a653-346b60f7df09 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:45.465308 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ca583-f0ad-4edc-a653-346b60f7df09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:45.487618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444d587-5730-48df-aa6f-6459f5a81a2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:45.490190 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444d587-5730-48df-aa6f-6459f5a81a2b service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:45.515541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 856/1708] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:45.516752 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444d587-5730-48df-aa6f-6459f5a81a2b service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:45.536642 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444d587-5730-48df-aa6f-6459f5a81a2b service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:45.544719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-157ca583-f0ad-4edc-a653-346b60f7df09 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:45.546037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-157ca583-f0ad-4edc-a653-346b60f7df09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:45.547842 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cc84f-9c8e-4e62-8079-d383fb92812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:45.549803 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cc84f-9c8e-4e62-8079-d383fb92812f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:45.550789 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cc84f-9c8e-4e62-8079-d383fb92812f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:45.552444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cc84f-9c8e-4e62-8079-d383fb92812f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:45.555346 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cc84f-9c8e-4e62-8079-d383fb92812f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:45.561679 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cc84f-9c8e-4e62-8079-d383fb92812f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:45.588111 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 853/1709] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:45.593493 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ca583-f0ad-4edc-a653-346b60f7df09 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:45.605908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 857/1710] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:45.610805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cc84f-9c8e-4e62-8079-d383fb92812f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:45.624792 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ca583-f0ad-4edc-a653-346b60f7df09 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:45.642298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cc84f-9c8e-4e62-8079-d383fb92812f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:45.663425 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32012cd9-f81b-44db-9433-a644e9e914bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:45.667906 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32012cd9-f81b-44db-9433-a644e9e914bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:45.668090 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d629c6e-8212-4486-bc3b-d831b14f5e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:45.670837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32012cd9-f81b-44db-9433-a644e9e914bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:45.675660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d629c6e-8212-4486-bc3b-d831b14f5e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:45.675660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d629c6e-8212-4486-bc3b-d831b14f5e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:45.675660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d629c6e-8212-4486-bc3b-d831b14f5e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:45.675987 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32012cd9-f81b-44db-9433-a644e9e914bc admin admin] PATH_INFO: `/v3/projects/b8fe724248b44a56ba4bb616ccf7947c/users/2b57208803a24a13b5d4bbd8fe8e0607/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:45.676125 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d629c6e-8212-4486-bc3b-d831b14f5e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:16:45.678329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d629c6e-8212-4486-bc3b-d831b14f5e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:45.680133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d629c6e-8212-4486-bc3b-d831b14f5e54 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:45.733989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 854/1711] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:16:45.735757 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d629c6e-8212-4486-bc3b-d831b14f5e54 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:45.760109 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:45.773006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32012cd9-f81b-44db-9433-a644e9e914bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8fe724248b44a56ba4bb616ccf7947c, user_id=2b57208803a24a13b5d4bbd8fe8e0607, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:45.780780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d629c6e-8212-4486-bc3b-d831b14f5e54 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:45.790022 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32012cd9-f81b-44db-9433-a644e9e914bc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:45.800834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c06b5-af0a-418e-9dd5-bf29d9a2ec70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:45.801698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c06b5-af0a-418e-9dd5-bf29d9a2ec70 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:45.802198 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c06b5-af0a-418e-9dd5-bf29d9a2ec70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:45.802580 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c06b5-af0a-418e-9dd5-bf29d9a2ec70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:45.803512 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c06b5-af0a-418e-9dd5-bf29d9a2ec70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:45.808471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c06b5-af0a-418e-9dd5-bf29d9a2ec70 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:45.823801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 858/1712] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:45 2022] PUT /identity/v3/projects/b8fe724248b44a56ba4bb616ccf7947c/users/2b57208803a24a13b5d4bbd8fe8e0607/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:45.845369 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d2fcb-4a7e-483c-b0e5-b46ccaf13ed4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:45.846500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d2fcb-4a7e-483c-b0e5-b46ccaf13ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:45.846959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d2fcb-4a7e-483c-b0e5-b46ccaf13ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:45.900538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 855/1713] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:45 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:45.905519 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c06b5-af0a-418e-9dd5-bf29d9a2ec70 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:45.940687 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-835d2fcb-4a7e-483c-b0e5-b46ccaf13ed4 None None] MFA Rules not processed for user `2b57208803a24a13b5d4bbd8fe8e0607`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:45.944943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-835d2fcb-4a7e-483c-b0e5-b46ccaf13ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:46.095498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c06b5-af0a-418e-9dd5-bf29d9a2ec70 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:46.102896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48549258-0da9-403e-8022-531977e0888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:46.103971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48549258-0da9-403e-8022-531977e0888d admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:46.104521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48549258-0da9-403e-8022-531977e0888d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:46.105030 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48549258-0da9-403e-8022-531977e0888d admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:46.106001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48549258-0da9-403e-8022-531977e0888d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:46.109049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48549258-0da9-403e-8022-531977e0888d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:46.153565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 859/1714] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:46.154802 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa1d83-40d9-4715-8c5b-75e70f5ce594 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:46.155097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa1d83-40d9-4715-8c5b-75e70f5ce594 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:46.155376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa1d83-40d9-4715-8c5b-75e70f5ce594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:46.160329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 856/1715] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:45 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:46.164714 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26b93-1555-4aff-9cc0-a1d318f8b8e0 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:46.165015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26b93-1555-4aff-9cc0-a1d318f8b8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:46.165301 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea26b93-1555-4aff-9cc0-a1d318f8b8e0 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:46.176022 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 857/1716] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jun 16 16:16:46 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:16:46.180950 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26b93-1555-4aff-9cc0-a1d318f8b8e0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:46.209067 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-78aa1d83-40d9-4715-8c5b-75e70f5ce594 None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:46.210639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea26b93-1555-4aff-9cc0-a1d318f8b8e0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:46.212023 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-78aa1d83-40d9-4715-8c5b-75e70f5ce594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:46.228901 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df597160-7fb2-4208-a39d-d757b0aa6cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:46.229370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df597160-7fb2-4208-a39d-d757b0aa6cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:46.230039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df597160-7fb2-4208-a39d-d757b0aa6cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:46.230515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df597160-7fb2-4208-a39d-d757b0aa6cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:46.231325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df597160-7fb2-4208-a39d-d757b0aa6cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:46.234561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df597160-7fb2-4208-a39d-d757b0aa6cb4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:46.259785 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 858/1717] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:46.261026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df597160-7fb2-4208-a39d-d757b0aa6cb4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:46.361786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 860/1718] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 16 16:16:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:46.376540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86067fe3-59c5-42e7-9c0b-8cb4cc6191d9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:46.376935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86067fe3-59c5-42e7-9c0b-8cb4cc6191d9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:46.379898 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86067fe3-59c5-42e7-9c0b-8cb4cc6191d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:46.390980 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:46.409944 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-86067fe3-59c5-42e7-9c0b-8cb4cc6191d9 None None] MFA Rules not processed for user `087adcbf737843db97dabfa9708484c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:46.412499 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-86067fe3-59c5-42e7-9c0b-8cb4cc6191d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:46.443388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df597160-7fb2-4208-a39d-d757b0aa6cb4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:46.460300 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbf5ef-3e3c-481b-ad35-3faa6f04819a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:46.461247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbf5ef-3e3c-481b-ad35-3faa6f04819a service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:46.461247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbf5ef-3e3c-481b-ad35-3faa6f04819a service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:46.462701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbf5ef-3e3c-481b-ad35-3faa6f04819a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:46.494129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbf5ef-3e3c-481b-ad35-3faa6f04819a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:46.495701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbf5ef-3e3c-481b-ad35-3faa6f04819a service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:46.513203 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 859/1719] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:46.514118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbf5ef-3e3c-481b-ad35-3faa6f04819a service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:46.547496 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbf5ef-3e3c-481b-ad35-3faa6f04819a service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:46.550707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 861/1720] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 16 16:16:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:46.554062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89ff3f-4882-4a48-980e-fae0c5f89799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:46.555481 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89ff3f-4882-4a48-980e-fae0c5f89799 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:46.555805 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89ff3f-4882-4a48-980e-fae0c5f89799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:46.556095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89ff3f-4882-4a48-980e-fae0c5f89799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:46.557390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89ff3f-4882-4a48-980e-fae0c5f89799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:46.566407 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89ff3f-4882-4a48-980e-fae0c5f89799 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:46.589947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 860/1721] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:46.594215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86067fe3-59c5-42e7-9c0b-8cb4cc6191d9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:46.615862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86067fe3-59c5-42e7-9c0b-8cb4cc6191d9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:46.634224 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731871ab-a312-4a89-aa98-55377e0e3e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:46.636297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731871ab-a312-4a89-aa98-55377e0e3e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:46.641499 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731871ab-a312-4a89-aa98-55377e0e3e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:46.642956 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731871ab-a312-4a89-aa98-55377e0e3e82 admin admin] PATH_INFO: `/v3/projects/d34653c5871647cf91d51db48e5318d9/users/5e88a4b37020486fa843a8d75345b32b/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:46.669129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89ff3f-4882-4a48-980e-fae0c5f89799 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:46.672653 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1a89ff3f-4882-4a48-980e-fae0c5f89799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:46.718564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731871ab-a312-4a89-aa98-55377e0e3e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d34653c5871647cf91d51db48e5318d9, user_id=5e88a4b37020486fa843a8d75345b32b, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:46.721459 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89ff3f-4882-4a48-980e-fae0c5f89799 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:46.724386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731871ab-a312-4a89-aa98-55377e0e3e82 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:46.746048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3400e-db90-4496-97b0-1fad9a001d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:46.749903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3400e-db90-4496-97b0-1fad9a001d32 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:46.751474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3400e-db90-4496-97b0-1fad9a001d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:46.760683 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 862/1722] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:46 2022] PUT /identity/v3/projects/d34653c5871647cf91d51db48e5318d9/users/5e88a4b37020486fa843a8d75345b32b/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:46.760683 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731871ab-a312-4a89-aa98-55377e0e3e82 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:46.762943 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3400e-db90-4496-97b0-1fad9a001d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:46.763825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-731871ab-a312-4a89-aa98-55377e0e3e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:46.795762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3400e-db90-4496-97b0-1fad9a001d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:46.797751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:46.803463 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3400e-db90-4496-97b0-1fad9a001d32 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:46.838486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 861/1723] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:46.839787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cab63-0c21-4570-a718-13adb76d3233 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:46.839787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cab63-0c21-4570-a718-13adb76d3233 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:46.840018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cab63-0c21-4570-a718-13adb76d3233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:46.978253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e94cab63-0c21-4570-a718-13adb76d3233 None None] MFA Rules not processed for user `5e88a4b37020486fa843a8d75345b32b`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:46.979547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e94cab63-0c21-4570-a718-13adb76d3233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:47.033287 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731871ab-a312-4a89-aa98-55377e0e3e82 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:47.058080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0c13b-cdcd-48f2-a723-bfc536cad501 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:47.058792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0c13b-cdcd-48f2-a723-bfc536cad501 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:47.059233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0c13b-cdcd-48f2-a723-bfc536cad501 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:47.059517 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0c13b-cdcd-48f2-a723-bfc536cad501 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:47.250061 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 862/1724] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:47.264189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cab63-0c21-4570-a718-13adb76d3233 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:47.351127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0c13b-cdcd-48f2-a723-bfc536cad501 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:47.352774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0c13b-cdcd-48f2-a723-bfc536cad501 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:47.427327 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 863/1725] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:16:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 16:16:47.687927 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cab63-0c21-4570-a718-13adb76d3233 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:47.708777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09f176-696d-4484-95ec-97fc1c94efff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:47.709589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09f176-696d-4484-95ec-97fc1c94efff admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:47.709947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09f176-696d-4484-95ec-97fc1c94efff admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:47.710337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09f176-696d-4484-95ec-97fc1c94efff admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:47.711297 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09f176-696d-4484-95ec-97fc1c94efff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:47.714648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09f176-696d-4484-95ec-97fc1c94efff admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:47.819546 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0c13b-cdcd-48f2-a723-bfc536cad501 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:47.830459 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 863/1726] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:47 2022] POST /identity/v3/projects => generated 387 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:47.840876 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0c13b-cdcd-48f2-a723-bfc536cad501 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:48.123161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f6ea6-e07a-4017-8d98-c916b7bd46ff None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:48.125706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f6ea6-e07a-4017-8d98-c916b7bd46ff None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:48.125706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f6ea6-e07a-4017-8d98-c916b7bd46ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:48.241995 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5f3f6ea6-e07a-4017-8d98-c916b7bd46ff None None] MFA Rules not processed for user `c5d0829ddcfe4116a0d180ff6d89bd20`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:48.246154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5f3f6ea6-e07a-4017-8d98-c916b7bd46ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:48.277145 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36171b-6e8d-4e0c-9461-5343febc25a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:48.278160 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36171b-6e8d-4e0c-9461-5343febc25a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:48.280286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36171b-6e8d-4e0c-9461-5343febc25a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:48.280758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36171b-6e8d-4e0c-9461-5343febc25a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:48.282320 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36171b-6e8d-4e0c-9461-5343febc25a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:48.293323 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36171b-6e8d-4e0c-9461-5343febc25a6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:48.442297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 864/1727] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:47 2022] POST /identity/v3/users => generated 300 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:16:48.449831 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78bb02-9304-4a19-a441-111b17940490 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:48.459546 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78bb02-9304-4a19-a441-111b17940490 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:48.460054 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78bb02-9304-4a19-a441-111b17940490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:48.483932 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:48.567430 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1e78bb02-9304-4a19-a441-111b17940490 None None] MFA Rules not processed for user `087adcbf737843db97dabfa9708484c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:48.579512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1e78bb02-9304-4a19-a441-111b17940490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:48.603287 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 864/1728] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:48.605638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f6ea6-e07a-4017-8d98-c916b7bd46ff None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:48.638280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f6ea6-e07a-4017-8d98-c916b7bd46ff None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:48.662247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95181a-d525-4d32-bbff-1477e4bad47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:48.671921 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95181a-d525-4d32-bbff-1477e4bad47a admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:48.680016 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95181a-d525-4d32-bbff-1477e4bad47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:48.680016 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95181a-d525-4d32-bbff-1477e4bad47a admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:48.680016 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95181a-d525-4d32-bbff-1477e4bad47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:48.683416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95181a-d525-4d32-bbff-1477e4bad47a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:48.724533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 865/1729] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:48.726247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95181a-d525-4d32-bbff-1477e4bad47a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:48.749245 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95181a-d525-4d32-bbff-1477e4bad47a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:48.762366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d09b4f-a02e-40f7-bc4b-ff3fb76c10ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:48.763758 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d09b4f-a02e-40f7-bc4b-ff3fb76c10ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:48.764153 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d09b4f-a02e-40f7-bc4b-ff3fb76c10ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:48.764544 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d09b4f-a02e-40f7-bc4b-ff3fb76c10ab admin admin] PATH_INFO: `/v3/projects/5c7a027e57e14d52a84d21a18ea45cc4/users/2243b163e50e4988be0ccabd609029eb/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:48.797905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d09b4f-a02e-40f7-bc4b-ff3fb76c10ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7a027e57e14d52a84d21a18ea45cc4, user_id=2243b163e50e4988be0ccabd609029eb, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:48.801871 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d09b4f-a02e-40f7-bc4b-ff3fb76c10ab admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:48.848429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 866/1730] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:48 2022] PUT /identity/v3/projects/5c7a027e57e14d52a84d21a18ea45cc4/users/2243b163e50e4988be0ccabd609029eb/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:48.853650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d09b4f-a02e-40f7-bc4b-ff3fb76c10ab admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:48.890680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:48.949858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 865/1731] 10.222.0.67 () {58 vars in 1015 bytes} [Thu Jun 16 16:16:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:48.970953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78bb02-9304-4a19-a441-111b17940490 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:48.972614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1e78bb02-9304-4a19-a441-111b17940490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:49.016081 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78bb02-9304-4a19-a441-111b17940490 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:49.134333 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d09b4f-a02e-40f7-bc4b-ff3fb76c10ab admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:49.136565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d22c8-a3d1-4557-8942-bf2fe5ddfedd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:49.137818 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d22c8-a3d1-4557-8942-bf2fe5ddfedd service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:49.140449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d22c8-a3d1-4557-8942-bf2fe5ddfedd service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:49.140809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d22c8-a3d1-4557-8942-bf2fe5ddfedd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:49.154375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436183ed-35eb-4a12-a312-a0eaaf79682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:49.155273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436183ed-35eb-4a12-a312-a0eaaf79682f admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:49.156282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436183ed-35eb-4a12-a312-a0eaaf79682f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:49.156282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436183ed-35eb-4a12-a312-a0eaaf79682f admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:49.157905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436183ed-35eb-4a12-a312-a0eaaf79682f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:49.164762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436183ed-35eb-4a12-a312-a0eaaf79682f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:49.180243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d22c8-a3d1-4557-8942-bf2fe5ddfedd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:49.190235 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d22c8-a3d1-4557-8942-bf2fe5ddfedd service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:49.206108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 867/1732] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:49.211080 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436183ed-35eb-4a12-a312-a0eaaf79682f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:49.232916 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436183ed-35eb-4a12-a312-a0eaaf79682f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:49.242096 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 866/1733] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:16:49.266161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fa2e7-9601-45d9-9c4b-9224df2964e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:49.267674 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fa2e7-9601-45d9-9c4b-9224df2964e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:49.268776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fa2e7-9601-45d9-9c4b-9224df2964e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:49.269294 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fa2e7-9601-45d9-9c4b-9224df2964e1 admin admin] PATH_INFO: `/v3/projects/5c7a027e57e14d52a84d21a18ea45cc4/users/2243b163e50e4988be0ccabd609029eb/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:49.276135 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fa2e7-9601-45d9-9c4b-9224df2964e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7a027e57e14d52a84d21a18ea45cc4, user_id=2243b163e50e4988be0ccabd609029eb, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:49.283414 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fa2e7-9601-45d9-9c4b-9224df2964e1 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:49.317827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 868/1734] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:49 2022] PUT /identity/v3/projects/5c7a027e57e14d52a84d21a18ea45cc4/users/2243b163e50e4988be0ccabd609029eb/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:16:49.330833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4800825-782f-4806-9fa1-8d354d68c92b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:49.331516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4800825-782f-4806-9fa1-8d354d68c92b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:49.331954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4800825-782f-4806-9fa1-8d354d68c92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:49.409600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e4800825-782f-4806-9fa1-8d354d68c92b None None] MFA Rules not processed for user `2243b163e50e4988be0ccabd609029eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:49.419408 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e4800825-782f-4806-9fa1-8d354d68c92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:49.616730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 867/1735] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:49.674403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fa2e7-9601-45d9-9c4b-9224df2964e1 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:49.677486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-001fa2e7-9601-45d9-9c4b-9224df2964e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:49.849369 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fa2e7-9601-45d9-9c4b-9224df2964e1 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:49.864361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f48770-42d6-428a-9cf3-953d27c4eae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:49.868928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f48770-42d6-428a-9cf3-953d27c4eae3 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:49.869416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f48770-42d6-428a-9cf3-953d27c4eae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:49.869797 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f48770-42d6-428a-9cf3-953d27c4eae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:49.948112 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f48770-42d6-428a-9cf3-953d27c4eae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:49.950129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f48770-42d6-428a-9cf3-953d27c4eae3 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:50.000635 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 869/1736] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:50.079619 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4800825-782f-4806-9fa1-8d354d68c92b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:50.246835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4800825-782f-4806-9fa1-8d354d68c92b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:50.255142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacaff8-cb5f-4552-92f8-56461bdacd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:50.257032 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacaff8-cb5f-4552-92f8-56461bdacd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:50.257339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacaff8-cb5f-4552-92f8-56461bdacd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:50.257815 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacaff8-cb5f-4552-92f8-56461bdacd4a admin admin] PATH_INFO: `/v3/users/5e88a4b37020486fa843a8d75345b32b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:50.259898 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eacaff8-cb5f-4552-92f8-56461bdacd4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e88a4b37020486fa843a8d75345b32b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:50.265210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eacaff8-cb5f-4552-92f8-56461bdacd4a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:50.318467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:50.403203 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3eacaff8-cb5f-4552-92f8-56461bdacd4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e88a4b37020486fa843a8d75345b32b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:50.406213 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3eacaff8-cb5f-4552-92f8-56461bdacd4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e88a4b37020486fa843a8d75345b32b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:50.440575 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3eacaff8-cb5f-4552-92f8-56461bdacd4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e88a4b37020486fa843a8d75345b32b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:50.442540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3eacaff8-cb5f-4552-92f8-56461bdacd4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e88a4b37020486fa843a8d75345b32b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:50.463802 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3eacaff8-cb5f-4552-92f8-56461bdacd4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e88a4b37020486fa843a8d75345b32b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:50.489577 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 868/1737] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:16:50 2022] DELETE /identity/v3/users/5e88a4b37020486fa843a8d75345b32b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:50.497634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352ab88-3a2d-4be4-b0b5-ef1c53bd6c93 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:50.498738 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352ab88-3a2d-4be4-b0b5-ef1c53bd6c93 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:50.501123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352ab88-3a2d-4be4-b0b5-ef1c53bd6c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:50.529453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b352ab88-3a2d-4be4-b0b5-ef1c53bd6c93 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:50.532119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b352ab88-3a2d-4be4-b0b5-ef1c53bd6c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:50.596044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:50.771826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 870/1738] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:50.809330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacaff8-cb5f-4552-92f8-56461bdacd4a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:50.811024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3eacaff8-cb5f-4552-92f8-56461bdacd4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:51.111939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacaff8-cb5f-4552-92f8-56461bdacd4a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:51.133834 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b25c3-ee75-48ae-85f8-e4f1a9257c01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:51.134560 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b25c3-ee75-48ae-85f8-e4f1a9257c01 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:51.134918 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b25c3-ee75-48ae-85f8-e4f1a9257c01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:51.135227 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b25c3-ee75-48ae-85f8-e4f1a9257c01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:51.188382 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b25c3-ee75-48ae-85f8-e4f1a9257c01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:51.199725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b25c3-ee75-48ae-85f8-e4f1a9257c01 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:51.252207 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 869/1739] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:52.681503 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352ab88-3a2d-4be4-b0b5-ef1c53bd6c93 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:52.684061 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b352ab88-3a2d-4be4-b0b5-ef1c53bd6c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:52.719334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352ab88-3a2d-4be4-b0b5-ef1c53bd6c93 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:52.787278 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d067f-6a7e-4c67-96e0-7fbe982e5637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:52.789509 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d067f-6a7e-4c67-96e0-7fbe982e5637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:52.792936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d067f-6a7e-4c67-96e0-7fbe982e5637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:52.796911 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d067f-6a7e-4c67-96e0-7fbe982e5637 admin admin] PATH_INFO: `/v3/projects/d34653c5871647cf91d51db48e5318d9` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:52.807443 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d067f-6a7e-4c67-96e0-7fbe982e5637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d34653c5871647cf91d51db48e5318d9)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:52.818303 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d067f-6a7e-4c67-96e0-7fbe982e5637 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:52.882758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9691251-b411-418d-8366-250e93fcc96a None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:52.883679 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9691251-b411-418d-8366-250e93fcc96a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:52.884187 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9691251-b411-418d-8366-250e93fcc96a None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:52.887660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 870/1740] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 16 16:16:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:16:53.042365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a02d067f-6a7e-4c67-96e0-7fbe982e5637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd34653c5871647cf91d51db48e5318d9', 'request_id': 'req-a02d067f-6a7e-4c67-96e0-7fbe982e5637'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:53.067154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a02d067f-6a7e-4c67-96e0-7fbe982e5637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd34653c5871647cf91d51db48e5318d9', 'request_id': 'req-a02d067f-6a7e-4c67-96e0-7fbe982e5637'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:53.104268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a02d067f-6a7e-4c67-96e0-7fbe982e5637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd34653c5871647cf91d51db48e5318d9', 'request_id': 'req-a02d067f-6a7e-4c67-96e0-7fbe982e5637'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:53.159523 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a02d067f-6a7e-4c67-96e0-7fbe982e5637 admin admin] The token cache is being invalidate because project d34653c5871647cf91d51db48e5318d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:16:53.159967 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a02d067f-6a7e-4c67-96e0-7fbe982e5637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:53.162321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a02d067f-6a7e-4c67-96e0-7fbe982e5637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:53.165610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 871/1741] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:16:52 2022] DELETE /identity/v3/projects/d34653c5871647cf91d51db48e5318d9 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:53.170743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9691251-b411-418d-8366-250e93fcc96a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:53.172877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b9691251-b411-418d-8366-250e93fcc96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:53.355391 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de412092-b6c7-4336-bfa8-6dd83cb9634a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:53.355681 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de412092-b6c7-4336-bfa8-6dd83cb9634a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:53.356203 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de412092-b6c7-4336-bfa8-6dd83cb9634a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:53.412074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-de412092-b6c7-4336-bfa8-6dd83cb9634a None None] MFA Rules not processed for user `795c029cb14b42b5b0f3987e218d4239`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:53.421047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-de412092-b6c7-4336-bfa8-6dd83cb9634a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:53.500906 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9691251-b411-418d-8366-250e93fcc96a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:53.522698 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745507d0-4187-4837-aa38-70b09de3db46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:53.523608 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745507d0-4187-4837-aa38-70b09de3db46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:53.523891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745507d0-4187-4837-aa38-70b09de3db46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:53.524168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745507d0-4187-4837-aa38-70b09de3db46 admin admin] PATH_INFO: `/v3/users/2243b163e50e4988be0ccabd609029eb` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:53.532865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745507d0-4187-4837-aa38-70b09de3db46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2243b163e50e4988be0ccabd609029eb)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:53.551550 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745507d0-4187-4837-aa38-70b09de3db46 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:53.680098 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:53.691894 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-745507d0-4187-4837-aa38-70b09de3db46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2243b163e50e4988be0ccabd609029eb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:53.692720 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-745507d0-4187-4837-aa38-70b09de3db46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2243b163e50e4988be0ccabd609029eb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:53.703718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 872/1742] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 16 16:16:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:53.731270 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-745507d0-4187-4837-aa38-70b09de3db46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2243b163e50e4988be0ccabd609029eb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:53.732756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-745507d0-4187-4837-aa38-70b09de3db46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2243b163e50e4988be0ccabd609029eb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:53.776063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-745507d0-4187-4837-aa38-70b09de3db46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2243b163e50e4988be0ccabd609029eb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:53.825884 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 871/1743] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:16:53 2022] DELETE /identity/v3/users/2243b163e50e4988be0ccabd609029eb => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:53.843893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de412092-b6c7-4336-bfa8-6dd83cb9634a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:53.845710 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-de412092-b6c7-4336-bfa8-6dd83cb9634a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:53.874584 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de412092-b6c7-4336-bfa8-6dd83cb9634a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:54.052436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745507d0-4187-4837-aa38-70b09de3db46 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:54.054361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-745507d0-4187-4837-aa38-70b09de3db46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:54.074621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:54.243758 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfaa59-ebe4-41ba-b388-270ac58a38d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:54.245173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfaa59-ebe4-41ba-b388-270ac58a38d5 service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:54.245501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfaa59-ebe4-41ba-b388-270ac58a38d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:54.245984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfaa59-ebe4-41ba-b388-270ac58a38d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:54.248920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-70bfaa59-ebe4-41ba-b388-270ac58a38d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:54.301637 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfaa59-ebe4-41ba-b388-270ac58a38d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:54.305870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfaa59-ebe4-41ba-b388-270ac58a38d5 service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:54.421939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 873/1744] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:54.445062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfaa59-ebe4-41ba-b388-270ac58a38d5 service nova] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:54.448478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-70bfaa59-ebe4-41ba-b388-270ac58a38d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:54.600469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745507d0-4187-4837-aa38-70b09de3db46 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:54.629871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfa9c6-b862-41ab-ac76-e5bf5120b199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:54.630649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfa9c6-b862-41ab-ac76-e5bf5120b199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:54.630939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfa9c6-b862-41ab-ac76-e5bf5120b199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:54.632061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfa9c6-b862-41ab-ac76-e5bf5120b199 admin admin] PATH_INFO: `/v3/users/63d83f431b07411ea8a6d221a03a9d97` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:54.633089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfa9c6-b862-41ab-ac76-e5bf5120b199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d83f431b07411ea8a6d221a03a9d97)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:54.635707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfa9c6-b862-41ab-ac76-e5bf5120b199 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:54.760493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d2cfa9c6-b862-41ab-ac76-e5bf5120b199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d83f431b07411ea8a6d221a03a9d97'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:54.761122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d2cfa9c6-b862-41ab-ac76-e5bf5120b199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d83f431b07411ea8a6d221a03a9d97'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:54.771992 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfaa59-ebe4-41ba-b388-270ac58a38d5 service nova] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:54.782075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d2cfa9c6-b862-41ab-ac76-e5bf5120b199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d83f431b07411ea8a6d221a03a9d97'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:54.782799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d2cfa9c6-b862-41ab-ac76-e5bf5120b199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d83f431b07411ea8a6d221a03a9d97'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:54.796778 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d2cfa9c6-b862-41ab-ac76-e5bf5120b199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d83f431b07411ea8a6d221a03a9d97'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:54.805915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fe998-f32d-4f7c-ad3a-f51617ca26fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:54.806878 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fe998-f32d-4f7c-ad3a-f51617ca26fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:54.807168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fe998-f32d-4f7c-ad3a-f51617ca26fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:54.807451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fe998-f32d-4f7c-ad3a-f51617ca26fe admin admin] PATH_INFO: `/v3/projects/5c7a027e57e14d52a84d21a18ea45cc4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:54.811571 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fe998-f32d-4f7c-ad3a-f51617ca26fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7a027e57e14d52a84d21a18ea45cc4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:54.813545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fe998-f32d-4f7c-ad3a-f51617ca26fe admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:54.830359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 872/1745] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:16:54 2022] DELETE /identity/v3/users/63d83f431b07411ea8a6d221a03a9d97 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:54.835356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f0df1-d2e4-41fd-a6d2-02352f230a25 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:54.835553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f0df1-d2e4-41fd-a6d2-02352f230a25 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:54.835922 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f0df1-d2e4-41fd-a6d2-02352f230a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:54.908236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-030f0df1-d2e4-41fd-a6d2-02352f230a25 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:54.926535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-030f0df1-d2e4-41fd-a6d2-02352f230a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:54.956503 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7b9fe998-f32d-4f7c-ad3a-f51617ca26fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7a027e57e14d52a84d21a18ea45cc4', 'request_id': 'req-7b9fe998-f32d-4f7c-ad3a-f51617ca26fe'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:54.981491 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7b9fe998-f32d-4f7c-ad3a-f51617ca26fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7a027e57e14d52a84d21a18ea45cc4', 'request_id': 'req-7b9fe998-f32d-4f7c-ad3a-f51617ca26fe'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:54.996359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7b9fe998-f32d-4f7c-ad3a-f51617ca26fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7a027e57e14d52a84d21a18ea45cc4', 'request_id': 'req-7b9fe998-f32d-4f7c-ad3a-f51617ca26fe'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:55.038610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7b9fe998-f32d-4f7c-ad3a-f51617ca26fe admin admin] The token cache is being invalidate because project 5c7a027e57e14d52a84d21a18ea45cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:16:55.039256 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7b9fe998-f32d-4f7c-ad3a-f51617ca26fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:55.041472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7b9fe998-f32d-4f7c-ad3a-f51617ca26fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:55.047174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 874/1746] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:16:54 2022] DELETE /identity/v3/projects/5c7a027e57e14d52a84d21a18ea45cc4 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:55.054754 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a590b-5677-4d96-84cf-5345af58beea None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:55.055337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a590b-5677-4d96-84cf-5345af58beea None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:55.055907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a590b-5677-4d96-84cf-5345af58beea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:55.126237 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-8e9a590b-5677-4d96-84cf-5345af58beea None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:55.127998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8e9a590b-5677-4d96-84cf-5345af58beea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:55.147861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:55.196668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 873/1747] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:55.197848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f0df1-d2e4-41fd-a6d2-02352f230a25 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:55.200111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-030f0df1-d2e4-41fd-a6d2-02352f230a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:55.219783 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f0df1-d2e4-41fd-a6d2-02352f230a25 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:55.227900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72f5be-9a98-43fa-828f-e00c07a945e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:55.230252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72f5be-9a98-43fa-828f-e00c07a945e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:55.230775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72f5be-9a98-43fa-828f-e00c07a945e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:55.231454 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72f5be-9a98-43fa-828f-e00c07a945e3 admin admin] PATH_INFO: `/v3/users/fd3c802c51c34e05bc1fc3ee1be1c03f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:55.234698 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72f5be-9a98-43fa-828f-e00c07a945e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd3c802c51c34e05bc1fc3ee1be1c03f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:55.239768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72f5be-9a98-43fa-828f-e00c07a945e3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:55.344270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:55.372219 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 875/1748] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:55.373110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a590b-5677-4d96-84cf-5345af58beea None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:55.380631 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8e9a590b-5677-4d96-84cf-5345af58beea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:55.400738 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bf72f5be-9a98-43fa-828f-e00c07a945e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd3c802c51c34e05bc1fc3ee1be1c03f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:55.402163 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bf72f5be-9a98-43fa-828f-e00c07a945e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd3c802c51c34e05bc1fc3ee1be1c03f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:55.439008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bf72f5be-9a98-43fa-828f-e00c07a945e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd3c802c51c34e05bc1fc3ee1be1c03f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:55.439836 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bf72f5be-9a98-43fa-828f-e00c07a945e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd3c802c51c34e05bc1fc3ee1be1c03f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:55.458135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-bf72f5be-9a98-43fa-828f-e00c07a945e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd3c802c51c34e05bc1fc3ee1be1c03f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:55.484072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 874/1749] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:16:55 2022] DELETE /identity/v3/users/fd3c802c51c34e05bc1fc3ee1be1c03f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:55.487057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbad0cd-8f20-46da-8b71-513346259209 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:55.487369 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbad0cd-8f20-46da-8b71-513346259209 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:55.487649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbad0cd-8f20-46da-8b71-513346259209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:55.530783 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ecbad0cd-8f20-46da-8b71-513346259209 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:55.545893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ecbad0cd-8f20-46da-8b71-513346259209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:55.575193 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a590b-5677-4d96-84cf-5345af58beea None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:55.706647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 875/1750] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:55.711687 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7dc60-2e21-4b7e-ab43-a85db40c3a1b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:55.712253 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7dc60-2e21-4b7e-ab43-a85db40c3a1b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:55.712892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7dc60-2e21-4b7e-ab43-a85db40c3a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:55.720882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a4f7e-bfee-4517-9535-ac2e3b2ed976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:55.721636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a4f7e-bfee-4517-9535-ac2e3b2ed976 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:55.726266 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a4f7e-bfee-4517-9535-ac2e3b2ed976 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:55.728125 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a4f7e-bfee-4517-9535-ac2e3b2ed976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:55.731608 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5a5a4f7e-bfee-4517-9535-ac2e3b2ed976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:55.737789 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-38c7dc60-2e21-4b7e-ab43-a85db40c3a1b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:55.739897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-38c7dc60-2e21-4b7e-ab43-a85db40c3a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:55.752340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 876/1751] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:55.759749 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7dc60-2e21-4b7e-ab43-a85db40c3a1b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:55.776927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7dc60-2e21-4b7e-ab43-a85db40c3a1b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:55.781543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a4f7e-bfee-4517-9535-ac2e3b2ed976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:55.784457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070794d7-cf3d-4259-8e1b-e5de7e74575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:55.784814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a4f7e-bfee-4517-9535-ac2e3b2ed976 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:55.785390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070794d7-cf3d-4259-8e1b-e5de7e74575e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:55.785772 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070794d7-cf3d-4259-8e1b-e5de7e74575e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:55.786153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070794d7-cf3d-4259-8e1b-e5de7e74575e admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:55.787143 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070794d7-cf3d-4259-8e1b-e5de7e74575e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:16:55.787553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070794d7-cf3d-4259-8e1b-e5de7e74575e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:55.789698 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070794d7-cf3d-4259-8e1b-e5de7e74575e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:55.813116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 877/1753] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:16:55.814265 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070794d7-cf3d-4259-8e1b-e5de7e74575e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:55.818058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-070794d7-cf3d-4259-8e1b-e5de7e74575e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:55.819053 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 876/1753] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:55.821256 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a4f7e-bfee-4517-9535-ac2e3b2ed976 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:55.842816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070794d7-cf3d-4259-8e1b-e5de7e74575e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:55.844817 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a4f7e-bfee-4517-9535-ac2e3b2ed976 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:55.853571 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1606f-13e5-42e2-8d33-63d6f9a3abf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:55.855387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1606f-13e5-42e2-8d33-63d6f9a3abf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:55.855999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1606f-13e5-42e2-8d33-63d6f9a3abf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:55.856490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1606f-13e5-42e2-8d33-63d6f9a3abf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:55.858086 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe2b89-4a53-451d-8957-fa1dd84bb1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:55.858974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe2b89-4a53-451d-8957-fa1dd84bb1af admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:55.859267 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe2b89-4a53-451d-8957-fa1dd84bb1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:55.859607 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe2b89-4a53-451d-8957-fa1dd84bb1af admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:55.860797 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe2b89-4a53-451d-8957-fa1dd84bb1af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:55.873626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1606f-13e5-42e2-8d33-63d6f9a3abf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:55.877105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1606f-13e5-42e2-8d33-63d6f9a3abf1 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:55.880223 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe2b89-4a53-451d-8957-fa1dd84bb1af admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:55.920425 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 878/1754] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:55.968700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1606f-13e5-42e2-8d33-63d6f9a3abf1 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:55.976839 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 877/1755] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:16:55 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:55.985854 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1606f-13e5-42e2-8d33-63d6f9a3abf1 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:56.032406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:56.200484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113c7b4-a820-4cf2-8334-8946b22b6a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:56.201238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113c7b4-a820-4cf2-8334-8946b22b6a46 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:56.201535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113c7b4-a820-4cf2-8334-8946b22b6a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:56.201828 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113c7b4-a820-4cf2-8334-8946b22b6a46 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:56.202660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113c7b4-a820-4cf2-8334-8946b22b6a46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:56.208263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113c7b4-a820-4cf2-8334-8946b22b6a46 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:56.283036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe2b89-4a53-451d-8957-fa1dd84bb1af admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:56.297732 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 879/1756] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:16:55 2022] POST /identity/v3/users => generated 281 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:16:56.304770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe2b89-4a53-451d-8957-fa1dd84bb1af admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:56.319484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bf9bf-e855-4896-b1f1-c5baede3dd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:56.320749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bf9bf-e855-4896-b1f1-c5baede3dd6b admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:56.321462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bf9bf-e855-4896-b1f1-c5baede3dd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:56.322055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bf9bf-e855-4896-b1f1-c5baede3dd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:56.326060 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bf9bf-e855-4896-b1f1-c5baede3dd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:56.329421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bf9bf-e855-4896-b1f1-c5baede3dd6b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:56.378169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 878/1757] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:56.378462 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113c7b4-a820-4cf2-8334-8946b22b6a46 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:56.400125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113c7b4-a820-4cf2-8334-8946b22b6a46 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:56.410547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8bbfb-5e00-4dca-9083-e46886a5a357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:56.412095 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8bbfb-5e00-4dca-9083-e46886a5a357 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:56.412390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8bbfb-5e00-4dca-9083-e46886a5a357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:56.412929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8bbfb-5e00-4dca-9083-e46886a5a357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:56.413766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8bbfb-5e00-4dca-9083-e46886a5a357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:56.415640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8bbfb-5e00-4dca-9083-e46886a5a357 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:56.438599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bf9bf-e855-4896-b1f1-c5baede3dd6b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:56.453580 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 880/1758] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:16:56.460858 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bf9bf-e855-4896-b1f1-c5baede3dd6b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:56.468963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236e485-3276-4789-934e-cb9d38879409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:56.470133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236e485-3276-4789-934e-cb9d38879409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:56.470255 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236e485-3276-4789-934e-cb9d38879409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:56.470549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236e485-3276-4789-934e-cb9d38879409 admin admin] PATH_INFO: `/v3/projects/91ea5fbef52944339edfb7b43128d864/users/8839e0fe61624527b5f12adb145bfa23/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:56.512840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236e485-3276-4789-934e-cb9d38879409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ea5fbef52944339edfb7b43128d864, user_id=8839e0fe61624527b5f12adb145bfa23, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:56.517274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236e485-3276-4789-934e-cb9d38879409 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:56.543643 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 879/1759] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:16:56 2022] PUT /identity/v3/projects/91ea5fbef52944339edfb7b43128d864/users/8839e0fe61624527b5f12adb145bfa23/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:56.567694 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e003b-c5c3-4e16-ae25-7646c9bbdf5b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:56.568076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e003b-c5c3-4e16-ae25-7646c9bbdf5b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:56.568371 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e003b-c5c3-4e16-ae25-7646c9bbdf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:56.645957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e17e003b-c5c3-4e16-ae25-7646c9bbdf5b None None] MFA Rules not processed for user `8839e0fe61624527b5f12adb145bfa23`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:56.649361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e17e003b-c5c3-4e16-ae25-7646c9bbdf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:56.858108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 881/1760] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:56.901221 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236e485-3276-4789-934e-cb9d38879409 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:56.903354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9236e485-3276-4789-934e-cb9d38879409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:57.028792 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236e485-3276-4789-934e-cb9d38879409 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:57.033333 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f95d78-534d-4a0c-90e5-972e32813b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:57.034108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f95d78-534d-4a0c-90e5-972e32813b58 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:57.034408 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f95d78-534d-4a0c-90e5-972e32813b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:57.034756 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f95d78-534d-4a0c-90e5-972e32813b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:57.048939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f95d78-534d-4a0c-90e5-972e32813b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:57.051919 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f95d78-534d-4a0c-90e5-972e32813b58 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:57.069141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 880/1761] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:57.085564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e003b-c5c3-4e16-ae25-7646c9bbdf5b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:57.310493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e003b-c5c3-4e16-ae25-7646c9bbdf5b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:57.334827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb013e0-b275-482c-b023-94c568b559b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:57.336032 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb013e0-b275-482c-b023-94c568b559b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:57.336321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb013e0-b275-482c-b023-94c568b559b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:57.336631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb013e0-b275-482c-b023-94c568b559b5 admin admin] PATH_INFO: `/v3/users/8839e0fe61624527b5f12adb145bfa23` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:57.348535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb013e0-b275-482c-b023-94c568b559b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8839e0fe61624527b5f12adb145bfa23)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:57.354904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb013e0-b275-482c-b023-94c568b559b5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:57.407264 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f95d78-534d-4a0c-90e5-972e32813b58 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:57.409001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b8f95d78-534d-4a0c-90e5-972e32813b58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:57.453853 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:57.467797 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:57.468867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f95d78-534d-4a0c-90e5-972e32813b58 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:57.489064 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac385c7b-ae01-4961-8d17-901ba9ecaa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:57.489964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac385c7b-ae01-4961-8d17-901ba9ecaa42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:57.490249 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac385c7b-ae01-4961-8d17-901ba9ecaa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:57.490559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac385c7b-ae01-4961-8d17-901ba9ecaa42 admin admin] PATH_INFO: `/v3/projects/fb6611b36fe8476b9bbf5379f0bc5cca` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:57.493176 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac385c7b-ae01-4961-8d17-901ba9ecaa42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6611b36fe8476b9bbf5379f0bc5cca)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:57.498378 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac385c7b-ae01-4961-8d17-901ba9ecaa42 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:57.512990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4eb013e0-b275-482c-b023-94c568b559b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8839e0fe61624527b5f12adb145bfa23'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:57.516011 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4eb013e0-b275-482c-b023-94c568b559b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8839e0fe61624527b5f12adb145bfa23'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:57.567477 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4eb013e0-b275-482c-b023-94c568b559b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8839e0fe61624527b5f12adb145bfa23'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:57.568927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4eb013e0-b275-482c-b023-94c568b559b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8839e0fe61624527b5f12adb145bfa23'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:57.587558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4eb013e0-b275-482c-b023-94c568b559b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8839e0fe61624527b5f12adb145bfa23'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:57.647537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 882/1762] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:16:57 2022] DELETE /identity/v3/users/8839e0fe61624527b5f12adb145bfa23 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:57.651220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaad51-37ce-460e-85b9-9e3df5ac8bcc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:57.651560 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaad51-37ce-460e-85b9-9e3df5ac8bcc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:57.651892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaad51-37ce-460e-85b9-9e3df5ac8bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:57.688227 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ac385c7b-ae01-4961-8d17-901ba9ecaa42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6611b36fe8476b9bbf5379f0bc5cca', 'request_id': 'req-ac385c7b-ae01-4961-8d17-901ba9ecaa42'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:57.715411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ac385c7b-ae01-4961-8d17-901ba9ecaa42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6611b36fe8476b9bbf5379f0bc5cca', 'request_id': 'req-ac385c7b-ae01-4961-8d17-901ba9ecaa42'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:57.734368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ac385c7b-ae01-4961-8d17-901ba9ecaa42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6611b36fe8476b9bbf5379f0bc5cca', 'request_id': 'req-ac385c7b-ae01-4961-8d17-901ba9ecaa42'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:57.752932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cdaaad51-37ce-460e-85b9-9e3df5ac8bcc None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:16:57.757169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ac385c7b-ae01-4961-8d17-901ba9ecaa42 admin admin] The token cache is being invalidate because project fb6611b36fe8476b9bbf5379f0bc5cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:16:57.757958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ac385c7b-ae01-4961-8d17-901ba9ecaa42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:57.760021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cdaaad51-37ce-460e-85b9-9e3df5ac8bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:57.760461 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ac385c7b-ae01-4961-8d17-901ba9ecaa42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:57.766052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 881/1763] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:16:57 2022] DELETE /identity/v3/projects/fb6611b36fe8476b9bbf5379f0bc5cca => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:16:57.766052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac385c7b-ae01-4961-8d17-901ba9ecaa42 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:57.767643 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ac385c7b-ae01-4961-8d17-901ba9ecaa42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:57.887524 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac385c7b-ae01-4961-8d17-901ba9ecaa42 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:57.972186 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:57.973944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:57.974369 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:57.974794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b admin admin] PATH_INFO: `/v3/projects/7a8dec49cf33465993ab41c96ac16e84` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:57.976319 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8dec49cf33465993ab41c96ac16e84)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:57.978525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:58.041046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 883/1764] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:16:58.043336 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaad51-37ce-460e-85b9-9e3df5ac8bcc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:58.057257 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cdaaad51-37ce-460e-85b9-9e3df5ac8bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:58.058651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:58.090874 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8dec49cf33465993ab41c96ac16e84', 'request_id': 'req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:58.114225 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8dec49cf33465993ab41c96ac16e84', 'request_id': 'req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:58.114360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaad51-37ce-460e-85b9-9e3df5ac8bcc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:58.129471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8dec49cf33465993ab41c96ac16e84', 'request_id': 'req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:58.148920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b admin admin] The token cache is being invalidate because project 7a8dec49cf33465993ab41c96ac16e84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:16:58.149609 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:58.152554 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:58.154937 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 882/1765] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:16:57 2022] DELETE /identity/v3/projects/7a8dec49cf33465993ab41c96ac16e84 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:58.155819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:58.157289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:58.283481 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ca965-1a8b-48c4-93c5-f97ba3069d9b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:58.297626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e6c55-416b-44bb-a817-b1463d893f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:58.298301 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e6c55-416b-44bb-a817-b1463d893f5f service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:58.298629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e6c55-416b-44bb-a817-b1463d893f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:58.299174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e6c55-416b-44bb-a817-b1463d893f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:58.301716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0e3e6c55-416b-44bb-a817-b1463d893f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:58.376046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160f5d4-127a-4762-a900-8add42928cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:58.377702 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160f5d4-127a-4762-a900-8add42928cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:58.379882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160f5d4-127a-4762-a900-8add42928cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:58.380364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160f5d4-127a-4762-a900-8add42928cdc admin admin] PATH_INFO: `/v3/users/451124e8d2b74d029e20c6eb132114e0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:58.383301 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160f5d4-127a-4762-a900-8add42928cdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=451124e8d2b74d029e20c6eb132114e0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:58.390697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160f5d4-127a-4762-a900-8add42928cdc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:58.451034 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e6c55-416b-44bb-a817-b1463d893f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:58.453872 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e6c55-416b-44bb-a817-b1463d893f5f service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:58.471185 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 883/1766] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:16:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:16:58.473027 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e6c55-416b-44bb-a817-b1463d893f5f service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:58.475228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0e3e6c55-416b-44bb-a817-b1463d893f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:58.491843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e6c55-416b-44bb-a817-b1463d893f5f service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:16:58.500721 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5a66d-282a-48b7-a93a-6ea7dda36d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:16:58.501808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5a66d-282a-48b7-a93a-6ea7dda36d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:16:58.502379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5a66d-282a-48b7-a93a-6ea7dda36d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:16:58.504580 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5a66d-282a-48b7-a93a-6ea7dda36d7b admin admin] PATH_INFO: `/v3/users/27deadd28c2f4d75a7f224fed925ee05` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:16:58.509074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5a66d-282a-48b7-a93a-6ea7dda36d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=27deadd28c2f4d75a7f224fed925ee05)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:16:58.514697 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5a66d-282a-48b7-a93a-6ea7dda36d7b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:16:58.525410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8160f5d4-127a-4762-a900-8add42928cdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451124e8d2b74d029e20c6eb132114e0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:58.525656 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8160f5d4-127a-4762-a900-8add42928cdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451124e8d2b74d029e20c6eb132114e0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:58.527392 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:58.557737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8160f5d4-127a-4762-a900-8add42928cdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451124e8d2b74d029e20c6eb132114e0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:58.559169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8160f5d4-127a-4762-a900-8add42928cdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451124e8d2b74d029e20c6eb132114e0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:58.572286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8160f5d4-127a-4762-a900-8add42928cdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451124e8d2b74d029e20c6eb132114e0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:58.598691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 884/1767] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:16:58 2022] DELETE /identity/v3/users/451124e8d2b74d029e20c6eb132114e0 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:58.636511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-38f5a66d-282a-48b7-a93a-6ea7dda36d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27deadd28c2f4d75a7f224fed925ee05'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:58.677957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-38f5a66d-282a-48b7-a93a-6ea7dda36d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27deadd28c2f4d75a7f224fed925ee05'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:58.694326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-38f5a66d-282a-48b7-a93a-6ea7dda36d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27deadd28c2f4d75a7f224fed925ee05'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:58.697594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-38f5a66d-282a-48b7-a93a-6ea7dda36d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27deadd28c2f4d75a7f224fed925ee05'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:58.703862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:16:58.710927 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-38f5a66d-282a-48b7-a93a-6ea7dda36d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27deadd28c2f4d75a7f224fed925ee05'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:16:58.755243 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 884/1768] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:16:58 2022] DELETE /identity/v3/users/27deadd28c2f4d75a7f224fed925ee05 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:16:59.769204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160f5d4-127a-4762-a900-8add42928cdc admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:59.772070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8160f5d4-127a-4762-a900-8add42928cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:59.895598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5a66d-282a-48b7-a93a-6ea7dda36d7b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:16:59.897085 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-38f5a66d-282a-48b7-a93a-6ea7dda36d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:16:59.944162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160f5d4-127a-4762-a900-8add42928cdc admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:00.091939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5a66d-282a-48b7-a93a-6ea7dda36d7b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:00.096345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4135a4c-6598-4a10-9dce-c777b7892722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:00.097522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4135a4c-6598-4a10-9dce-c777b7892722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:00.099587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4135a4c-6598-4a10-9dce-c777b7892722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:00.100021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4135a4c-6598-4a10-9dce-c777b7892722 admin admin] PATH_INFO: `/v3/projects/b75585fe51ca4b148230f32a723e5c4a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:00.104111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4135a4c-6598-4a10-9dce-c777b7892722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75585fe51ca4b148230f32a723e5c4a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:00.110661 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4135a4c-6598-4a10-9dce-c777b7892722 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:00.119734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033dc358-522c-4517-bc15-89dc2694d76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:00.123273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dc358-522c-4517-bc15-89dc2694d76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:00.132330 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dc358-522c-4517-bc15-89dc2694d76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:00.133200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dc358-522c-4517-bc15-89dc2694d76f admin admin] PATH_INFO: `/v3/projects/91ea5fbef52944339edfb7b43128d864` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:00.136761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033dc358-522c-4517-bc15-89dc2694d76f admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ea5fbef52944339edfb7b43128d864)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:00.143269 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033dc358-522c-4517-bc15-89dc2694d76f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:00.317655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a4135a4c-6598-4a10-9dce-c777b7892722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75585fe51ca4b148230f32a723e5c4a', 'request_id': 'req-a4135a4c-6598-4a10-9dce-c777b7892722'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:00.337782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a4135a4c-6598-4a10-9dce-c777b7892722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75585fe51ca4b148230f32a723e5c4a', 'request_id': 'req-a4135a4c-6598-4a10-9dce-c777b7892722'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:00.369715 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a4135a4c-6598-4a10-9dce-c777b7892722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75585fe51ca4b148230f32a723e5c4a', 'request_id': 'req-a4135a4c-6598-4a10-9dce-c777b7892722'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:00.374539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-033dc358-522c-4517-bc15-89dc2694d76f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ea5fbef52944339edfb7b43128d864', 'request_id': 'req-033dc358-522c-4517-bc15-89dc2694d76f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:00.393976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-033dc358-522c-4517-bc15-89dc2694d76f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ea5fbef52944339edfb7b43128d864', 'request_id': 'req-033dc358-522c-4517-bc15-89dc2694d76f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:00.407582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-033dc358-522c-4517-bc15-89dc2694d76f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ea5fbef52944339edfb7b43128d864', 'request_id': 'req-033dc358-522c-4517-bc15-89dc2694d76f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:00.418988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a4135a4c-6598-4a10-9dce-c777b7892722 admin admin] The token cache is being invalidate because project b75585fe51ca4b148230f32a723e5c4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:00.419313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a4135a4c-6598-4a10-9dce-c777b7892722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:00.423720 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a4135a4c-6598-4a10-9dce-c777b7892722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:00.437379 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 885/1769] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:16:59 2022] DELETE /identity/v3/projects/b75585fe51ca4b148230f32a723e5c4a => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:00.437526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-033dc358-522c-4517-bc15-89dc2694d76f admin admin] The token cache is being invalidate because project 91ea5fbef52944339edfb7b43128d864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:00.437526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-033dc358-522c-4517-bc15-89dc2694d76f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:00.438274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-033dc358-522c-4517-bc15-89dc2694d76f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:00.441288 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813924e-5bfd-4fdd-baad-09179faf664b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:00.441727 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813924e-5bfd-4fdd-baad-09179faf664b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:00.442062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813924e-5bfd-4fdd-baad-09179faf664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:00.442383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 885/1770] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:16:59 2022] DELETE /identity/v3/projects/91ea5fbef52944339edfb7b43128d864 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:00.454504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3de4d0-5b1f-4756-a747-85b8f864ea98 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:00.454504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3de4d0-5b1f-4756-a747-85b8f864ea98 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:00.454504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3de4d0-5b1f-4756-a747-85b8f864ea98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:00.456307 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:00.471707 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6e3de4d0-5b1f-4756-a747-85b8f864ea98 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:00.473788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6e3de4d0-5b1f-4756-a747-85b8f864ea98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:00.502282 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4813924e-5bfd-4fdd-baad-09179faf664b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:00.503835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4813924e-5bfd-4fdd-baad-09179faf664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:00.655389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 886/1771] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:00.657704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57714d-8474-4eee-b461-aad08b36bc7c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:00.658783 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57714d-8474-4eee-b461-aad08b36bc7c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:00.663174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57714d-8474-4eee-b461-aad08b36bc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:00.677339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 886/1772] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:00.679854 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bab1bc-3cad-4643-a3de-055b597e6aa1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:00.680147 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bab1bc-3cad-4643-a3de-055b597e6aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:00.680426 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bab1bc-3cad-4643-a3de-055b597e6aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:00.716547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-bf57714d-8474-4eee-b461-aad08b36bc7c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:00.719768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bf57714d-8474-4eee-b461-aad08b36bc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:00.726449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-31bab1bc-3cad-4643-a3de-055b597e6aa1 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:00.728429 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-31bab1bc-3cad-4643-a3de-055b597e6aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:00.754937 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 887/1773] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:00.755866 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57714d-8474-4eee-b461-aad08b36bc7c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:00.767605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 887/1774] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:00.767825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57714d-8474-4eee-b461-aad08b36bc7c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:00.768578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bab1bc-3cad-4643-a3de-055b597e6aa1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:00.774599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fe118-77ff-49ee-a783-1af12ca109fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:00.776086 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fe118-77ff-49ee-a783-1af12ca109fc admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:00.776374 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fe118-77ff-49ee-a783-1af12ca109fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:00.776783 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fe118-77ff-49ee-a783-1af12ca109fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:00.777401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fe118-77ff-49ee-a783-1af12ca109fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:00.778844 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fe118-77ff-49ee-a783-1af12ca109fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:00.780498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fe118-77ff-49ee-a783-1af12ca109fc admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:00.789382 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:00.795024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bab1bc-3cad-4643-a3de-055b597e6aa1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:00.803924 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff0ff2-22c6-4afe-9764-080f51bb3754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:00.804682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff0ff2-22c6-4afe-9764-080f51bb3754 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:00.804963 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff0ff2-22c6-4afe-9764-080f51bb3754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:00.806043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff0ff2-22c6-4afe-9764-080f51bb3754 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:00.806900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff0ff2-22c6-4afe-9764-080f51bb3754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:00.807783 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff0ff2-22c6-4afe-9764-080f51bb3754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:00.810607 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff0ff2-22c6-4afe-9764-080f51bb3754 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:00.837727 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 888/1775] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:17:00.853506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff0ff2-22c6-4afe-9764-080f51bb3754 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:00.854602 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 888/1776] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:00.855265 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff0ff2-22c6-4afe-9764-080f51bb3754 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:00.856035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fe118-77ff-49ee-a783-1af12ca109fc admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:00.860720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2b2fe118-77ff-49ee-a783-1af12ca109fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:00.879443 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fe118-77ff-49ee-a783-1af12ca109fc admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:00.882649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a2080-8440-4512-8721-8996eabf3339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:00.885298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a2080-8440-4512-8721-8996eabf3339 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:00.886718 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a2080-8440-4512-8721-8996eabf3339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:00.887334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa071f7-b024-4b7e-9829-9be596286716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:00.888557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a2080-8440-4512-8721-8996eabf3339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:00.889492 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a2080-8440-4512-8721-8996eabf3339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:00.889655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa071f7-b024-4b7e-9829-9be596286716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:00.899348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a2080-8440-4512-8721-8996eabf3339 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:00.904681 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa071f7-b024-4b7e-9829-9be596286716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:00.905949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa071f7-b024-4b7e-9829-9be596286716 admin admin] PATH_INFO: `/v3/projects/d87d30492a6e4f01aad6f65cbb4beae3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:00.910841 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa071f7-b024-4b7e-9829-9be596286716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d87d30492a6e4f01aad6f65cbb4beae3)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:00.915111 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa071f7-b024-4b7e-9829-9be596286716 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:00.980921 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-cfa071f7-b024-4b7e-9829-9be596286716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd87d30492a6e4f01aad6f65cbb4beae3', 'request_id': 'req-cfa071f7-b024-4b7e-9829-9be596286716'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:00.988639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 889/1777] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:00 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:00.993142 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-cfa071f7-b024-4b7e-9829-9be596286716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd87d30492a6e4f01aad6f65cbb4beae3', 'request_id': 'req-cfa071f7-b024-4b7e-9829-9be596286716'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:01.000401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a2080-8440-4512-8721-8996eabf3339 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:01.011781 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-cfa071f7-b024-4b7e-9829-9be596286716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd87d30492a6e4f01aad6f65cbb4beae3', 'request_id': 'req-cfa071f7-b024-4b7e-9829-9be596286716'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:01.046459 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-cfa071f7-b024-4b7e-9829-9be596286716 admin admin] The token cache is being invalidate because project d87d30492a6e4f01aad6f65cbb4beae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:01.048975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-cfa071f7-b024-4b7e-9829-9be596286716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:01.052150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-cfa071f7-b024-4b7e-9829-9be596286716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:01.057819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 889/1778] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:00 2022] DELETE /identity/v3/projects/d87d30492a6e4f01aad6f65cbb4beae3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:01.061659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa071f7-b024-4b7e-9829-9be596286716 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:01.064568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cfa071f7-b024-4b7e-9829-9be596286716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:01.174116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a2080-8440-4512-8721-8996eabf3339 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:01.183137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755b7b1-7646-44a0-a67f-eb5915067357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:01.183828 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755b7b1-7646-44a0-a67f-eb5915067357 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:01.184111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755b7b1-7646-44a0-a67f-eb5915067357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:01.184386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755b7b1-7646-44a0-a67f-eb5915067357 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:01.185208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755b7b1-7646-44a0-a67f-eb5915067357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:01.188394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755b7b1-7646-44a0-a67f-eb5915067357 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:01.246179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa071f7-b024-4b7e-9829-9be596286716 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:01.260655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 890/1779] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:00 2022] POST /identity/v3/projects => generated 385 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:01.260765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32291643-5dd5-44ae-be75-7e433aae0253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:01.261640 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32291643-5dd5-44ae-be75-7e433aae0253 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:01.262086 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32291643-5dd5-44ae-be75-7e433aae0253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:01.262376 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32291643-5dd5-44ae-be75-7e433aae0253 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:01.263152 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32291643-5dd5-44ae-be75-7e433aae0253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:01.263546 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a640f7-7617-452a-9623-7997e88b36ce None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:01.263841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a640f7-7617-452a-9623-7997e88b36ce None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:01.264121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a640f7-7617-452a-9623-7997e88b36ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:01.265302 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32291643-5dd5-44ae-be75-7e433aae0253 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:01.296200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 890/1780] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:01 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:01.297114 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32291643-5dd5-44ae-be75-7e433aae0253 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:01.299920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-32291643-5dd5-44ae-be75-7e433aae0253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:01.322388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32291643-5dd5-44ae-be75-7e433aae0253 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:01.348481 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-32a640f7-7617-452a-9623-7997e88b36ce None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:01.349766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-32a640f7-7617-452a-9623-7997e88b36ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:01.473721 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:01.529733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ff65d-481c-4f8d-a580-92ce6d1c58fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:01.535271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 891/1781] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:01.542282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ff65d-481c-4f8d-a580-92ce6d1c58fb admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:01.542282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ff65d-481c-4f8d-a580-92ce6d1c58fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:01.542282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ff65d-481c-4f8d-a580-92ce6d1c58fb admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:01.542282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ff65d-481c-4f8d-a580-92ce6d1c58fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:01.547168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a640f7-7617-452a-9623-7997e88b36ce None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:01.554265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ff65d-481c-4f8d-a580-92ce6d1c58fb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:01.576463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a640f7-7617-452a-9623-7997e88b36ce None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:01.605347 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50655b0-3cf8-49c0-a3b2-721b547bd302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:01.607135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50655b0-3cf8-49c0-a3b2-721b547bd302 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:01.607720 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50655b0-3cf8-49c0-a3b2-721b547bd302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:01.608223 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50655b0-3cf8-49c0-a3b2-721b547bd302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:01.609264 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50655b0-3cf8-49c0-a3b2-721b547bd302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:01.614517 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50655b0-3cf8-49c0-a3b2-721b547bd302 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:01.631208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=7 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:01.638745 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 891/1782] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:01 2022] POST /identity/v3/users => generated 293 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:01.641950 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db78eb-8b7c-4070-822b-682fb9b3e931 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:01.642290 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db78eb-8b7c-4070-822b-682fb9b3e931 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:01.646393 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db78eb-8b7c-4070-822b-682fb9b3e931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:01.669175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 892/1783] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:01.672130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50655b0-3cf8-49c0-a3b2-721b547bd302 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:01.712793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50655b0-3cf8-49c0-a3b2-721b547bd302 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:01.719765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-93db78eb-8b7c-4070-822b-682fb9b3e931 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:01.722980 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-93db78eb-8b7c-4070-822b-682fb9b3e931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:01.729906 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b559b-9357-4309-897a-b07c394cad55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:01.730926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b559b-9357-4309-897a-b07c394cad55 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:01.735554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b559b-9357-4309-897a-b07c394cad55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:01.736577 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b559b-9357-4309-897a-b07c394cad55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:01.743695 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b559b-9357-4309-897a-b07c394cad55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:01.747377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 892/1784] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:01.747913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b559b-9357-4309-897a-b07c394cad55 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:01.750248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db78eb-8b7c-4070-822b-682fb9b3e931 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:01.762736 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db78eb-8b7c-4070-822b-682fb9b3e931 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:01.780738 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161d642-7018-4d51-b086-6d9f9b973b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:01.783293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d642-7018-4d51-b086-6d9f9b973b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:01.784784 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d642-7018-4d51-b086-6d9f9b973b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:01.786300 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d642-7018-4d51-b086-6d9f9b973b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:01.788320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161d642-7018-4d51-b086-6d9f9b973b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:01.791761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161d642-7018-4d51-b086-6d9f9b973b25 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:01.803722 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 893/1785] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:01.805624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b559b-9357-4309-897a-b07c394cad55 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:01.835813 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 893/1786] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:01.836553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161d642-7018-4d51-b086-6d9f9b973b25 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:01.842335 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b559b-9357-4309-897a-b07c394cad55 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:01.860283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30546d-b15d-4c43-8e0d-a01a893116d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:01.864140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30546d-b15d-4c43-8e0d-a01a893116d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:01.865337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30546d-b15d-4c43-8e0d-a01a893116d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:01.878661 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30546d-b15d-4c43-8e0d-a01a893116d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:01.887827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30546d-b15d-4c43-8e0d-a01a893116d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:01.889319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30546d-b15d-4c43-8e0d-a01a893116d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:01.891968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161d642-7018-4d51-b086-6d9f9b973b25 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:01.896319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30546d-b15d-4c43-8e0d-a01a893116d2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:01.911880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed0c37-71b5-456a-aa3d-88116787a4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:01.914922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed0c37-71b5-456a-aa3d-88116787a4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:01.915208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed0c37-71b5-456a-aa3d-88116787a4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:01.915497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed0c37-71b5-456a-aa3d-88116787a4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:01.919537 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed0c37-71b5-456a-aa3d-88116787a4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:01.929845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed0c37-71b5-456a-aa3d-88116787a4c1 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:01.940039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 894/1787] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:01.941259 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30546d-b15d-4c43-8e0d-a01a893116d2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:01.958651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30546d-b15d-4c43-8e0d-a01a893116d2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:01.969254 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205884-9c2d-4b87-b807-127f4e70f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:01.972949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205884-9c2d-4b87-b807-127f4e70f548 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:01.973801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205884-9c2d-4b87-b807-127f4e70f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:01.974534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205884-9c2d-4b87-b807-127f4e70f548 admin admin] PATH_INFO: `/v3/projects/e14e311da0904b33b3fc416b5e1f5255/users/57e60d484f5749fa99df21db5f29bb3c/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:01.991798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 894/1788] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:01.993700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed0c37-71b5-456a-aa3d-88116787a4c1 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:02.017616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c205884-9c2d-4b87-b807-127f4e70f548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14e311da0904b33b3fc416b5e1f5255, user_id=57e60d484f5749fa99df21db5f29bb3c, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:02.021949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed0c37-71b5-456a-aa3d-88116787a4c1 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:02.026729 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c205884-9c2d-4b87-b807-127f4e70f548 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:02.043999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5de2d-d0ad-4c43-b7e1-095d6dd65521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:02.044837 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5de2d-d0ad-4c43-b7e1-095d6dd65521 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:02.045375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5de2d-d0ad-4c43-b7e1-095d6dd65521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:02.045788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5de2d-d0ad-4c43-b7e1-095d6dd65521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:02.047427 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5de2d-d0ad-4c43-b7e1-095d6dd65521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:02.050054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5de2d-d0ad-4c43-b7e1-095d6dd65521 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:02.062543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 895/1789] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:01 2022] PUT /identity/v3/projects/e14e311da0904b33b3fc416b5e1f5255/users/57e60d484f5749fa99df21db5f29bb3c/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:02.065250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205884-9c2d-4b87-b807-127f4e70f548 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:02.121104 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 895/1790] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:01 2022] POST /identity/v3/projects => generated 393 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:02.125628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea851a0-a125-4caf-ad1a-ab3eac58297e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:02.126032 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea851a0-a125-4caf-ad1a-ab3eac58297e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:02.126532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea851a0-a125-4caf-ad1a-ab3eac58297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:02.292467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-4ea851a0-a125-4caf-ad1a-ab3eac58297e None None] MFA Rules not processed for user `57e60d484f5749fa99df21db5f29bb3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:02.304977 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4ea851a0-a125-4caf-ad1a-ab3eac58297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:02.364083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205884-9c2d-4b87-b807-127f4e70f548 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:02.461780 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db9f1a-cae4-4722-8299-683e05750876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:02.465613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db9f1a-cae4-4722-8299-683e05750876 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:02.466447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db9f1a-cae4-4722-8299-683e05750876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:02.466938 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db9f1a-cae4-4722-8299-683e05750876 admin admin] PATH_INFO: `/v3/projects/d412fc554ccb45b7a4e7283feff7e743/users/54bd589d820b4eff80b90bb97801a3e7/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:02.486513 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db9f1a-cae4-4722-8299-683e05750876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d412fc554ccb45b7a4e7283feff7e743, user_id=54bd589d820b4eff80b90bb97801a3e7, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:02.491577 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db9f1a-cae4-4722-8299-683e05750876 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:02.507323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 896/1791] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:02.508274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea851a0-a125-4caf-ad1a-ab3eac58297e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:02.509956 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 896/1792] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:02 2022] PUT /identity/v3/projects/d412fc554ccb45b7a4e7283feff7e743/users/54bd589d820b4eff80b90bb97801a3e7/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:02.511646 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db9f1a-cae4-4722-8299-683e05750876 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:02.547035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea851a0-a125-4caf-ad1a-ab3eac58297e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:02.554302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:02.682257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb8e3d-1c0d-4537-98ae-3e690cb9f498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:02.683507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb8e3d-1c0d-4537-98ae-3e690cb9f498 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:02.684015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb8e3d-1c0d-4537-98ae-3e690cb9f498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:02.684454 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb8e3d-1c0d-4537-98ae-3e690cb9f498 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:02.685911 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb8e3d-1c0d-4537-98ae-3e690cb9f498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:02.689588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb8e3d-1c0d-4537-98ae-3e690cb9f498 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:02.729858 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 897/1793] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:02 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:02.731519 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f76bff-88bd-4377-90f1-b50922f5fc47 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:02.731827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f76bff-88bd-4377-90f1-b50922f5fc47 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:02.732863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f76bff-88bd-4377-90f1-b50922f5fc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:02.767879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-49f76bff-88bd-4377-90f1-b50922f5fc47 None None] MFA Rules not processed for user `54bd589d820b4eff80b90bb97801a3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:02.769348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-49f76bff-88bd-4377-90f1-b50922f5fc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:02.770183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db9f1a-cae4-4722-8299-683e05750876 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:02.776853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ea5a7-3498-4276-ad99-46e2ac46ec9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:02.777491 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ea5a7-3498-4276-ad99-46e2ac46ec9c admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:02.777774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ea5a7-3498-4276-ad99-46e2ac46ec9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:02.778044 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ea5a7-3498-4276-ad99-46e2ac46ec9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:02.778815 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ea5a7-3498-4276-ad99-46e2ac46ec9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:02.781244 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ea5a7-3498-4276-ad99-46e2ac46ec9c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:02.791318 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:02.816514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 897/1794] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:02 2022] POST /identity/v3/projects => generated 375 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:02.816514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ea5a7-3498-4276-ad99-46e2ac46ec9c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:02.818443 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f36ea5a7-3498-4276-ad99-46e2ac46ec9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:02.877225 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 898/1795] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:02.878099 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f76bff-88bd-4377-90f1-b50922f5fc47 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:02.891253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f76bff-88bd-4377-90f1-b50922f5fc47 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:02.917415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ea5a7-3498-4276-ad99-46e2ac46ec9c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:02.924260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5a546-ddd1-4d8a-a603-ee81a42b3cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:02.927543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5a546-ddd1-4d8a-a603-ee81a42b3cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:02.927838 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5a546-ddd1-4d8a-a603-ee81a42b3cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:02.928123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5a546-ddd1-4d8a-a603-ee81a42b3cd8 admin admin] PATH_INFO: `/v3/users/2b57208803a24a13b5d4bbd8fe8e0607` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:02.929742 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5a546-ddd1-4d8a-a603-ee81a42b3cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b57208803a24a13b5d4bbd8fe8e0607)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:02.931956 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5a546-ddd1-4d8a-a603-ee81a42b3cd8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:02.970727 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356c8d7-7dc5-4004-8619-d73113352ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:02.971819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356c8d7-7dc5-4004-8619-d73113352ded admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:02.972163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356c8d7-7dc5-4004-8619-d73113352ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:02.972956 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356c8d7-7dc5-4004-8619-d73113352ded admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:02.973807 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356c8d7-7dc5-4004-8619-d73113352ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:02.975958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356c8d7-7dc5-4004-8619-d73113352ded admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:02.988421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 899/1796] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:02.989914 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356c8d7-7dc5-4004-8619-d73113352ded admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:02.998908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cbb5a546-ddd1-4d8a-a603-ee81a42b3cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b57208803a24a13b5d4bbd8fe8e0607'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:03.000288 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cbb5a546-ddd1-4d8a-a603-ee81a42b3cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b57208803a24a13b5d4bbd8fe8e0607'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:03.003576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356c8d7-7dc5-4004-8619-d73113352ded admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:03.010012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3475b33-e57b-4885-9946-c0cddaa8d701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:03.010868 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3475b33-e57b-4885-9946-c0cddaa8d701 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:03.011252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3475b33-e57b-4885-9946-c0cddaa8d701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:03.011626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3475b33-e57b-4885-9946-c0cddaa8d701 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:03.012442 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3475b33-e57b-4885-9946-c0cddaa8d701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:03.014561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3475b33-e57b-4885-9946-c0cddaa8d701 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:03.018176 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cbb5a546-ddd1-4d8a-a603-ee81a42b3cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b57208803a24a13b5d4bbd8fe8e0607'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:03.019769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cbb5a546-ddd1-4d8a-a603-ee81a42b3cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b57208803a24a13b5d4bbd8fe8e0607'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:03.029145 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cbb5a546-ddd1-4d8a-a603-ee81a42b3cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b57208803a24a13b5d4bbd8fe8e0607'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:03.041634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 900/1797] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:02 2022] POST /identity/v3/users => generated 294 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:03.042954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3475b33-e57b-4885-9946-c0cddaa8d701 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:03.045761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a3475b33-e57b-4885-9946-c0cddaa8d701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:03.045890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 898/1798] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:02 2022] DELETE /identity/v3/users/2b57208803a24a13b5d4bbd8fe8e0607 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:03.047169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5a546-ddd1-4d8a-a603-ee81a42b3cd8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:03.051208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cbb5a546-ddd1-4d8a-a603-ee81a42b3cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:03.065976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3475b33-e57b-4885-9946-c0cddaa8d701 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:03.080943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:03.137085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5a546-ddd1-4d8a-a603-ee81a42b3cd8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:03.143202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe3973-89f7-4f6e-ae83-8cdcd657f15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:03.144668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3973-89f7-4f6e-ae83-8cdcd657f15b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:03.145113 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3973-89f7-4f6e-ae83-8cdcd657f15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:03.145711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3973-89f7-4f6e-ae83-8cdcd657f15b admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:03.146824 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe3973-89f7-4f6e-ae83-8cdcd657f15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:03.148958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe3973-89f7-4f6e-ae83-8cdcd657f15b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:03.154157 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5b3e4-3a10-4afb-9a1d-29d9ed68691d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:03.154953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5b3e4-3a10-4afb-9a1d-29d9ed68691d admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:03.155161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5b3e4-3a10-4afb-9a1d-29d9ed68691d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:03.155533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5b3e4-3a10-4afb-9a1d-29d9ed68691d admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:03.156495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5b3e4-3a10-4afb-9a1d-29d9ed68691d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:03.159394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5b3e4-3a10-4afb-9a1d-29d9ed68691d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:03.162335 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 899/1799] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:03.163275 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe3973-89f7-4f6e-ae83-8cdcd657f15b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:03.165061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cefe3973-89f7-4f6e-ae83-8cdcd657f15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:03.182734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe3973-89f7-4f6e-ae83-8cdcd657f15b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:03.189680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002fed7-dd8f-481b-97be-fb29614e3084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:03.190378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002fed7-dd8f-481b-97be-fb29614e3084 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:03.190733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002fed7-dd8f-481b-97be-fb29614e3084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:03.191075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002fed7-dd8f-481b-97be-fb29614e3084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:03.192482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002fed7-dd8f-481b-97be-fb29614e3084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:03.194256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002fed7-dd8f-481b-97be-fb29614e3084 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:03.197235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 901/1800] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:03 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:03.198770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e6344-0549-4bbc-86d7-93ac70935b4d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:03.199156 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e6344-0549-4bbc-86d7-93ac70935b4d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:03.199529 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e6344-0549-4bbc-86d7-93ac70935b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:03.213616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 900/1801] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:03.213616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002fed7-dd8f-481b-97be-fb29614e3084 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:03.220396 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2d5e6344-0549-4bbc-86d7-93ac70935b4d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:03.221711 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2d5e6344-0549-4bbc-86d7-93ac70935b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:03.227124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002fed7-dd8f-481b-97be-fb29614e3084 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:03.243208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:03.312687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 902/1802] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:03.313974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e6344-0549-4bbc-86d7-93ac70935b4d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:03.325865 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e6344-0549-4bbc-86d7-93ac70935b4d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:03.333620 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fafcc-d197-442b-ac02-e6dce63c2e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:03.333811 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9dcc0c-e600-4cbe-8a00-ced6456835bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:03.333925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fafcc-d197-442b-ac02-e6dce63c2e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:03.334162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dcc0c-e600-4cbe-8a00-ced6456835bf admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:03.334267 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fafcc-d197-442b-ac02-e6dce63c2e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:03.334352 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dcc0c-e600-4cbe-8a00-ced6456835bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:03.334769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fafcc-d197-442b-ac02-e6dce63c2e6a admin admin] PATH_INFO: `/v3/projects/bc7faa1606a84cf19597243af92d5877/users/1a08c6874bc34600993b452406986abc/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:03.334892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dcc0c-e600-4cbe-8a00-ced6456835bf admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:03.335711 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9dcc0c-e600-4cbe-8a00-ced6456835bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:03.337917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9dcc0c-e600-4cbe-8a00-ced6456835bf admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:03.402336 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fafcc-d197-442b-ac02-e6dce63c2e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7faa1606a84cf19597243af92d5877, user_id=1a08c6874bc34600993b452406986abc, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:03.410097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fafcc-d197-442b-ac02-e6dce63c2e6a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:03.412687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 903/1803] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:03 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:03.416256 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9dcc0c-e600-4cbe-8a00-ced6456835bf admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:03.444543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 901/1804] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:03 2022] PUT /identity/v3/projects/bc7faa1606a84cf19597243af92d5877/users/1a08c6874bc34600993b452406986abc/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:03.446909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fafcc-d197-442b-ac02-e6dce63c2e6a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:03.451939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9dcc0c-e600-4cbe-8a00-ced6456835bf admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:03.464775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dc9fafcc-d197-442b-ac02-e6dce63c2e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:03.599756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fafcc-d197-442b-ac02-e6dce63c2e6a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:03.603568 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5617cb-1667-4518-ac7e-5f4115250833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:03.604359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5617cb-1667-4518-ac7e-5f4115250833 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:03.604652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5617cb-1667-4518-ac7e-5f4115250833 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:03.604931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5617cb-1667-4518-ac7e-5f4115250833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:03.622318 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e111e0-5f17-4241-97f0-049c1cd18d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:03.623788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e111e0-5f17-4241-97f0-049c1cd18d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:03.624291 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e111e0-5f17-4241-97f0-049c1cd18d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:03.624764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e111e0-5f17-4241-97f0-049c1cd18d22 admin admin] PATH_INFO: `/v3/projects/a6e47cae02ed4a32902f8bc67192939f/users/5025320260cb4f85b9a8fb8ce6125ecc/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:03.661392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e111e0-5f17-4241-97f0-049c1cd18d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e47cae02ed4a32902f8bc67192939f, user_id=5025320260cb4f85b9a8fb8ce6125ecc, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:03.665302 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e111e0-5f17-4241-97f0-049c1cd18d22 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:03.683328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 904/1805] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:03 2022] PUT /identity/v3/projects/a6e47cae02ed4a32902f8bc67192939f/users/5025320260cb4f85b9a8fb8ce6125ecc/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:03.684395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e111e0-5f17-4241-97f0-049c1cd18d22 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:03.695057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:03.750183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5617cb-1667-4518-ac7e-5f4115250833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:03.752227 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5617cb-1667-4518-ac7e-5f4115250833 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:03.775841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 902/1806] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:03.780236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3fc56-5667-4a02-b668-4c9b058b21d7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:03.781216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3fc56-5667-4a02-b668-4c9b058b21d7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:03.781681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3fc56-5667-4a02-b668-4c9b058b21d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:03.824100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e111e0-5f17-4241-97f0-049c1cd18d22 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:03.836333 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d5f56-1585-4d95-98f3-9b052cbc5d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:03.837221 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d5f56-1585-4d95-98f3-9b052cbc5d39 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:03.838065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d5f56-1585-4d95-98f3-9b052cbc5d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:03.838065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d5f56-1585-4d95-98f3-9b052cbc5d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:03.839046 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d5f56-1585-4d95-98f3-9b052cbc5d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:03.841723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d5f56-1585-4d95-98f3-9b052cbc5d39 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:03.862523 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 905/1807] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:03.863489 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d5f56-1585-4d95-98f3-9b052cbc5d39 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:03.874591 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f1e3fc56-5667-4a02-b668-4c9b058b21d7 None None] MFA Rules not processed for user `1a08c6874bc34600993b452406986abc`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:03.875750 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f1e3fc56-5667-4a02-b668-4c9b058b21d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:03.897616 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d5f56-1585-4d95-98f3-9b052cbc5d39 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:03.917881 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c12a3-22e9-4f3b-80cd-6e2eae6ee86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:03.918694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c12a3-22e9-4f3b-80cd-6e2eae6ee86e admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:03.922256 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c12a3-22e9-4f3b-80cd-6e2eae6ee86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:03.923209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c12a3-22e9-4f3b-80cd-6e2eae6ee86e admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:03.924254 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c12a3-22e9-4f3b-80cd-6e2eae6ee86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:03.928840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c12a3-22e9-4f3b-80cd-6e2eae6ee86e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:03.953907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 906/1808] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:03.955251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c12a3-22e9-4f3b-80cd-6e2eae6ee86e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:03.989900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c12a3-22e9-4f3b-80cd-6e2eae6ee86e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:04.009025 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57167933-5db3-4ed6-b1aa-4428ce14ccb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:04.011095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57167933-5db3-4ed6-b1aa-4428ce14ccb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:04.012399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57167933-5db3-4ed6-b1aa-4428ce14ccb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:04.012399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57167933-5db3-4ed6-b1aa-4428ce14ccb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:04.014105 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57167933-5db3-4ed6-b1aa-4428ce14ccb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:04.017757 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57167933-5db3-4ed6-b1aa-4428ce14ccb9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:04.049394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 903/1809] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:04.051438 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3fc56-5667-4a02-b668-4c9b058b21d7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:04.056501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 907/1810] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:04.057750 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57167933-5db3-4ed6-b1aa-4428ce14ccb9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:04.073544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3fc56-5667-4a02-b668-4c9b058b21d7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:04.083155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:04.086003 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d52db0-df3d-4c7d-a92e-2b17e23b5c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:04.086949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d52db0-df3d-4c7d-a92e-2b17e23b5c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:04.087238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d52db0-df3d-4c7d-a92e-2b17e23b5c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:04.087514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d52db0-df3d-4c7d-a92e-2b17e23b5c41 admin admin] PATH_INFO: `/v3/projects/a6e47cae02ed4a32902f8bc67192939f/users/5025320260cb4f85b9a8fb8ce6125ecc/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:04.089696 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d52db0-df3d-4c7d-a92e-2b17e23b5c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e47cae02ed4a32902f8bc67192939f, user_id=5025320260cb4f85b9a8fb8ce6125ecc, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:04.092428 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d52db0-df3d-4c7d-a92e-2b17e23b5c41 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:04.098545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57167933-5db3-4ed6-b1aa-4428ce14ccb9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:04.108730 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659727ec-8792-4ef8-8a66-775850cc2c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:04.109422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659727ec-8792-4ef8-8a66-775850cc2c98 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:04.109716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659727ec-8792-4ef8-8a66-775850cc2c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:04.109998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659727ec-8792-4ef8-8a66-775850cc2c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:04.110746 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659727ec-8792-4ef8-8a66-775850cc2c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:04.112755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659727ec-8792-4ef8-8a66-775850cc2c98 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:04.118837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 904/1811] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:04 2022] PUT /identity/v3/projects/a6e47cae02ed4a32902f8bc67192939f/users/5025320260cb4f85b9a8fb8ce6125ecc/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:04.119757 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d52db0-df3d-4c7d-a92e-2b17e23b5c41 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:04.226101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 908/1812] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:04 2022] POST /identity/v3/projects => generated 393 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:04.228057 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b84829-bce6-46ab-9755-538fef57aae5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:04.228373 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b84829-bce6-46ab-9755-538fef57aae5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:04.228660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b84829-bce6-46ab-9755-538fef57aae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:04.273174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-07b84829-bce6-46ab-9755-538fef57aae5 None None] MFA Rules not processed for user `5025320260cb4f85b9a8fb8ce6125ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:04.274619 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-07b84829-bce6-46ab-9755-538fef57aae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:04.276018 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d52db0-df3d-4c7d-a92e-2b17e23b5c41 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:04.389637 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 909/1813] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:04.390600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b84829-bce6-46ab-9755-538fef57aae5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:04.441659 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03af577-1db3-4c0b-870f-f2aa3a1a72dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:04.443342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03af577-1db3-4c0b-870f-f2aa3a1a72dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:04.443783 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03af577-1db3-4c0b-870f-f2aa3a1a72dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:04.444334 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03af577-1db3-4c0b-870f-f2aa3a1a72dd admin admin] PATH_INFO: `/v3/projects/bad1a1fec9a34735b8b03bcc07baf1cd/users/54bf269d70bf4973aac1379e5a2b3700/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:04.459950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:04.472964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03af577-1db3-4c0b-870f-f2aa3a1a72dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad1a1fec9a34735b8b03bcc07baf1cd, user_id=54bf269d70bf4973aac1379e5a2b3700, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:04.476837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03af577-1db3-4c0b-870f-f2aa3a1a72dd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:04.490287 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b84829-bce6-46ab-9755-538fef57aae5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:04.497053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 905/1814] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:04 2022] PUT /identity/v3/projects/bad1a1fec9a34735b8b03bcc07baf1cd/users/54bf269d70bf4973aac1379e5a2b3700/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:04.497053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03af577-1db3-4c0b-870f-f2aa3a1a72dd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:04.498945 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c03af577-1db3-4c0b-870f-f2aa3a1a72dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:04.605717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204090db-7c5a-4c66-9851-6c543e1665f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:04.607200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204090db-7c5a-4c66-9851-6c543e1665f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:04.607423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204090db-7c5a-4c66-9851-6c543e1665f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:04.607713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204090db-7c5a-4c66-9851-6c543e1665f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:04.608659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204090db-7c5a-4c66-9851-6c543e1665f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:04.610735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204090db-7c5a-4c66-9851-6c543e1665f8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:04.618686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03af577-1db3-4c0b-870f-f2aa3a1a72dd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:04.624347 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab05e1c-1103-4987-ad6e-7f963fab9076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:04.625125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab05e1c-1103-4987-ad6e-7f963fab9076 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:04.625503 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab05e1c-1103-4987-ad6e-7f963fab9076 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:04.625889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab05e1c-1103-4987-ad6e-7f963fab9076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:04.627973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bab05e1c-1103-4987-ad6e-7f963fab9076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:04.634831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 910/1815] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:04 2022] POST /identity/v3/users => generated 303 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:04.636395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b791b-05a4-49af-b673-89a6e1207808 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:04.636849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b791b-05a4-49af-b673-89a6e1207808 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:04.637268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b791b-05a4-49af-b673-89a6e1207808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:04.643670 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:04.672696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5a6b791b-05a4-49af-b673-89a6e1207808 None None] MFA Rules not processed for user `54bf269d70bf4973aac1379e5a2b3700`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:04.674111 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5a6b791b-05a4-49af-b673-89a6e1207808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:04.697260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab05e1c-1103-4987-ad6e-7f963fab9076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:04.698746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab05e1c-1103-4987-ad6e-7f963fab9076 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:04.709179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 906/1816] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:04.710118 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab05e1c-1103-4987-ad6e-7f963fab9076 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:04.711587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bab05e1c-1103-4987-ad6e-7f963fab9076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:04.726558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab05e1c-1103-4987-ad6e-7f963fab9076 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:04.731368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:04.732243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:04.732519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:04.732797 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646 admin admin] PATH_INFO: `/v3/projects/b8fe724248b44a56ba4bb616ccf7947c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:04.734002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8fe724248b44a56ba4bb616ccf7947c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:04.735989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:04.763471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 911/1817] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:04.764446 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b791b-05a4-49af-b673-89a6e1207808 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:04.780782 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b791b-05a4-49af-b673-89a6e1207808 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:04.787187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef3f93-fed8-4a89-a088-947e56fd0cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:04.788250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3f93-fed8-4a89-a088-947e56fd0cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:04.788250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3f93-fed8-4a89-a088-947e56fd0cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:04.788616 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3f93-fed8-4a89-a088-947e56fd0cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:04.789329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef3f93-fed8-4a89-a088-947e56fd0cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:04.791277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef3f93-fed8-4a89-a088-947e56fd0cd6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:04.806633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 912/1818] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:04.807556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef3f93-fed8-4a89-a088-947e56fd0cd6 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:04.809943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8fe724248b44a56ba4bb616ccf7947c', 'request_id': 'req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:04.816879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8fe724248b44a56ba4bb616ccf7947c', 'request_id': 'req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:04.825345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef3f93-fed8-4a89-a088-947e56fd0cd6 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:04.829129 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8fe724248b44a56ba4bb616ccf7947c', 'request_id': 'req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:04.845807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646 admin admin] The token cache is being invalidate because project b8fe724248b44a56ba4bb616ccf7947c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:04.846104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:04.847726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:04.849411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 907/1819] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:04 2022] DELETE /identity/v3/projects/b8fe724248b44a56ba4bb616ccf7947c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:04.852863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:04.854236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:04.960401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:05.074137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb4c99-12e0-47a7-875c-030a9b32f8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:05.075247 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2f2fb-3e18-4aab-85b1-4e49adc8d646 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:05.075460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb4c99-12e0-47a7-875c-030a9b32f8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:05.075748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb4c99-12e0-47a7-875c-030a9b32f8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:05.076073 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb4c99-12e0-47a7-875c-030a9b32f8f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:05.076772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb4c99-12e0-47a7-875c-030a9b32f8f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:05.079590 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb4c99-12e0-47a7-875c-030a9b32f8f0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:05.086312 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7d866-8dc0-4a21-9d05-7c0cacccefb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:05.087809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7d866-8dc0-4a21-9d05-7c0cacccefb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:05.088479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7d866-8dc0-4a21-9d05-7c0cacccefb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:05.089136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7d866-8dc0-4a21-9d05-7c0cacccefb9 admin admin] PATH_INFO: `/v3/projects/1615afab772943169ca178ae6bd29ace/users/4e569ddba82e4f7ead647c1b6e3c3dc1/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:05.126140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7d866-8dc0-4a21-9d05-7c0cacccefb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1615afab772943169ca178ae6bd29ace, user_id=4e569ddba82e4f7ead647c1b6e3c3dc1, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:05.127330 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 913/1820] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:04 2022] POST /identity/v3/projects => generated 385 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:05.129710 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55850a8-6e9c-4c40-af1e-59f99598c176 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:05.129910 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55850a8-6e9c-4c40-af1e-59f99598c176 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:05.130183 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55850a8-6e9c-4c40-af1e-59f99598c176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:05.131085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7d866-8dc0-4a21-9d05-7c0cacccefb9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:05.155910 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e55850a8-6e9c-4c40-af1e-59f99598c176 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:05.157424 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e55850a8-6e9c-4c40-af1e-59f99598c176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:05.159025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 908/1821] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:04 2022] PUT /identity/v3/projects/1615afab772943169ca178ae6bd29ace/users/4e569ddba82e4f7ead647c1b6e3c3dc1/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:05.160730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7d866-8dc0-4a21-9d05-7c0cacccefb9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:05.162625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-75f7d866-8dc0-4a21-9d05-7c0cacccefb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:05.278616 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 914/1822] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:05.278616 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55850a8-6e9c-4c40-af1e-59f99598c176 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:05.294280 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7d866-8dc0-4a21-9d05-7c0cacccefb9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:05.297281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55850a8-6e9c-4c40-af1e-59f99598c176 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:05.299292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9332a-1658-412d-a150-4a9fd9eb21f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:05.300428 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9332a-1658-412d-a150-4a9fd9eb21f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:05.300899 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9332a-1658-412d-a150-4a9fd9eb21f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:05.301709 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9332a-1658-412d-a150-4a9fd9eb21f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:05.302250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9332a-1658-412d-a150-4a9fd9eb21f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:05.304518 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9332a-1658-412d-a150-4a9fd9eb21f3 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:05.320953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6aca1-c787-40d3-8da8-fe79438838e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:05.322132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6aca1-c787-40d3-8da8-fe79438838e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:05.322449 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6aca1-c787-40d3-8da8-fe79438838e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:05.322815 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6aca1-c787-40d3-8da8-fe79438838e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:05.323574 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6aca1-c787-40d3-8da8-fe79438838e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:05.325380 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6aca1-c787-40d3-8da8-fe79438838e6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:05.327067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:05.361188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 915/1823] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:05.361341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 909/1824] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:05 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:05.361341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9332a-1658-412d-a150-4a9fd9eb21f3 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:05.361489 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef9223-6b9c-43c7-a4c7-db83716ae860 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:05.361489 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef9223-6b9c-43c7-a4c7-db83716ae860 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:05.361489 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef9223-6b9c-43c7-a4c7-db83716ae860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:05.391831 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9332a-1658-412d-a150-4a9fd9eb21f3 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:05.399944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-99ef9223-6b9c-43c7-a4c7-db83716ae860 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:05.401194 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-99ef9223-6b9c-43c7-a4c7-db83716ae860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:05.412927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b7e64-22ce-49c2-916a-cb2eff82384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:05.414569 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b7e64-22ce-49c2-916a-cb2eff82384d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:05.417346 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b7e64-22ce-49c2-916a-cb2eff82384d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:05.417767 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b7e64-22ce-49c2-916a-cb2eff82384d admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:05.420804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b7e64-22ce-49c2-916a-cb2eff82384d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:05.422655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 916/1825] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:05.423889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef9223-6b9c-43c7-a4c7-db83716ae860 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:05.437330 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef9223-6b9c-43c7-a4c7-db83716ae860 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:05.443178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0158f8-d095-48b5-94fd-1f3a71fd90b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:05.444089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0158f8-d095-48b5-94fd-1f3a71fd90b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:05.444375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0158f8-d095-48b5-94fd-1f3a71fd90b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:05.444657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0158f8-d095-48b5-94fd-1f3a71fd90b4 admin admin] PATH_INFO: `/v3/projects/1615afab772943169ca178ae6bd29ace/users/4e569ddba82e4f7ead647c1b6e3c3dc1/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:05.446765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0158f8-d095-48b5-94fd-1f3a71fd90b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1615afab772943169ca178ae6bd29ace, user_id=4e569ddba82e4f7ead647c1b6e3c3dc1, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:05.450464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b7e64-22ce-49c2-916a-cb2eff82384d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:05.450597 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0158f8-d095-48b5-94fd-1f3a71fd90b4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:05.468896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 917/1826] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:05 2022] PUT /identity/v3/projects/1615afab772943169ca178ae6bd29ace/users/4e569ddba82e4f7ead647c1b6e3c3dc1/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:05.471212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0158f8-d095-48b5-94fd-1f3a71fd90b4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:05.496959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 910/1827] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:05.508774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414b951-ca4e-4dd5-b5a2-90a4e08b4003 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:05.511798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414b951-ca4e-4dd5-b5a2-90a4e08b4003 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:05.513996 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414b951-ca4e-4dd5-b5a2-90a4e08b4003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:05.562528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0158f8-d095-48b5-94fd-1f3a71fd90b4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:05.571737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e71e8-7bc6-47b6-802c-d8835ba7336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:05.572840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e71e8-7bc6-47b6-802c-d8835ba7336d admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:05.572840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e71e8-7bc6-47b6-802c-d8835ba7336d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:05.573031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e71e8-7bc6-47b6-802c-d8835ba7336d admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:05.573873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e71e8-7bc6-47b6-802c-d8835ba7336d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:05.574316 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e71e8-7bc6-47b6-802c-d8835ba7336d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:05.576291 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e71e8-7bc6-47b6-802c-d8835ba7336d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:05.594712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 918/1828] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:05.596375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e71e8-7bc6-47b6-802c-d8835ba7336d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:05.616423 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0414b951-ca4e-4dd5-b5a2-90a4e08b4003 None None] MFA Rules not processed for user `4e569ddba82e4f7ead647c1b6e3c3dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:05.619979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0414b951-ca4e-4dd5-b5a2-90a4e08b4003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:05.624094 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e71e8-7bc6-47b6-802c-d8835ba7336d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:05.639377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc451d-bfaf-4eee-8254-fd1a500672eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:05.641604 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc451d-bfaf-4eee-8254-fd1a500672eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:05.642776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc451d-bfaf-4eee-8254-fd1a500672eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:05.646023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc451d-bfaf-4eee-8254-fd1a500672eb admin admin] PATH_INFO: `/v3/projects/b4e2f08bf3734f55b2ea0d020684cfc9/users/2f9baa38402a43228ba41e3bd589aa3e/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:05.683226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc451d-bfaf-4eee-8254-fd1a500672eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e2f08bf3734f55b2ea0d020684cfc9, user_id=2f9baa38402a43228ba41e3bd589aa3e, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:05.686009 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc451d-bfaf-4eee-8254-fd1a500672eb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:05.742910 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 919/1829] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:05 2022] PUT /identity/v3/projects/b4e2f08bf3734f55b2ea0d020684cfc9/users/2f9baa38402a43228ba41e3bd589aa3e/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:05.746671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc451d-bfaf-4eee-8254-fd1a500672eb admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:05.815456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 911/1830] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:05.819969 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414b951-ca4e-4dd5-b5a2-90a4e08b4003 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:05.832833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414b951-ca4e-4dd5-b5a2-90a4e08b4003 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:05.844809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:05.863973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc451d-bfaf-4eee-8254-fd1a500672eb admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:05.869623 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13704319-36a2-4504-839e-71c0a5665dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:05.870385 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13704319-36a2-4504-839e-71c0a5665dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:05.870781 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13704319-36a2-4504-839e-71c0a5665dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:05.871139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13704319-36a2-4504-839e-71c0a5665dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:05.871931 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13704319-36a2-4504-839e-71c0a5665dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:05.874033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13704319-36a2-4504-839e-71c0a5665dfd admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:05.910523 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 920/1831] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:05 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:05.911953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13704319-36a2-4504-839e-71c0a5665dfd admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:05.916528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-13704319-36a2-4504-839e-71c0a5665dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:05.922151 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b413d-f014-46d5-a54e-d3d7ecfa7f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:05.922967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b413d-f014-46d5-a54e-d3d7ecfa7f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:05.923252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b413d-f014-46d5-a54e-d3d7ecfa7f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:05.923533 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b413d-f014-46d5-a54e-d3d7ecfa7f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:05.924275 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b413d-f014-46d5-a54e-d3d7ecfa7f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:05.927709 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b413d-f014-46d5-a54e-d3d7ecfa7f39 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:05.939955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 912/1832] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:05.940847 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b413d-f014-46d5-a54e-d3d7ecfa7f39 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:05.953768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b413d-f014-46d5-a54e-d3d7ecfa7f39 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:05.965136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:06.009062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13704319-36a2-4504-839e-71c0a5665dfd admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:06.012987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb48ec3-e3e6-4100-ab2e-88f3a6f72ee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:06.013792 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb48ec3-e3e6-4100-ab2e-88f3a6f72ee3 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:06.014079 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb48ec3-e3e6-4100-ab2e-88f3a6f72ee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:06.014390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb48ec3-e3e6-4100-ab2e-88f3a6f72ee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:06.035788 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c4e0f-cb16-4133-bf09-65746654d9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:06.036560 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c4e0f-cb16-4133-bf09-65746654d9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:06.036825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c4e0f-cb16-4133-bf09-65746654d9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:06.037110 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c4e0f-cb16-4133-bf09-65746654d9c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:06.037817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c4e0f-cb16-4133-bf09-65746654d9c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:06.040114 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c4e0f-cb16-4133-bf09-65746654d9c5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:06.068310 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 913/1833] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:05 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:06.070380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c4e0f-cb16-4133-bf09-65746654d9c5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:06.086242 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c4e0f-cb16-4133-bf09-65746654d9c5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:06.092647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889964df-b7db-4863-b66e-904ccf3065e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:06.094211 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889964df-b7db-4863-b66e-904ccf3065e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:06.094912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889964df-b7db-4863-b66e-904ccf3065e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:06.095437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889964df-b7db-4863-b66e-904ccf3065e8 admin admin] PATH_INFO: `/v3/projects/b4e2f08bf3734f55b2ea0d020684cfc9/users/2f9baa38402a43228ba41e3bd589aa3e/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:06.100900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889964df-b7db-4863-b66e-904ccf3065e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e2f08bf3734f55b2ea0d020684cfc9, user_id=2f9baa38402a43228ba41e3bd589aa3e, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:06.102724 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb48ec3-e3e6-4100-ab2e-88f3a6f72ee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:06.103755 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889964df-b7db-4863-b66e-904ccf3065e8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:06.105835 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb48ec3-e3e6-4100-ab2e-88f3a6f72ee3 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:06.116639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 914/1834] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:06 2022] PUT /identity/v3/projects/b4e2f08bf3734f55b2ea0d020684cfc9/users/2f9baa38402a43228ba41e3bd589aa3e/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:06.117469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889964df-b7db-4863-b66e-904ccf3065e8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:06.130001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 921/1835] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:06.132387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cd5a6-4a76-4d02-b595-60d73a00e7ac None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:06.132891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cd5a6-4a76-4d02-b595-60d73a00e7ac None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:06.133408 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cd5a6-4a76-4d02-b595-60d73a00e7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:06.170547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-4d0cd5a6-4a76-4d02-b595-60d73a00e7ac None None] MFA Rules not processed for user `2f9baa38402a43228ba41e3bd589aa3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:06.171824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4d0cd5a6-4a76-4d02-b595-60d73a00e7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:06.216758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889964df-b7db-4863-b66e-904ccf3065e8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:06.221993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1184b56-4b2f-46db-bf38-bcf59a42b4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:06.222764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1184b56-4b2f-46db-bf38-bcf59a42b4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:06.223051 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1184b56-4b2f-46db-bf38-bcf59a42b4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:06.223330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1184b56-4b2f-46db-bf38-bcf59a42b4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:06.224064 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1184b56-4b2f-46db-bf38-bcf59a42b4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:06.225848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1184b56-4b2f-46db-bf38-bcf59a42b4f8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:06.241870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 915/1836] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:06.241870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1184b56-4b2f-46db-bf38-bcf59a42b4f8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:06.243882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b1184b56-4b2f-46db-bf38-bcf59a42b4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:06.270039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 922/1837] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:06.271216 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cd5a6-4a76-4d02-b595-60d73a00e7ac None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:06.277309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:06.285721 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cd5a6-4a76-4d02-b595-60d73a00e7ac None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:06.290945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01204859-75b6-42fc-bf3c-b6b364e11829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:06.291815 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01204859-75b6-42fc-bf3c-b6b364e11829 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:06.292308 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01204859-75b6-42fc-bf3c-b6b364e11829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:06.292733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01204859-75b6-42fc-bf3c-b6b364e11829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:06.293633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01204859-75b6-42fc-bf3c-b6b364e11829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:06.295296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01204859-75b6-42fc-bf3c-b6b364e11829 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:06.306946 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 923/1838] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:06.310960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01204859-75b6-42fc-bf3c-b6b364e11829 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:06.322659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01204859-75b6-42fc-bf3c-b6b364e11829 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:06.322884 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1184b56-4b2f-46db-bf38-bcf59a42b4f8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:06.327014 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bc314-857e-46a0-bd4b-835ab19d1b9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:06.327654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658259b1-2ca0-49a9-a520-b6ba3660adf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:06.327831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bc314-857e-46a0-bd4b-835ab19d1b9f service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:06.328223 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bc314-857e-46a0-bd4b-835ab19d1b9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:06.328561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bc314-857e-46a0-bd4b-835ab19d1b9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:06.328980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658259b1-2ca0-49a9-a520-b6ba3660adf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:06.329497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658259b1-2ca0-49a9-a520-b6ba3660adf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:06.329946 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658259b1-2ca0-49a9-a520-b6ba3660adf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:06.332763 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-658259b1-2ca0-49a9-a520-b6ba3660adf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:06.339892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bc314-857e-46a0-bd4b-835ab19d1b9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:06.341449 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bc314-857e-46a0-bd4b-835ab19d1b9f service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:06.358572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 924/1839] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:06.359527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bc314-857e-46a0-bd4b-835ab19d1b9f service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:06.377620 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bc314-857e-46a0-bd4b-835ab19d1b9f service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:06.383383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea62079-dad6-4a18-8369-74768e3f0796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:06.384386 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea62079-dad6-4a18-8369-74768e3f0796 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:06.385339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea62079-dad6-4a18-8369-74768e3f0796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:06.385640 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea62079-dad6-4a18-8369-74768e3f0796 admin admin] PATH_INFO: `/v3/projects/026ac65a944345c7b7e0d1bb875348eb/users/d78a68a649804b14a8f6261a334d7371/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:06.406151 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea62079-dad6-4a18-8369-74768e3f0796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=026ac65a944345c7b7e0d1bb875348eb, user_id=d78a68a649804b14a8f6261a334d7371, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:06.414876 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea62079-dad6-4a18-8369-74768e3f0796 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:06.451019 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 925/1840] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:06 2022] PUT /identity/v3/projects/026ac65a944345c7b7e0d1bb875348eb/users/d78a68a649804b14a8f6261a334d7371/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:06.463747 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eff65d-d84c-4389-bc8e-8bad76ae525c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:06.464045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eff65d-d84c-4389-bc8e-8bad76ae525c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:06.464328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eff65d-d84c-4389-bc8e-8bad76ae525c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:06.490925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658259b1-2ca0-49a9-a520-b6ba3660adf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:06.493162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658259b1-2ca0-49a9-a520-b6ba3660adf3 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:06.511778 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-88eff65d-d84c-4389-bc8e-8bad76ae525c None None] MFA Rules not processed for user `d78a68a649804b14a8f6261a334d7371`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:06.513013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-88eff65d-d84c-4389-bc8e-8bad76ae525c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:06.513301 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 916/1841] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:06.519615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:06.638474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 926/1842] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:06.642947 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658259b1-2ca0-49a9-a520-b6ba3660adf3 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:06.654864 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658259b1-2ca0-49a9-a520-b6ba3660adf3 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:06.759811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea59de7-bd92-41a0-919a-2e8af1778153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:06.760803 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea59de7-bd92-41a0-919a-2e8af1778153 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:06.761265 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea59de7-bd92-41a0-919a-2e8af1778153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:06.761708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea59de7-bd92-41a0-919a-2e8af1778153 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:06.762577 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea59de7-bd92-41a0-919a-2e8af1778153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:06.765076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea59de7-bd92-41a0-919a-2e8af1778153 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:06.806053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 917/1843] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:06 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:06.809415 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eff65d-d84c-4389-bc8e-8bad76ae525c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:06.830479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eff65d-d84c-4389-bc8e-8bad76ae525c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:06.941338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed16b94-6f22-4c50-9898-b0ffb3649fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:06.943852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed16b94-6f22-4c50-9898-b0ffb3649fac admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:06.943852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed16b94-6f22-4c50-9898-b0ffb3649fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:06.943852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed16b94-6f22-4c50-9898-b0ffb3649fac admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:06.944867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed16b94-6f22-4c50-9898-b0ffb3649fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:06.952619 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed16b94-6f22-4c50-9898-b0ffb3649fac admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:06.994208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 927/1844] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:06 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:06.998402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea59de7-bd92-41a0-919a-2e8af1778153 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:07.017964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea59de7-bd92-41a0-919a-2e8af1778153 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:07.033648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00b001-831e-4916-a189-e0980d7a9a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:07.033648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00b001-831e-4916-a189-e0980d7a9a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:07.033648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00b001-831e-4916-a189-e0980d7a9a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:07.033648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00b001-831e-4916-a189-e0980d7a9a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:07.034041 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00b001-831e-4916-a189-e0980d7a9a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:07.038579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00b001-831e-4916-a189-e0980d7a9a7b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:07.054786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 918/1845] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:07.057231 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed16b94-6f22-4c50-9898-b0ffb3649fac admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:07.076364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed16b94-6f22-4c50-9898-b0ffb3649fac admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:07.082656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b460550-ee83-4c8c-b7fd-67a600ec99c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:07.083679 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b460550-ee83-4c8c-b7fd-67a600ec99c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:07.083971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b460550-ee83-4c8c-b7fd-67a600ec99c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:07.084255 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b460550-ee83-4c8c-b7fd-67a600ec99c4 admin admin] PATH_INFO: `/v3/projects/31260b3227784ef2b5db5e49bf5110a1/users/dc2a40f649e64dc8817eb05c86b0d85e/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:07.102844 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b460550-ee83-4c8c-b7fd-67a600ec99c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31260b3227784ef2b5db5e49bf5110a1, user_id=dc2a40f649e64dc8817eb05c86b0d85e, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:07.106709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b460550-ee83-4c8c-b7fd-67a600ec99c4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:07.122485 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 928/1846] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:07 2022] PUT /identity/v3/projects/31260b3227784ef2b5db5e49bf5110a1/users/dc2a40f649e64dc8817eb05c86b0d85e/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:07.126816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00b001-831e-4916-a189-e0980d7a9a7b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:07.138222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00b001-831e-4916-a189-e0980d7a9a7b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:07.190166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:07.206969 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f152b-1f42-417b-b4a5-2b35972d71a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:07.207735 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f152b-1f42-417b-b4a5-2b35972d71a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:07.208026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f152b-1f42-417b-b4a5-2b35972d71a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:07.208319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f152b-1f42-417b-b4a5-2b35972d71a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:07.209046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f152b-1f42-417b-b4a5-2b35972d71a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:07.211105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f152b-1f42-417b-b4a5-2b35972d71a6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:07.222653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 919/1847] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:07.227517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b460550-ee83-4c8c-b7fd-67a600ec99c4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:07.241497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b460550-ee83-4c8c-b7fd-67a600ec99c4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:07.247010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f78c83-a3d7-4f94-9fdc-3568794550ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:07.247923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f78c83-a3d7-4f94-9fdc-3568794550ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:07.250661 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f78c83-a3d7-4f94-9fdc-3568794550ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:07.251077 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f78c83-a3d7-4f94-9fdc-3568794550ff admin admin] PATH_INFO: `/v3/projects/31260b3227784ef2b5db5e49bf5110a1/users/dc2a40f649e64dc8817eb05c86b0d85e/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:07.255987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f78c83-a3d7-4f94-9fdc-3568794550ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=31260b3227784ef2b5db5e49bf5110a1, user_id=dc2a40f649e64dc8817eb05c86b0d85e, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:07.258992 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f78c83-a3d7-4f94-9fdc-3568794550ff admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:07.273867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 929/1848] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:07 2022] PUT /identity/v3/projects/31260b3227784ef2b5db5e49bf5110a1/users/dc2a40f649e64dc8817eb05c86b0d85e/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:07.284672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c970ad-b6d9-44c9-ad92-c901a3a7446e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:07.285784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c970ad-b6d9-44c9-ad92-c901a3a7446e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:07.285784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c970ad-b6d9-44c9-ad92-c901a3a7446e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:07.325166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b1c970ad-b6d9-44c9-ad92-c901a3a7446e None None] MFA Rules not processed for user `dc2a40f649e64dc8817eb05c86b0d85e`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:07.326780 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b1c970ad-b6d9-44c9-ad92-c901a3a7446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:07.440739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 920/1849] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:07.452409 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f78c83-a3d7-4f94-9fdc-3568794550ff admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:07.464123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c970ad-b6d9-44c9-ad92-c901a3a7446e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:07.532386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c970ad-b6d9-44c9-ad92-c901a3a7446e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:07.537352 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213ea43-7aa8-4420-81d6-7a3295eb99a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:07.538034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213ea43-7aa8-4420-81d6-7a3295eb99a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:07.538208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f78c83-a3d7-4f94-9fdc-3568794550ff admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:07.538316 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213ea43-7aa8-4420-81d6-7a3295eb99a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:07.538662 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213ea43-7aa8-4420-81d6-7a3295eb99a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:07.540950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b213ea43-7aa8-4420-81d6-7a3295eb99a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:07.544411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb46b3-4820-406b-aa1e-64b319731d96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:07.545621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb46b3-4820-406b-aa1e-64b319731d96 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:07.546214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb46b3-4820-406b-aa1e-64b319731d96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:07.546624 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb46b3-4820-406b-aa1e-64b319731d96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:07.559883 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb46b3-4820-406b-aa1e-64b319731d96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:07.561499 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb46b3-4820-406b-aa1e-64b319731d96 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:07.600140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 930/1850] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:07.621536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213ea43-7aa8-4420-81d6-7a3295eb99a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:07.624046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213ea43-7aa8-4420-81d6-7a3295eb99a1 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:07.638082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 921/1851] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:07.829433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c31d40-4eaf-4ec4-91a5-9bb2441f7533 None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:07.830121 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c31d40-4eaf-4ec4-91a5-9bb2441f7533 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:07.830745 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c31d40-4eaf-4ec4-91a5-9bb2441f7533 None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:07.833641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 931/1852] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 16 16:17:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:17:07.842639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febd22b-21af-4283-93f5-0b62f9f164a3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:07.842888 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febd22b-21af-4283-93f5-0b62f9f164a3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:07.843178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febd22b-21af-4283-93f5-0b62f9f164a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:07.872288 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7febd22b-21af-4283-93f5-0b62f9f164a3 None None] MFA Rules not processed for user `795c029cb14b42b5b0f3987e218d4239`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:07.875373 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7febd22b-21af-4283-93f5-0b62f9f164a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:07.908014 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:08.026581 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c31d40-4eaf-4ec4-91a5-9bb2441f7533 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:08.029196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-25c31d40-4eaf-4ec4-91a5-9bb2441f7533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:08.038142 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:08.055816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 922/1853] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 16 16:17:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:08.069566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febd22b-21af-4283-93f5-0b62f9f164a3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:08.075897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7febd22b-21af-4283-93f5-0b62f9f164a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:08.120332 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febd22b-21af-4283-93f5-0b62f9f164a3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:08.129161 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576601a8-3561-4c92-87d3-555b8d35e87a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:08.130129 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576601a8-3561-4c92-87d3-555b8d35e87a service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:08.130587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576601a8-3561-4c92-87d3-555b8d35e87a service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:08.130932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576601a8-3561-4c92-87d3-555b8d35e87a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:08.144792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576601a8-3561-4c92-87d3-555b8d35e87a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:08.147764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576601a8-3561-4c92-87d3-555b8d35e87a service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:08.181509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 923/1854] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:08.204512 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c31d40-4eaf-4ec4-91a5-9bb2441f7533 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:08.218626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f98183-d3cb-4354-bc4e-ee5e0fe97302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:08.219981 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f98183-d3cb-4354-bc4e-ee5e0fe97302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:08.220468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f98183-d3cb-4354-bc4e-ee5e0fe97302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:08.220910 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f98183-d3cb-4354-bc4e-ee5e0fe97302 admin admin] PATH_INFO: `/v3/users/57e60d484f5749fa99df21db5f29bb3c` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:08.223601 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f98183-d3cb-4354-bc4e-ee5e0fe97302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e60d484f5749fa99df21db5f29bb3c)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:08.225923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f98183-d3cb-4354-bc4e-ee5e0fe97302 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:08.327836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f3f98183-d3cb-4354-bc4e-ee5e0fe97302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e60d484f5749fa99df21db5f29bb3c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:08.366814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f3f98183-d3cb-4354-bc4e-ee5e0fe97302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e60d484f5749fa99df21db5f29bb3c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:08.367834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f3f98183-d3cb-4354-bc4e-ee5e0fe97302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e60d484f5749fa99df21db5f29bb3c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:08.368655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f3f98183-d3cb-4354-bc4e-ee5e0fe97302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e60d484f5749fa99df21db5f29bb3c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:08.379438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f3f98183-d3cb-4354-bc4e-ee5e0fe97302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e60d484f5749fa99df21db5f29bb3c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:08.410785 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 932/1855] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:08 2022] DELETE /identity/v3/users/57e60d484f5749fa99df21db5f29bb3c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:08.416666 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559906f4-35e9-4556-a8f8-cbf48c405a9a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:08.417080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559906f4-35e9-4556-a8f8-cbf48c405a9a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:08.417500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559906f4-35e9-4556-a8f8-cbf48c405a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:08.459583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f98183-d3cb-4354-bc4e-ee5e0fe97302 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:08.459797 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-559906f4-35e9-4556-a8f8-cbf48c405a9a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:08.461399 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-559906f4-35e9-4556-a8f8-cbf48c405a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:08.461826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f3f98183-d3cb-4354-bc4e-ee5e0fe97302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:08.529073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 924/1856] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:08.542052 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559906f4-35e9-4556-a8f8-cbf48c405a9a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:08.544738 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-559906f4-35e9-4556-a8f8-cbf48c405a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:08.572461 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f98183-d3cb-4354-bc4e-ee5e0fe97302 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:08.578071 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eeb30-1c15-4268-8746-13e39c39b3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:08.579106 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eeb30-1c15-4268-8746-13e39c39b3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:08.579449 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eeb30-1c15-4268-8746-13e39c39b3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:08.579836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eeb30-1c15-4268-8746-13e39c39b3c0 admin admin] PATH_INFO: `/v3/users/d78a68a649804b14a8f6261a334d7371` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:08.581943 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20eeb30-1c15-4268-8746-13e39c39b3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78a68a649804b14a8f6261a334d7371)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:08.584239 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20eeb30-1c15-4268-8746-13e39c39b3c0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:08.610959 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:08.635243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559906f4-35e9-4556-a8f8-cbf48c405a9a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:08.639415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d80b2-13a8-487a-99ec-8ff441dcfcf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:08.640072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d80b2-13a8-487a-99ec-8ff441dcfcf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:08.640341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d80b2-13a8-487a-99ec-8ff441dcfcf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:08.640654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d80b2-13a8-487a-99ec-8ff441dcfcf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:08.641891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c20eeb30-1c15-4268-8746-13e39c39b3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78a68a649804b14a8f6261a334d7371'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:08.651403 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d80b2-13a8-487a-99ec-8ff441dcfcf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:08.653512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d80b2-13a8-487a-99ec-8ff441dcfcf9 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:08.661839 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c20eeb30-1c15-4268-8746-13e39c39b3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78a68a649804b14a8f6261a334d7371'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:08.662686 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c20eeb30-1c15-4268-8746-13e39c39b3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78a68a649804b14a8f6261a334d7371'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:08.663352 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c20eeb30-1c15-4268-8746-13e39c39b3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78a68a649804b14a8f6261a334d7371'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:08.664424 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 925/1857] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:08.671467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c20eeb30-1c15-4268-8746-13e39c39b3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78a68a649804b14a8f6261a334d7371'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:08.688454 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 933/1858] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:08 2022] DELETE /identity/v3/users/d78a68a649804b14a8f6261a334d7371 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:08.694073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e0c60-19f6-4ffa-9580-852da7991509 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:08.694365 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e0c60-19f6-4ffa-9580-852da7991509 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:08.694698 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e0c60-19f6-4ffa-9580-852da7991509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:08.714975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-862e0c60-19f6-4ffa-9580-852da7991509 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:08.716175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-862e0c60-19f6-4ffa-9580-852da7991509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:08.784090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:08.818340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 926/1859] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:08.829361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eeb30-1c15-4268-8746-13e39c39b3c0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:08.832855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c20eeb30-1c15-4268-8746-13e39c39b3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:08.919940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eeb30-1c15-4268-8746-13e39c39b3c0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:08.924219 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d823a-85e0-45d9-ab4a-60cd6e7d34f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:08.925738 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d823a-85e0-45d9-ab4a-60cd6e7d34f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:08.926291 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d823a-85e0-45d9-ab4a-60cd6e7d34f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:08.926818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d823a-85e0-45d9-ab4a-60cd6e7d34f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:08.939243 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d823a-85e0-45d9-ab4a-60cd6e7d34f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:08.941751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d823a-85e0-45d9-ab4a-60cd6e7d34f5 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:08.954233 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 934/1860] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:09.092651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e0c60-19f6-4ffa-9580-852da7991509 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:09.094300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-862e0c60-19f6-4ffa-9580-852da7991509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:09.116324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e0c60-19f6-4ffa-9580-852da7991509 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:09.121751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3a50e-fd68-40a4-897f-a925c317c95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:09.123379 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3a50e-fd68-40a4-897f-a925c317c95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:09.123676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3a50e-fd68-40a4-897f-a925c317c95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:09.123963 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3a50e-fd68-40a4-897f-a925c317c95a admin admin] PATH_INFO: `/v3/projects/e14e311da0904b33b3fc416b5e1f5255` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:09.125482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3a50e-fd68-40a4-897f-a925c317c95a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e14e311da0904b33b3fc416b5e1f5255)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:09.127557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3a50e-fd68-40a4-897f-a925c317c95a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:09.204893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-94b3a50e-fd68-40a4-897f-a925c317c95a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e14e311da0904b33b3fc416b5e1f5255', 'request_id': 'req-94b3a50e-fd68-40a4-897f-a925c317c95a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:09.214959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-94b3a50e-fd68-40a4-897f-a925c317c95a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e14e311da0904b33b3fc416b5e1f5255', 'request_id': 'req-94b3a50e-fd68-40a4-897f-a925c317c95a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:09.245088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-94b3a50e-fd68-40a4-897f-a925c317c95a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e14e311da0904b33b3fc416b5e1f5255', 'request_id': 'req-94b3a50e-fd68-40a4-897f-a925c317c95a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:09.265908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-94b3a50e-fd68-40a4-897f-a925c317c95a admin admin] The token cache is being invalidate because project e14e311da0904b33b3fc416b5e1f5255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:09.266209 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-94b3a50e-fd68-40a4-897f-a925c317c95a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:09.266961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-94b3a50e-fd68-40a4-897f-a925c317c95a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:09.269210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 927/1861] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:09 2022] DELETE /identity/v3/projects/e14e311da0904b33b3fc416b5e1f5255 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:09.275063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d823a-85e0-45d9-ab4a-60cd6e7d34f5 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:09.298245 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d823a-85e0-45d9-ab4a-60cd6e7d34f5 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:09.443987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd7037-4c75-4396-a384-eb9297e55fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:09.444999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd7037-4c75-4396-a384-eb9297e55fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:09.445360 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd7037-4c75-4396-a384-eb9297e55fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:09.445737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd7037-4c75-4396-a384-eb9297e55fca admin admin] PATH_INFO: `/v3/users/5025320260cb4f85b9a8fb8ce6125ecc` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:09.449083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd7037-4c75-4396-a384-eb9297e55fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=5025320260cb4f85b9a8fb8ce6125ecc)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:09.452407 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd7037-4c75-4396-a384-eb9297e55fca admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:09.559005 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:09.564589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a6bd7037-4c75-4396-a384-eb9297e55fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5025320260cb4f85b9a8fb8ce6125ecc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:09.572360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3a50e-fd68-40a4-897f-a925c317c95a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:09.575673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-94b3a50e-fd68-40a4-897f-a925c317c95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:09.609993 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a6bd7037-4c75-4396-a384-eb9297e55fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5025320260cb4f85b9a8fb8ce6125ecc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:09.613495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a6bd7037-4c75-4396-a384-eb9297e55fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5025320260cb4f85b9a8fb8ce6125ecc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:09.614617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3a50e-fd68-40a4-897f-a925c317c95a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:09.614737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a6bd7037-4c75-4396-a384-eb9297e55fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5025320260cb4f85b9a8fb8ce6125ecc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:09.635043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a6bd7037-4c75-4396-a384-eb9297e55fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5025320260cb4f85b9a8fb8ce6125ecc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:09.645519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c255b7-76e4-493b-8142-df867637e7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:09.650813 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c255b7-76e4-493b-8142-df867637e7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:09.652825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c255b7-76e4-493b-8142-df867637e7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:09.653220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c255b7-76e4-493b-8142-df867637e7c6 admin admin] PATH_INFO: `/v3/projects/026ac65a944345c7b7e0d1bb875348eb` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:09.657203 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c255b7-76e4-493b-8142-df867637e7c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=026ac65a944345c7b7e0d1bb875348eb)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:09.664901 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c255b7-76e4-493b-8142-df867637e7c6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:09.666284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 935/1862] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:09 2022] DELETE /identity/v3/users/5025320260cb4f85b9a8fb8ce6125ecc => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:09.793552 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-28c255b7-76e4-493b-8142-df867637e7c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026ac65a944345c7b7e0d1bb875348eb', 'request_id': 'req-28c255b7-76e4-493b-8142-df867637e7c6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:09.817338 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-28c255b7-76e4-493b-8142-df867637e7c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026ac65a944345c7b7e0d1bb875348eb', 'request_id': 'req-28c255b7-76e4-493b-8142-df867637e7c6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:09.840319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-28c255b7-76e4-493b-8142-df867637e7c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026ac65a944345c7b7e0d1bb875348eb', 'request_id': 'req-28c255b7-76e4-493b-8142-df867637e7c6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:09.864778 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-28c255b7-76e4-493b-8142-df867637e7c6 admin admin] The token cache is being invalidate because project 026ac65a944345c7b7e0d1bb875348eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:09.865043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-28c255b7-76e4-493b-8142-df867637e7c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:09.867155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-28c255b7-76e4-493b-8142-df867637e7c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:09.872994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd7037-4c75-4396-a384-eb9297e55fca admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:09.873987 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 928/1863] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:09 2022] DELETE /identity/v3/projects/026ac65a944345c7b7e0d1bb875348eb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:09.874848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a6bd7037-4c75-4396-a384-eb9297e55fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:09.999499 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd7037-4c75-4396-a384-eb9297e55fca admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:10.089154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d17e01-0811-4629-9c84-5f43d5884a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:10.090047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d17e01-0811-4629-9c84-5f43d5884a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:10.090330 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d17e01-0811-4629-9c84-5f43d5884a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:10.090672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d17e01-0811-4629-9c84-5f43d5884a7b admin admin] PATH_INFO: `/v3/users/dc2a40f649e64dc8817eb05c86b0d85e` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:10.092078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d17e01-0811-4629-9c84-5f43d5884a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2a40f649e64dc8817eb05c86b0d85e)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:10.094040 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d17e01-0811-4629-9c84-5f43d5884a7b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:10.191385 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-05d17e01-0811-4629-9c84-5f43d5884a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2a40f649e64dc8817eb05c86b0d85e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:10.209128 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-05d17e01-0811-4629-9c84-5f43d5884a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2a40f649e64dc8817eb05c86b0d85e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:10.210098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-05d17e01-0811-4629-9c84-5f43d5884a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2a40f649e64dc8817eb05c86b0d85e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:10.211615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-05d17e01-0811-4629-9c84-5f43d5884a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2a40f649e64dc8817eb05c86b0d85e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:10.220890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-05d17e01-0811-4629-9c84-5f43d5884a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2a40f649e64dc8817eb05c86b0d85e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:10.222843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:10.240938 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 936/1864] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:09 2022] DELETE /identity/v3/users/dc2a40f649e64dc8817eb05c86b0d85e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:10.305143 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c255b7-76e4-493b-8142-df867637e7c6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:10.308158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-28c255b7-76e4-493b-8142-df867637e7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:10.322813 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c255b7-76e4-493b-8142-df867637e7c6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:10.388194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:10.400450 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb70d23-92d8-4f03-ba6b-621c84958f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:10.401285 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb70d23-92d8-4f03-ba6b-621c84958f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:10.401569 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb70d23-92d8-4f03-ba6b-621c84958f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:10.401992 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb70d23-92d8-4f03-ba6b-621c84958f3d admin admin] PATH_INFO: `/v3/projects/a6e47cae02ed4a32902f8bc67192939f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:10.404300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb70d23-92d8-4f03-ba6b-621c84958f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e47cae02ed4a32902f8bc67192939f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:10.405522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb70d23-92d8-4f03-ba6b-621c84958f3d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:10.466653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1cb70d23-92d8-4f03-ba6b-621c84958f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e47cae02ed4a32902f8bc67192939f', 'request_id': 'req-1cb70d23-92d8-4f03-ba6b-621c84958f3d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:10.473046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1cb70d23-92d8-4f03-ba6b-621c84958f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e47cae02ed4a32902f8bc67192939f', 'request_id': 'req-1cb70d23-92d8-4f03-ba6b-621c84958f3d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:10.482908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1cb70d23-92d8-4f03-ba6b-621c84958f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e47cae02ed4a32902f8bc67192939f', 'request_id': 'req-1cb70d23-92d8-4f03-ba6b-621c84958f3d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:10.499776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1cb70d23-92d8-4f03-ba6b-621c84958f3d admin admin] The token cache is being invalidate because project a6e47cae02ed4a32902f8bc67192939f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:10.500560 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1cb70d23-92d8-4f03-ba6b-621c84958f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:10.500717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1cb70d23-92d8-4f03-ba6b-621c84958f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:10.507694 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 929/1865] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:10 2022] DELETE /identity/v3/projects/a6e47cae02ed4a32902f8bc67192939f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:10.513672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93bdfd-518b-4da1-b07e-5d97e23a40f0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:10.514505 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93bdfd-518b-4da1-b07e-5d97e23a40f0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:10.514505 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93bdfd-518b-4da1-b07e-5d97e23a40f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:10.541835 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5a93bdfd-518b-4da1-b07e-5d97e23a40f0 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:10.543330 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5a93bdfd-518b-4da1-b07e-5d97e23a40f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:10.600372 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb70d23-92d8-4f03-ba6b-621c84958f3d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:10.601788 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1cb70d23-92d8-4f03-ba6b-621c84958f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:10.642574 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 937/1866] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:10.650592 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220b8f9-6037-4785-9a9f-97f7d75ea30d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:10.651355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220b8f9-6037-4785-9a9f-97f7d75ea30d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:10.651732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220b8f9-6037-4785-9a9f-97f7d75ea30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:10.671887 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b220b8f9-6037-4785-9a9f-97f7d75ea30d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:10.673084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b220b8f9-6037-4785-9a9f-97f7d75ea30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:10.680757 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb70d23-92d8-4f03-ba6b-621c84958f3d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:10.683339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 938/1867] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:10.685572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e282f-93c7-40f2-9780-a323ce03fe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:10.686557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e282f-93c7-40f2-9780-a323ce03fe61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:10.686838 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e282f-93c7-40f2-9780-a323ce03fe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:10.687110 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e282f-93c7-40f2-9780-a323ce03fe61 admin admin] PATH_INFO: `/v3/projects/31260b3227784ef2b5db5e49bf5110a1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:10.687561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220b8f9-6037-4785-9a9f-97f7d75ea30d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:10.688355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e282f-93c7-40f2-9780-a323ce03fe61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31260b3227784ef2b5db5e49bf5110a1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:10.690256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e282f-93c7-40f2-9780-a323ce03fe61 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:10.700485 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220b8f9-6037-4785-9a9f-97f7d75ea30d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:10.705720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace615d-fde1-4eba-8506-5a279f9215d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:10.706743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace615d-fde1-4eba-8506-5a279f9215d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:10.707002 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace615d-fde1-4eba-8506-5a279f9215d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:10.707315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace615d-fde1-4eba-8506-5a279f9215d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:10.708049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace615d-fde1-4eba-8506-5a279f9215d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:10.708360 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace615d-fde1-4eba-8506-5a279f9215d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:10.709979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace615d-fde1-4eba-8506-5a279f9215d7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:10.722808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 939/1868] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:17:10.727254 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace615d-fde1-4eba-8506-5a279f9215d7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:10.737058 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace615d-fde1-4eba-8506-5a279f9215d7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:10.740453 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cb3e282f-93c7-40f2-9780-a323ce03fe61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31260b3227784ef2b5db5e49bf5110a1', 'request_id': 'req-cb3e282f-93c7-40f2-9780-a323ce03fe61'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:10.746442 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cb3e282f-93c7-40f2-9780-a323ce03fe61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31260b3227784ef2b5db5e49bf5110a1', 'request_id': 'req-cb3e282f-93c7-40f2-9780-a323ce03fe61'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:10.754633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cb3e282f-93c7-40f2-9780-a323ce03fe61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31260b3227784ef2b5db5e49bf5110a1', 'request_id': 'req-cb3e282f-93c7-40f2-9780-a323ce03fe61'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:10.766389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cb3e282f-93c7-40f2-9780-a323ce03fe61 admin admin] The token cache is being invalidate because project 31260b3227784ef2b5db5e49bf5110a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:10.766757 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cb3e282f-93c7-40f2-9780-a323ce03fe61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:10.767542 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-cb3e282f-93c7-40f2-9780-a323ce03fe61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:10.769503 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 930/1869] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:10 2022] DELETE /identity/v3/projects/31260b3227784ef2b5db5e49bf5110a1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:10.773965 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d911-1363-4299-bbcc-db4a69052b23 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:10.774278 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d911-1363-4299-bbcc-db4a69052b23 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:10.774580 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d911-1363-4299-bbcc-db4a69052b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:10.793299 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1037d911-1363-4299-bbcc-db4a69052b23 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:10.794830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1037d911-1363-4299-bbcc-db4a69052b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:10.806814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b9a08-3596-479b-b13f-4bd201aadee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:10.807504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b9a08-3596-479b-b13f-4bd201aadee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:10.807655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:10.807907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b9a08-3596-479b-b13f-4bd201aadee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:10.808198 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b9a08-3596-479b-b13f-4bd201aadee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:10.809003 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b9a08-3596-479b-b13f-4bd201aadee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:10.811057 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b9a08-3596-479b-b13f-4bd201aadee0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:10.861010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 940/1870] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:10 2022] POST /identity/v3/projects => generated 391 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:17:10.865867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b9a08-3596-479b-b13f-4bd201aadee0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:10.868473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-029b9a08-3596-479b-b13f-4bd201aadee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:10.884476 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 931/1871] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:10.893258 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eef8b1-830f-4266-83cf-7d9acbbb6b09 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:10.893446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eef8b1-830f-4266-83cf-7d9acbbb6b09 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:10.893718 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eef8b1-830f-4266-83cf-7d9acbbb6b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:10.928936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-15eef8b1-830f-4266-83cf-7d9acbbb6b09 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:10.930814 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-15eef8b1-830f-4266-83cf-7d9acbbb6b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:10.962168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:10.969559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b9a08-3596-479b-b13f-4bd201aadee0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:10.978206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265580d-05c3-4af4-9404-69a0ab246c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:10.978883 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265580d-05c3-4af4-9404-69a0ab246c10 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:10.979780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265580d-05c3-4af4-9404-69a0ab246c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:10.980054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265580d-05c3-4af4-9404-69a0ab246c10 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:10.980986 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265580d-05c3-4af4-9404-69a0ab246c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:10.983208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265580d-05c3-4af4-9404-69a0ab246c10 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:11.010208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 941/1872] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:10 2022] POST /identity/v3/users => generated 296 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:11.016294 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265580d-05c3-4af4-9404-69a0ab246c10 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:11.031708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265580d-05c3-4af4-9404-69a0ab246c10 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:11.047703 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12bcb4-28f9-41fd-9186-b5de89abadce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:11.048466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12bcb4-28f9-41fd-9186-b5de89abadce admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:11.048760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12bcb4-28f9-41fd-9186-b5de89abadce admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:11.049042 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12bcb4-28f9-41fd-9186-b5de89abadce admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:11.051437 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12bcb4-28f9-41fd-9186-b5de89abadce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:11.053068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12bcb4-28f9-41fd-9186-b5de89abadce admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:11.075456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 932/1873] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:11.076571 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eef8b1-830f-4266-83cf-7d9acbbb6b09 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:11.084371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 942/1874] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:11.085673 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12bcb4-28f9-41fd-9186-b5de89abadce admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:11.096288 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-15eef8b1-830f-4266-83cf-7d9acbbb6b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:11.105128 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12bcb4-28f9-41fd-9186-b5de89abadce admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:11.120414 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f9369-e8a2-4901-9e91-7791628e7ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:11.121120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f9369-e8a2-4901-9e91-7791628e7ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:11.121409 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f9369-e8a2-4901-9e91-7791628e7ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:11.121695 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f9369-e8a2-4901-9e91-7791628e7ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:11.122570 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f9369-e8a2-4901-9e91-7791628e7ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:11.125207 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f9369-e8a2-4901-9e91-7791628e7ef8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:11.131079 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eef8b1-830f-4266-83cf-7d9acbbb6b09 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:11.139121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaf4cb-7736-4858-92a7-fa2289e6b6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:11.140026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaf4cb-7736-4858-92a7-fa2289e6b6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:11.140311 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaf4cb-7736-4858-92a7-fa2289e6b6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:11.140585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaf4cb-7736-4858-92a7-fa2289e6b6ab admin admin] PATH_INFO: `/v3/users/1a08c6874bc34600993b452406986abc` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:11.143086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abaf4cb-7736-4858-92a7-fa2289e6b6ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a08c6874bc34600993b452406986abc)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:11.145370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abaf4cb-7736-4858-92a7-fa2289e6b6ab admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:11.148652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 943/1875] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:11.153126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f9369-e8a2-4901-9e91-7791628e7ef8 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:11.201791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f9369-e8a2-4901-9e91-7791628e7ef8 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:11.216861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0abaf4cb-7736-4858-92a7-fa2289e6b6ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a08c6874bc34600993b452406986abc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:11.218761 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0abaf4cb-7736-4858-92a7-fa2289e6b6ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a08c6874bc34600993b452406986abc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:11.221450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cad19-c581-4dd4-8c6d-c04b62db851b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:11.222207 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cad19-c581-4dd4-8c6d-c04b62db851b admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:11.222568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cad19-c581-4dd4-8c6d-c04b62db851b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:11.222795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cad19-c581-4dd4-8c6d-c04b62db851b admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:11.224031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cad19-c581-4dd4-8c6d-c04b62db851b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:11.225072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cad19-c581-4dd4-8c6d-c04b62db851b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:11.226294 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cad19-c581-4dd4-8c6d-c04b62db851b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:11.247729 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 944/1876] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:11.248232 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0abaf4cb-7736-4858-92a7-fa2289e6b6ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a08c6874bc34600993b452406986abc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:11.248706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cad19-c581-4dd4-8c6d-c04b62db851b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:11.249099 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0abaf4cb-7736-4858-92a7-fa2289e6b6ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a08c6874bc34600993b452406986abc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:11.250730 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f36cad19-c581-4dd4-8c6d-c04b62db851b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:11.273235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cad19-c581-4dd4-8c6d-c04b62db851b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:11.282289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a328a-fe46-4f31-bbc0-414651e6b03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:11.286839 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a328a-fe46-4f31-bbc0-414651e6b03b admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:11.286839 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a328a-fe46-4f31-bbc0-414651e6b03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:11.288861 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a328a-fe46-4f31-bbc0-414651e6b03b admin admin] PATH_INFO: `/v3/projects/ab4dd29ed3d64bc7bc540d3001f68e58/users/7c242b41547a4e1ba4aa61d402c0775f/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:11.288988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0abaf4cb-7736-4858-92a7-fa2289e6b6ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a08c6874bc34600993b452406986abc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:11.330041 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 933/1877] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:11 2022] DELETE /identity/v3/users/1a08c6874bc34600993b452406986abc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:11.332467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaf4cb-7736-4858-92a7-fa2289e6b6ab admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:11.336120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a328a-fe46-4f31-bbc0-414651e6b03b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4dd29ed3d64bc7bc540d3001f68e58, user_id=7c242b41547a4e1ba4aa61d402c0775f, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:11.336461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0abaf4cb-7736-4858-92a7-fa2289e6b6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:11.345061 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a328a-fe46-4f31-bbc0-414651e6b03b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:11.372992 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 945/1878] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:11 2022] PUT /identity/v3/projects/ab4dd29ed3d64bc7bc540d3001f68e58/users/7c242b41547a4e1ba4aa61d402c0775f/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:11.375325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a13d8-c776-4f63-adcf-86d8273649cc None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:11.375651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a13d8-c776-4f63-adcf-86d8273649cc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:11.375925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a13d8-c776-4f63-adcf-86d8273649cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:11.426074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:11.426287 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d24a13d8-c776-4f63-adcf-86d8273649cc None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:11.427500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d24a13d8-c776-4f63-adcf-86d8273649cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:11.544866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaf4cb-7736-4858-92a7-fa2289e6b6ab admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:11.626936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 946/1879] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:11.629358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f847e10-dcf9-43c6-aa45-a128dbbe1be1 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:11.629665 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f847e10-dcf9-43c6-aa45-a128dbbe1be1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:11.629944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f847e10-dcf9-43c6-aa45-a128dbbe1be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:11.667648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9f847e10-dcf9-43c6-aa45-a128dbbe1be1 None None] MFA Rules not processed for user `7c242b41547a4e1ba4aa61d402c0775f`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:11.668933 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9f847e10-dcf9-43c6-aa45-a128dbbe1be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:11.781986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76593dd4-5e90-4af7-b47a-a88276930706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:11.782764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593dd4-5e90-4af7-b47a-a88276930706 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:11.783058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593dd4-5e90-4af7-b47a-a88276930706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:11.783337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593dd4-5e90-4af7-b47a-a88276930706 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:11.784043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76593dd4-5e90-4af7-b47a-a88276930706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:11.791845 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76593dd4-5e90-4af7-b47a-a88276930706 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:11.815227 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 947/1880] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:11.817001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f847e10-dcf9-43c6-aa45-a128dbbe1be1 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:11.820217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9f847e10-dcf9-43c6-aa45-a128dbbe1be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:11.857080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 934/1881] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:11 2022] POST /identity/v3/projects => generated 365 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:11.859793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:11.860347 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76593dd4-5e90-4af7-b47a-a88276930706 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:11.870410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-76593dd4-5e90-4af7-b47a-a88276930706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:11.959260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f847e10-dcf9-43c6-aa45-a128dbbe1be1 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:11.963032 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76593dd4-5e90-4af7-b47a-a88276930706 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:11.969336 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109f7b7-cfb6-4aed-9c61-533027496243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:11.970258 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109f7b7-cfb6-4aed-9c61-533027496243 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:11.970924 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109f7b7-cfb6-4aed-9c61-533027496243 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:11.971460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109f7b7-cfb6-4aed-9c61-533027496243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:12.044999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1dec16-400d-4c38-ba1d-74e93db2a7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:12.045666 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dec16-400d-4c38-ba1d-74e93db2a7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:12.046495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dec16-400d-4c38-ba1d-74e93db2a7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:12.046495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dec16-400d-4c38-ba1d-74e93db2a7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:12.048991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109f7b7-cfb6-4aed-9c61-533027496243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:12.051089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109f7b7-cfb6-4aed-9c61-533027496243 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:12.062271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 935/1882] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:12.063266 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109f7b7-cfb6-4aed-9c61-533027496243 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:12.077912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:12.147033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1dec16-400d-4c38-ba1d-74e93db2a7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:12.149235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1dec16-400d-4c38-ba1d-74e93db2a7a7 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:12.159008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109f7b7-cfb6-4aed-9c61-533027496243 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:12.163652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 948/1883] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:12.167214 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a828d24-5a43-41c5-bb59-35da3fc0e489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:12.167621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a828d24-5a43-41c5-bb59-35da3fc0e489 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:12.168098 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a828d24-5a43-41c5-bb59-35da3fc0e489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:12.168380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a828d24-5a43-41c5-bb59-35da3fc0e489 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:12.169110 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a828d24-5a43-41c5-bb59-35da3fc0e489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:12.171398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a828d24-5a43-41c5-bb59-35da3fc0e489 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:12.200139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 936/1884] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:12 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:12.205071 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1dec16-400d-4c38-ba1d-74e93db2a7a7 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:12.220804 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1dec16-400d-4c38-ba1d-74e93db2a7a7 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:12.231517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9877238-d907-4488-ab26-8cb329f3849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:12.232375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9877238-d907-4488-ab26-8cb329f3849e admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:12.233383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9877238-d907-4488-ab26-8cb329f3849e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:12.233383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9877238-d907-4488-ab26-8cb329f3849e admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:12.234277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9877238-d907-4488-ab26-8cb329f3849e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:12.236275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9877238-d907-4488-ab26-8cb329f3849e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:12.250673 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 949/1885] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:12.255162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a828d24-5a43-41c5-bb59-35da3fc0e489 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:12.272029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a828d24-5a43-41c5-bb59-35da3fc0e489 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:12.279810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9ca1f-63b9-4f60-a4ea-26dc0bf0b4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:12.281329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9ca1f-63b9-4f60-a4ea-26dc0bf0b4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:12.281777 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9ca1f-63b9-4f60-a4ea-26dc0bf0b4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:12.282073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9ca1f-63b9-4f60-a4ea-26dc0bf0b4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:12.282968 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9ca1f-63b9-4f60-a4ea-26dc0bf0b4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:12.286355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9ca1f-63b9-4f60-a4ea-26dc0bf0b4c5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:12.301304 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 937/1886] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:12.305797 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9877238-d907-4488-ab26-8cb329f3849e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:12.319433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9877238-d907-4488-ab26-8cb329f3849e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:12.326135 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd33a2-4714-4417-a4a8-b7abc50c3106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:12.327222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd33a2-4714-4417-a4a8-b7abc50c3106 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:12.327562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd33a2-4714-4417-a4a8-b7abc50c3106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:12.327855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd33a2-4714-4417-a4a8-b7abc50c3106 admin admin] PATH_INFO: `/v3/projects/f60b6599161f408bbfa82eaf06bb7b25/users/d967b6c6cf374fe68e2ab2f73e18b6cb/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:12.349785 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd33a2-4714-4417-a4a8-b7abc50c3106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60b6599161f408bbfa82eaf06bb7b25, user_id=d967b6c6cf374fe68e2ab2f73e18b6cb, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:12.353054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd33a2-4714-4417-a4a8-b7abc50c3106 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:12.373881 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 950/1887] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:12 2022] PUT /identity/v3/projects/f60b6599161f408bbfa82eaf06bb7b25/users/d967b6c6cf374fe68e2ab2f73e18b6cb/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:12.386985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec817d-70eb-47c6-a0da-171ef7e56442 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:12.387459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec817d-70eb-47c6-a0da-171ef7e56442 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:12.387567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec817d-70eb-47c6-a0da-171ef7e56442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:12.437030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-acec817d-70eb-47c6-a0da-171ef7e56442 None None] MFA Rules not processed for user `d967b6c6cf374fe68e2ab2f73e18b6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:12.438370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-acec817d-70eb-47c6-a0da-171ef7e56442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:12.606339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 938/1888] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:12.608714 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd33a2-4714-4417-a4a8-b7abc50c3106 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:12.703681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec817d-70eb-47c6-a0da-171ef7e56442 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:12.705307 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-acec817d-70eb-47c6-a0da-171ef7e56442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:12.717052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:12.751199 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd33a2-4714-4417-a4a8-b7abc50c3106 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:12.768179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcebcbe-5139-4e14-bc8a-3ea4e7a54cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:12.769452 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcebcbe-5139-4e14-bc8a-3ea4e7a54cda admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:12.778411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcebcbe-5139-4e14-bc8a-3ea4e7a54cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:12.778411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcebcbe-5139-4e14-bc8a-3ea4e7a54cda admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:12.778411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcebcbe-5139-4e14-bc8a-3ea4e7a54cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:12.778411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcebcbe-5139-4e14-bc8a-3ea4e7a54cda admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:12.843181 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 951/1889] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:12 2022] POST /identity/v3/projects => generated 365 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:12.848240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcebcbe-5139-4e14-bc8a-3ea4e7a54cda admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:12.914325 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec817d-70eb-47c6-a0da-171ef7e56442 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:12.936741 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcebcbe-5139-4e14-bc8a-3ea4e7a54cda admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:12.943711 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564f55e-331d-4d29-bad4-788174322729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:12.944474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564f55e-331d-4d29-bad4-788174322729 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:12.944832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564f55e-331d-4d29-bad4-788174322729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:12.945189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564f55e-331d-4d29-bad4-788174322729 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:12.946561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564f55e-331d-4d29-bad4-788174322729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:12.949897 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564f55e-331d-4d29-bad4-788174322729 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:12.988337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 952/1890] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:12 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:12.989923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564f55e-331d-4d29-bad4-788174322729 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:13.041217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564f55e-331d-4d29-bad4-788174322729 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:13.044937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:13.057107 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96644346-a2c7-4459-a865-5ec08c780b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:13.058006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96644346-a2c7-4459-a865-5ec08c780b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:13.058792 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96644346-a2c7-4459-a865-5ec08c780b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:13.058969 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96644346-a2c7-4459-a865-5ec08c780b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:13.060036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96644346-a2c7-4459-a865-5ec08c780b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:13.061694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96644346-a2c7-4459-a865-5ec08c780b36 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:13.088851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 953/1891] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:13.092275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96644346-a2c7-4459-a865-5ec08c780b36 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:13.108886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96644346-a2c7-4459-a865-5ec08c780b36 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:13.118332 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb4f52-0bbf-4d23-89fe-ac0c09473c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:13.120748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb4f52-0bbf-4d23-89fe-ac0c09473c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:13.121246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb4f52-0bbf-4d23-89fe-ac0c09473c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:13.121907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb4f52-0bbf-4d23-89fe-ac0c09473c73 admin admin] PATH_INFO: `/v3/projects/fad040937ae74267b2e83438082220d0/users/e3dc9c3576544f14ba2ccc2d345ec51d/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:13.140856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:13.141756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:13.142040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:13.142315 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d admin admin] PATH_INFO: `/v3/projects/bc7faa1606a84cf19597243af92d5877` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:13.144245 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7faa1606a84cf19597243af92d5877)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:13.146197 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb4f52-0bbf-4d23-89fe-ac0c09473c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad040937ae74267b2e83438082220d0, user_id=e3dc9c3576544f14ba2ccc2d345ec51d, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:13.146995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:13.159005 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb4f52-0bbf-4d23-89fe-ac0c09473c73 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:13.172775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 954/1892] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:13 2022] PUT /identity/v3/projects/fad040937ae74267b2e83438082220d0/users/e3dc9c3576544f14ba2ccc2d345ec51d/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:13.173724 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb4f52-0bbf-4d23-89fe-ac0c09473c73 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:13.270942 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7faa1606a84cf19597243af92d5877', 'request_id': 'req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:13.279821 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7faa1606a84cf19597243af92d5877', 'request_id': 'req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:13.308009 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7faa1606a84cf19597243af92d5877', 'request_id': 'req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:13.328649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d admin admin] The token cache is being invalidate because project bc7faa1606a84cf19597243af92d5877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:13.329460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:13.330601 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:13.333561 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 939/1893] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:12 2022] DELETE /identity/v3/projects/bc7faa1606a84cf19597243af92d5877 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:13.340200 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:13.344167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:13.374183 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb4f52-0bbf-4d23-89fe-ac0c09473c73 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:13.459386 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:13.484027 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b8584-1317-4c88-88fb-1f1d8ede7a5d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:13.489450 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f090e4-d9f5-431f-8a52-b63dc80d1acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:13.490254 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f090e4-d9f5-431f-8a52-b63dc80d1acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:13.490585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f090e4-d9f5-431f-8a52-b63dc80d1acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:13.490868 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f090e4-d9f5-431f-8a52-b63dc80d1acc admin admin] PATH_INFO: `/v3/users/4e569ddba82e4f7ead647c1b6e3c3dc1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:13.492322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f090e4-d9f5-431f-8a52-b63dc80d1acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e569ddba82e4f7ead647c1b6e3c3dc1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:13.500463 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998d37d-df41-40c4-8919-9d55090fdd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:13.500598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f090e4-d9f5-431f-8a52-b63dc80d1acc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:13.501166 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998d37d-df41-40c4-8919-9d55090fdd4c admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:13.501536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998d37d-df41-40c4-8919-9d55090fdd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:13.502501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998d37d-df41-40c4-8919-9d55090fdd4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:13.503514 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998d37d-df41-40c4-8919-9d55090fdd4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:13.505484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998d37d-df41-40c4-8919-9d55090fdd4c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:13.532801 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 955/1894] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:13.534905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998d37d-df41-40c4-8919-9d55090fdd4c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:13.538937 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e998d37d-df41-40c4-8919-9d55090fdd4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:13.580636 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-53f090e4-d9f5-431f-8a52-b63dc80d1acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e569ddba82e4f7ead647c1b6e3c3dc1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:13.584018 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-53f090e4-d9f5-431f-8a52-b63dc80d1acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e569ddba82e4f7ead647c1b6e3c3dc1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:13.606696 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:13.614640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-53f090e4-d9f5-431f-8a52-b63dc80d1acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e569ddba82e4f7ead647c1b6e3c3dc1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:13.615969 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-53f090e4-d9f5-431f-8a52-b63dc80d1acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e569ddba82e4f7ead647c1b6e3c3dc1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:13.627236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-53f090e4-d9f5-431f-8a52-b63dc80d1acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e569ddba82e4f7ead647c1b6e3c3dc1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:13.637620 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998d37d-df41-40c4-8919-9d55090fdd4c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:13.642264 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b376a0-faf2-4a77-a6e4-56f432d52e73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:13.642964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b376a0-faf2-4a77-a6e4-56f432d52e73 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:13.643249 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b376a0-faf2-4a77-a6e4-56f432d52e73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:13.644620 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b376a0-faf2-4a77-a6e4-56f432d52e73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:13.646802 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 940/1895] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:13 2022] DELETE /identity/v3/users/4e569ddba82e4f7ead647c1b6e3c3dc1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:13.651348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-57b376a0-faf2-4a77-a6e4-56f432d52e73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:13.651737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f090e4-d9f5-431f-8a52-b63dc80d1acc admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:13.654872 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-53f090e4-d9f5-431f-8a52-b63dc80d1acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:13.780140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b376a0-faf2-4a77-a6e4-56f432d52e73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:13.781581 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b376a0-faf2-4a77-a6e4-56f432d52e73 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:13.792741 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 956/1896] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:13.793972 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f090e4-d9f5-431f-8a52-b63dc80d1acc admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:13.799042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fb90c-fdff-4fb3-8576-13f4c3771db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:13.800291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fb90c-fdff-4fb3-8576-13f4c3771db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:13.800577 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fb90c-fdff-4fb3-8576-13f4c3771db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:13.800851 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fb90c-fdff-4fb3-8576-13f4c3771db4 admin admin] PATH_INFO: `/v3/projects/fad040937ae74267b2e83438082220d0/users/e3dc9c3576544f14ba2ccc2d345ec51d/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:13.803114 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fb90c-fdff-4fb3-8576-13f4c3771db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad040937ae74267b2e83438082220d0, user_id=e3dc9c3576544f14ba2ccc2d345ec51d, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:13.805767 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fb90c-fdff-4fb3-8576-13f4c3771db4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:13.818602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 941/1897] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:13 2022] PUT /identity/v3/projects/fad040937ae74267b2e83438082220d0/users/e3dc9c3576544f14ba2ccc2d345ec51d/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:13.828543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3945a78-10df-43e0-a250-226b3c00bb69 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:13.828868 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3945a78-10df-43e0-a250-226b3c00bb69 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:13.829108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3945a78-10df-43e0-a250-226b3c00bb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:13.859191 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f3945a78-10df-43e0-a250-226b3c00bb69 None None] MFA Rules not processed for user `e3dc9c3576544f14ba2ccc2d345ec51d`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:13.861236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f3945a78-10df-43e0-a250-226b3c00bb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:13.968838 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 957/1898] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:14.023852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fb90c-fdff-4fb3-8576-13f4c3771db4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:14.026046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-436fb90c-fdff-4fb3-8576-13f4c3771db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:14.126918 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fb90c-fdff-4fb3-8576-13f4c3771db4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:14.133609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68e072-c863-4339-a6a1-52cf77d1f319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:14.134300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e072-c863-4339-a6a1-52cf77d1f319 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:14.134635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e072-c863-4339-a6a1-52cf77d1f319 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:14.134952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e072-c863-4339-a6a1-52cf77d1f319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:14.145627 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68e072-c863-4339-a6a1-52cf77d1f319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:14.150138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68e072-c863-4339-a6a1-52cf77d1f319 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:14.164249 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3945a78-10df-43e0-a250-226b3c00bb69 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:14.165449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 942/1899] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:14.165856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f3945a78-10df-43e0-a250-226b3c00bb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:14.181918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:14.264092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3945a78-10df-43e0-a250-226b3c00bb69 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:14.274246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783e3fb-5fea-4911-87de-7b07108691ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:14.275404 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783e3fb-5fea-4911-87de-7b07108691ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:14.275525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783e3fb-5fea-4911-87de-7b07108691ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:14.275709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783e3fb-5fea-4911-87de-7b07108691ad admin admin] PATH_INFO: `/v3/projects/1615afab772943169ca178ae6bd29ace` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:14.277484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783e3fb-5fea-4911-87de-7b07108691ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=1615afab772943169ca178ae6bd29ace)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:14.282997 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783e3fb-5fea-4911-87de-7b07108691ad admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:14.377001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d783e3fb-5fea-4911-87de-7b07108691ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1615afab772943169ca178ae6bd29ace', 'request_id': 'req-d783e3fb-5fea-4911-87de-7b07108691ad'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:14.386759 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d783e3fb-5fea-4911-87de-7b07108691ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1615afab772943169ca178ae6bd29ace', 'request_id': 'req-d783e3fb-5fea-4911-87de-7b07108691ad'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:14.400056 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d783e3fb-5fea-4911-87de-7b07108691ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1615afab772943169ca178ae6bd29ace', 'request_id': 'req-d783e3fb-5fea-4911-87de-7b07108691ad'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:14.420004 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d783e3fb-5fea-4911-87de-7b07108691ad admin admin] The token cache is being invalidate because project 1615afab772943169ca178ae6bd29ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:14.420378 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d783e3fb-5fea-4911-87de-7b07108691ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:14.421378 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d783e3fb-5fea-4911-87de-7b07108691ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:14.427337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 958/1900] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:14 2022] DELETE /identity/v3/projects/1615afab772943169ca178ae6bd29ace => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:14.428889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5202c8b-063e-4f9e-901a-248795b06780 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:14.429343 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5202c8b-063e-4f9e-901a-248795b06780 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:14.429628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5202c8b-063e-4f9e-901a-248795b06780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:14.461816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b5202c8b-063e-4f9e-901a-248795b06780 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:14.466020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b5202c8b-063e-4f9e-901a-248795b06780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:14.480518 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783e3fb-5fea-4911-87de-7b07108691ad admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:14.481940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d783e3fb-5fea-4911-87de-7b07108691ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:14.557984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783e3fb-5fea-4911-87de-7b07108691ad admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:14.559537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 943/1901] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:14.568587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e61fa-3231-4540-b418-7e12343e6d32 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:14.570419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a1004-39a5-48a8-82db-51f051877eec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:14.571092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e61fa-3231-4540-b418-7e12343e6d32 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:14.571389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e61fa-3231-4540-b418-7e12343e6d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:14.571794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a1004-39a5-48a8-82db-51f051877eec service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:14.572146 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a1004-39a5-48a8-82db-51f051877eec service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:14.572496 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a1004-39a5-48a8-82db-51f051877eec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:14.574595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ba3a1004-39a5-48a8-82db-51f051877eec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:14.625492 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2b4e61fa-3231-4540-b418-7e12343e6d32 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:14.628177 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2b4e61fa-3231-4540-b418-7e12343e6d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:14.639176 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 944/1902] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:14.645381 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e61fa-3231-4540-b418-7e12343e6d32 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:14.662558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e61fa-3231-4540-b418-7e12343e6d32 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:14.667236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:14.672460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a1004-39a5-48a8-82db-51f051877eec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:14.672853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88ffed-363e-48a9-a1ee-097ea29ba4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:14.673574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88ffed-363e-48a9-a1ee-097ea29ba4dd admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:14.673905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88ffed-363e-48a9-a1ee-097ea29ba4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:14.674464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88ffed-363e-48a9-a1ee-097ea29ba4dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:14.676125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88ffed-363e-48a9-a1ee-097ea29ba4dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:14.676268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a1004-39a5-48a8-82db-51f051877eec service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:14.676447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88ffed-363e-48a9-a1ee-097ea29ba4dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:14.678321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88ffed-363e-48a9-a1ee-097ea29ba4dd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:14.682113 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:14.692756 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 959/1903] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:14.704775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 945/1904] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:14.709489 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a1004-39a5-48a8-82db-51f051877eec service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:14.721027 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a1004-39a5-48a8-82db-51f051877eec service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:14.727034 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c97de-d244-420a-99fd-5dc8e08a15a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:14.727705 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c97de-d244-420a-99fd-5dc8e08a15a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:14.727991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c97de-d244-420a-99fd-5dc8e08a15a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:14.728274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c97de-d244-420a-99fd-5dc8e08a15a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:14.728975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c97de-d244-420a-99fd-5dc8e08a15a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:14.731083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c97de-d244-420a-99fd-5dc8e08a15a0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:14.772180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 960/1905] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:14 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:14.773099 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88ffed-363e-48a9-a1ee-097ea29ba4dd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:14.785203 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88ffed-363e-48a9-a1ee-097ea29ba4dd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:14.914398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9030cc7-688f-46a5-9f14-dbe439776d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:14.915162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9030cc7-688f-46a5-9f14-dbe439776d3a admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:14.915423 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9030cc7-688f-46a5-9f14-dbe439776d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:14.926216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9030cc7-688f-46a5-9f14-dbe439776d3a admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:14.926216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9030cc7-688f-46a5-9f14-dbe439776d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:14.926216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9030cc7-688f-46a5-9f14-dbe439776d3a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:14.951000 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c97de-d244-420a-99fd-5dc8e08a15a0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:14.953547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 946/1906] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:14 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:14.963498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c97de-d244-420a-99fd-5dc8e08a15a0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:14.977353 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7697a7-56a8-4adb-9fc7-4efe6a597fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:14.977813 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7697a7-56a8-4adb-9fc7-4efe6a597fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:14.978100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7697a7-56a8-4adb-9fc7-4efe6a597fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:14.978380 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7697a7-56a8-4adb-9fc7-4efe6a597fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:14.979156 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7697a7-56a8-4adb-9fc7-4efe6a597fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:14.980803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7697a7-56a8-4adb-9fc7-4efe6a597fb3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:14.996945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 961/1907] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:15.001258 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9030cc7-688f-46a5-9f14-dbe439776d3a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:15.012004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9030cc7-688f-46a5-9f14-dbe439776d3a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:15.017697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11502bff-928b-4bde-9012-e3aa51f7d5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:15.019259 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11502bff-928b-4bde-9012-e3aa51f7d5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:15.019647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11502bff-928b-4bde-9012-e3aa51f7d5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:15.020476 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11502bff-928b-4bde-9012-e3aa51f7d5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:15.020982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11502bff-928b-4bde-9012-e3aa51f7d5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:15.022630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11502bff-928b-4bde-9012-e3aa51f7d5b2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:15.037007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 947/1908] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:17:15.041290 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7697a7-56a8-4adb-9fc7-4efe6a597fb3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:15.058540 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7697a7-56a8-4adb-9fc7-4efe6a597fb3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:15.064243 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043ad51-5fdd-4730-9bd9-df60bba28d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:15.065374 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043ad51-5fdd-4730-9bd9-df60bba28d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:15.065748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043ad51-5fdd-4730-9bd9-df60bba28d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:15.066143 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043ad51-5fdd-4730-9bd9-df60bba28d48 admin admin] PATH_INFO: `/v3/projects/73dfba55abea4c24812edf57e01b7522/users/a96f24f9a0e1430d9559de99826e67b0/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:15.097885 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043ad51-5fdd-4730-9bd9-df60bba28d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dfba55abea4c24812edf57e01b7522, user_id=a96f24f9a0e1430d9559de99826e67b0, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:15.100970 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043ad51-5fdd-4730-9bd9-df60bba28d48 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:15.119330 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 962/1909] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:15 2022] PUT /identity/v3/projects/73dfba55abea4c24812edf57e01b7522/users/a96f24f9a0e1430d9559de99826e67b0/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:15.132578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387871b-d84c-4728-8c9f-2624ae6fbc12 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:15.132855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387871b-d84c-4728-8c9f-2624ae6fbc12 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:15.133296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387871b-d84c-4728-8c9f-2624ae6fbc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:15.176258 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4387871b-d84c-4728-8c9f-2624ae6fbc12 None None] MFA Rules not processed for user `a96f24f9a0e1430d9559de99826e67b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:15.177509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4387871b-d84c-4728-8c9f-2624ae6fbc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:15.263451 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 948/1910] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:15.268277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043ad51-5fdd-4730-9bd9-df60bba28d48 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:15.342538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043ad51-5fdd-4730-9bd9-df60bba28d48 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:15.348994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a08406-7010-4d62-9c51-5a5dae692c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:15.349235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a08406-7010-4d62-9c51-5a5dae692c14 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:15.349530 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a08406-7010-4d62-9c51-5a5dae692c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:15.349807 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a08406-7010-4d62-9c51-5a5dae692c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:15.350599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a08406-7010-4d62-9c51-5a5dae692c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:15.352622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a08406-7010-4d62-9c51-5a5dae692c14 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:15.388499 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 963/1911] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:15 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:15.392767 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387871b-d84c-4728-8c9f-2624ae6fbc12 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:15.404912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387871b-d84c-4728-8c9f-2624ae6fbc12 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:15.469889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f73f98-0f26-4865-8296-081f40815963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:15.470627 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f73f98-0f26-4865-8296-081f40815963 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:15.470919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f73f98-0f26-4865-8296-081f40815963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:15.471203 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f73f98-0f26-4865-8296-081f40815963 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:15.473016 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f73f98-0f26-4865-8296-081f40815963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:15.475038 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f73f98-0f26-4865-8296-081f40815963 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:15.487178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:15.513495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 949/1912] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:15 2022] POST /identity/v3/users => generated 301 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:15.517599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a08406-7010-4d62-9c51-5a5dae692c14 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:15.534608 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a08406-7010-4d62-9c51-5a5dae692c14 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:15.541426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1275a-a048-45d8-9a2c-4a2ff234d990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:15.542183 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1275a-a048-45d8-9a2c-4a2ff234d990 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:15.543435 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1275a-a048-45d8-9a2c-4a2ff234d990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:15.543841 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1275a-a048-45d8-9a2c-4a2ff234d990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:15.546047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1275a-a048-45d8-9a2c-4a2ff234d990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:15.548179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1275a-a048-45d8-9a2c-4a2ff234d990 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:15.576352 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 964/1913] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:15.579917 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f73f98-0f26-4865-8296-081f40815963 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:15.600071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f73f98-0f26-4865-8296-081f40815963 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:15.607754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5826ba8-a4c5-41d7-8e2c-125a7f58360c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:15.609704 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5826ba8-a4c5-41d7-8e2c-125a7f58360c admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:15.609998 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5826ba8-a4c5-41d7-8e2c-125a7f58360c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:15.610278 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5826ba8-a4c5-41d7-8e2c-125a7f58360c admin admin] PATH_INFO: `/v3/projects/94ced6f1bb9f4545aad05e543831c87f/users/6b8dfe73d8e84f578ede7d97eb0205a9/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:15.640123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5826ba8-a4c5-41d7-8e2c-125a7f58360c admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ced6f1bb9f4545aad05e543831c87f, user_id=6b8dfe73d8e84f578ede7d97eb0205a9, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:15.644178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5826ba8-a4c5-41d7-8e2c-125a7f58360c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:15.660000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 950/1914] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:15 2022] PUT /identity/v3/projects/94ced6f1bb9f4545aad05e543831c87f/users/6b8dfe73d8e84f578ede7d97eb0205a9/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:15.664113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1275a-a048-45d8-9a2c-4a2ff234d990 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:15.674521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1275a-a048-45d8-9a2c-4a2ff234d990 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:15.783315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f298d8d-a010-4e1e-884a-b8a0b81d1170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:15.785945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f298d8d-a010-4e1e-884a-b8a0b81d1170 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:15.786488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f298d8d-a010-4e1e-884a-b8a0b81d1170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:15.786975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f298d8d-a010-4e1e-884a-b8a0b81d1170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:15.788169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f298d8d-a010-4e1e-884a-b8a0b81d1170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:15.790557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f298d8d-a010-4e1e-884a-b8a0b81d1170 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:15.808672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 965/1915] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:15.814333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5826ba8-a4c5-41d7-8e2c-125a7f58360c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:15.828177 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5826ba8-a4c5-41d7-8e2c-125a7f58360c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:15.833804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c0a3c-7647-4269-83d4-a6f0f5be6ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:15.835013 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c0a3c-7647-4269-83d4-a6f0f5be6ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:15.836233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c0a3c-7647-4269-83d4-a6f0f5be6ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:15.836662 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c0a3c-7647-4269-83d4-a6f0f5be6ca5 admin admin] PATH_INFO: `/v3/projects/94ced6f1bb9f4545aad05e543831c87f/users/6b8dfe73d8e84f578ede7d97eb0205a9/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:15.841194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c0a3c-7647-4269-83d4-a6f0f5be6ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ced6f1bb9f4545aad05e543831c87f, user_id=6b8dfe73d8e84f578ede7d97eb0205a9, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:15.845640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c0a3c-7647-4269-83d4-a6f0f5be6ca5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:15.863466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 951/1916] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:15 2022] PUT /identity/v3/projects/94ced6f1bb9f4545aad05e543831c87f/users/6b8dfe73d8e84f578ede7d97eb0205a9/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:15.880620 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62142d-8901-48db-a860-af2ac15ddd69 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:15.881056 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62142d-8901-48db-a860-af2ac15ddd69 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:15.881663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62142d-8901-48db-a860-af2ac15ddd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:15.895867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:15.934063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9c62142d-8901-48db-a860-af2ac15ddd69 None None] MFA Rules not processed for user `6b8dfe73d8e84f578ede7d97eb0205a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:15.936242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9c62142d-8901-48db-a860-af2ac15ddd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:16.089331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 966/1917] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:16.256391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c0a3c-7647-4269-83d4-a6f0f5be6ca5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:16.341779 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c0a3c-7647-4269-83d4-a6f0f5be6ca5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:16.345655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eb091-587a-4d65-b4ea-b1173b215d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:16.346617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eb091-587a-4d65-b4ea-b1173b215d7e service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:16.347548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eb091-587a-4d65-b4ea-b1173b215d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:16.347838 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eb091-587a-4d65-b4ea-b1173b215d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:16.372820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8eb091-587a-4d65-b4ea-b1173b215d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:16.374287 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8eb091-587a-4d65-b4ea-b1173b215d7e service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:16.418761 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 952/1918] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:16.620209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62142d-8901-48db-a860-af2ac15ddd69 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:16.621629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9c62142d-8901-48db-a860-af2ac15ddd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:16.682037 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eb091-587a-4d65-b4ea-b1173b215d7e service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:16.721609 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62142d-8901-48db-a860-af2ac15ddd69 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:16.727012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21272c91-7e3a-4a4a-a7dd-f6093d3faf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:16.728217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21272c91-7e3a-4a4a-a7dd-f6093d3faf98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:16.728507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21272c91-7e3a-4a4a-a7dd-f6093d3faf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:16.728818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21272c91-7e3a-4a4a-a7dd-f6093d3faf98 admin admin] PATH_INFO: `/v3/users/54bd589d820b4eff80b90bb97801a3e7` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:16.730212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21272c91-7e3a-4a4a-a7dd-f6093d3faf98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54bd589d820b4eff80b90bb97801a3e7)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:16.732983 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21272c91-7e3a-4a4a-a7dd-f6093d3faf98 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:16.771074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eb091-587a-4d65-b4ea-b1173b215d7e service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:16.777976 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82714b0-8c29-486c-ba8e-8737f2596465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:16.779230 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82714b0-8c29-486c-ba8e-8737f2596465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:16.779689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82714b0-8c29-486c-ba8e-8737f2596465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:16.780115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82714b0-8c29-486c-ba8e-8737f2596465 admin admin] PATH_INFO: `/v3/users/a96f24f9a0e1430d9559de99826e67b0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:16.781900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82714b0-8c29-486c-ba8e-8737f2596465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a96f24f9a0e1430d9559de99826e67b0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:16.784629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82714b0-8c29-486c-ba8e-8737f2596465 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:16.798577 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-21272c91-7e3a-4a4a-a7dd-f6093d3faf98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54bd589d820b4eff80b90bb97801a3e7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:16.817495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-21272c91-7e3a-4a4a-a7dd-f6093d3faf98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54bd589d820b4eff80b90bb97801a3e7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:16.818558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-21272c91-7e3a-4a4a-a7dd-f6093d3faf98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54bd589d820b4eff80b90bb97801a3e7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:16.819292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-21272c91-7e3a-4a4a-a7dd-f6093d3faf98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54bd589d820b4eff80b90bb97801a3e7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:16.830845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-21272c91-7e3a-4a4a-a7dd-f6093d3faf98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54bd589d820b4eff80b90bb97801a3e7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:16.870304 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b82714b0-8c29-486c-ba8e-8737f2596465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a96f24f9a0e1430d9559de99826e67b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:16.870304 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b82714b0-8c29-486c-ba8e-8737f2596465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a96f24f9a0e1430d9559de99826e67b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:16.871708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 967/1919] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:16 2022] DELETE /identity/v3/users/54bd589d820b4eff80b90bb97801a3e7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:16.876607 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8deb4-f48c-4a69-a4ed-049e739b3344 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:16.876917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8deb4-f48c-4a69-a4ed-049e739b3344 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:16.877205 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8deb4-f48c-4a69-a4ed-049e739b3344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:16.890185 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:16.893478 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b82714b0-8c29-486c-ba8e-8737f2596465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a96f24f9a0e1430d9559de99826e67b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:16.895241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b82714b0-8c29-486c-ba8e-8737f2596465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a96f24f9a0e1430d9559de99826e67b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:16.901664 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d4f8deb4-f48c-4a69-a4ed-049e739b3344 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:16.903024 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d4f8deb4-f48c-4a69-a4ed-049e739b3344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:16.912699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b82714b0-8c29-486c-ba8e-8737f2596465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a96f24f9a0e1430d9559de99826e67b0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:16.922765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:16.941562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 953/1920] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:16 2022] DELETE /identity/v3/users/a96f24f9a0e1430d9559de99826e67b0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:16.964044 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e110e19-4b95-4a9a-b3a6-48f8f6a46c11 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:16.964540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e110e19-4b95-4a9a-b3a6-48f8f6a46c11 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:16.966101 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e110e19-4b95-4a9a-b3a6-48f8f6a46c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:16.989155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0e110e19-4b95-4a9a-b3a6-48f8f6a46c11 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:16.990411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0e110e19-4b95-4a9a-b3a6-48f8f6a46c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:17.047629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 968/1921] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:17.058791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8deb4-f48c-4a69-a4ed-049e739b3344 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:17.061144 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d4f8deb4-f48c-4a69-a4ed-049e739b3344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:17.090810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 954/1922] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:17.121980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e110e19-4b95-4a9a-b3a6-48f8f6a46c11 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:17.123778 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0e110e19-4b95-4a9a-b3a6-48f8f6a46c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:17.137823 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8deb4-f48c-4a69-a4ed-049e739b3344 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:17.204673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e110e19-4b95-4a9a-b3a6-48f8f6a46c11 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:17.210386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b63b6-44ff-474d-b0d8-9c8a86d52d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:17.211077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b63b6-44ff-474d-b0d8-9c8a86d52d0e service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:17.211361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b63b6-44ff-474d-b0d8-9c8a86d52d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:17.211643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b63b6-44ff-474d-b0d8-9c8a86d52d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:17.213983 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebc75b-2bad-4d0f-bf85-1e47fea3fffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:17.214761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebc75b-2bad-4d0f-bf85-1e47fea3fffa service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:17.215028 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebc75b-2bad-4d0f-bf85-1e47fea3fffa service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:17.215307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebc75b-2bad-4d0f-bf85-1e47fea3fffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:17.222026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b63b6-44ff-474d-b0d8-9c8a86d52d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:17.223374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b63b6-44ff-474d-b0d8-9c8a86d52d0e service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:17.225736 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebc75b-2bad-4d0f-bf85-1e47fea3fffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:17.227655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebc75b-2bad-4d0f-bf85-1e47fea3fffa service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:17.233951 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 955/1923] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:17.238393 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 969/1924] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:17.717622 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b63b6-44ff-474d-b0d8-9c8a86d52d0e service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:17.719616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-777b63b6-44ff-474d-b0d8-9c8a86d52d0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:17.736629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b63b6-44ff-474d-b0d8-9c8a86d52d0e service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:17.744534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:17.745866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:17.746394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:17.746853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6 admin admin] PATH_INFO: `/v3/projects/73dfba55abea4c24812edf57e01b7522` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:17.749131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73dfba55abea4c24812edf57e01b7522)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:17.750813 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebc75b-2bad-4d0f-bf85-1e47fea3fffa service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:17.752234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-feebc75b-2bad-4d0f-bf85-1e47fea3fffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:17.753513 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:17.774496 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebc75b-2bad-4d0f-bf85-1e47fea3fffa service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:17.792412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3cb1c-eeba-411d-8f23-f4b660012ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:17.793720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3cb1c-eeba-411d-8f23-f4b660012ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:17.794310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3cb1c-eeba-411d-8f23-f4b660012ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:17.794782 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3cb1c-eeba-411d-8f23-f4b660012ac5 admin admin] PATH_INFO: `/v3/projects/d412fc554ccb45b7a4e7283feff7e743` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:17.796156 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3cb1c-eeba-411d-8f23-f4b660012ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d412fc554ccb45b7a4e7283feff7e743)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:17.798250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3cb1c-eeba-411d-8f23-f4b660012ac5 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:17.845431 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73dfba55abea4c24812edf57e01b7522', 'request_id': 'req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:17.853591 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73dfba55abea4c24812edf57e01b7522', 'request_id': 'req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:17.872887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73dfba55abea4c24812edf57e01b7522', 'request_id': 'req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:17.897575 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-65d3cb1c-eeba-411d-8f23-f4b660012ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd412fc554ccb45b7a4e7283feff7e743', 'request_id': 'req-65d3cb1c-eeba-411d-8f23-f4b660012ac5'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:17.904749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-65d3cb1c-eeba-411d-8f23-f4b660012ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd412fc554ccb45b7a4e7283feff7e743', 'request_id': 'req-65d3cb1c-eeba-411d-8f23-f4b660012ac5'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:17.905094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6 admin admin] The token cache is being invalidate because project 73dfba55abea4c24812edf57e01b7522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:17.905393 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:17.909627 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:17.916706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-65d3cb1c-eeba-411d-8f23-f4b660012ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd412fc554ccb45b7a4e7283feff7e743', 'request_id': 'req-65d3cb1c-eeba-411d-8f23-f4b660012ac5'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:17.918420 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:17.925155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 956/1925] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:17 2022] DELETE /identity/v3/projects/73dfba55abea4c24812edf57e01b7522 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:17.927438 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:17.930368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:17.939267 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-65d3cb1c-eeba-411d-8f23-f4b660012ac5 admin admin] The token cache is being invalidate because project d412fc554ccb45b7a4e7283feff7e743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:17.940273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-65d3cb1c-eeba-411d-8f23-f4b660012ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:17.943306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-65d3cb1c-eeba-411d-8f23-f4b660012ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:17.947751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 970/1926] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:17 2022] DELETE /identity/v3/projects/d412fc554ccb45b7a4e7283feff7e743 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:17.948135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:17.951732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3cb1c-eeba-411d-8f23-f4b660012ac5 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:17.957135 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-65d3cb1c-eeba-411d-8f23-f4b660012ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:18.100379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3cb1c-eeba-411d-8f23-f4b660012ac5 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:18.110423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dafc9-527e-4c56-bba5-008202dde6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:18.111392 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d72da-9f06-4cb0-8c45-8a4598d61cd6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:18.111722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dafc9-527e-4c56-bba5-008202dde6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:18.112109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dafc9-527e-4c56-bba5-008202dde6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:18.112386 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dafc9-527e-4c56-bba5-008202dde6b6 admin admin] PATH_INFO: `/v3/users/54bf269d70bf4973aac1379e5a2b3700` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:18.114777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dafc9-527e-4c56-bba5-008202dde6b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54bf269d70bf4973aac1379e5a2b3700)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:18.116768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dafc9-527e-4c56-bba5-008202dde6b6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:18.133267 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40af46-fcd7-4f78-8946-d27201f55ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:18.134342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40af46-fcd7-4f78-8946-d27201f55ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:18.135331 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40af46-fcd7-4f78-8946-d27201f55ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:18.135331 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40af46-fcd7-4f78-8946-d27201f55ba2 admin admin] PATH_INFO: `/v3/users/6b8dfe73d8e84f578ede7d97eb0205a9` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:18.136306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40af46-fcd7-4f78-8946-d27201f55ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8dfe73d8e84f578ede7d97eb0205a9)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:18.138392 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40af46-fcd7-4f78-8946-d27201f55ba2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:18.217912 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a10dafc9-527e-4c56-bba5-008202dde6b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54bf269d70bf4973aac1379e5a2b3700'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:18.250335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a10dafc9-527e-4c56-bba5-008202dde6b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54bf269d70bf4973aac1379e5a2b3700'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:18.255494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a10dafc9-527e-4c56-bba5-008202dde6b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54bf269d70bf4973aac1379e5a2b3700'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:18.267052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a10dafc9-527e-4c56-bba5-008202dde6b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54bf269d70bf4973aac1379e5a2b3700'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:18.279880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a10dafc9-527e-4c56-bba5-008202dde6b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54bf269d70bf4973aac1379e5a2b3700'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:18.295186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1a40af46-fcd7-4f78-8946-d27201f55ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8dfe73d8e84f578ede7d97eb0205a9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:18.296695 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1a40af46-fcd7-4f78-8946-d27201f55ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8dfe73d8e84f578ede7d97eb0205a9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:18.322967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1a40af46-fcd7-4f78-8946-d27201f55ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8dfe73d8e84f578ede7d97eb0205a9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:18.324554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1a40af46-fcd7-4f78-8946-d27201f55ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8dfe73d8e84f578ede7d97eb0205a9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:18.338377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 971/1927] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:17 2022] DELETE /identity/v3/users/54bf269d70bf4973aac1379e5a2b3700 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:18.341515 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1a40af46-fcd7-4f78-8946-d27201f55ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8dfe73d8e84f578ede7d97eb0205a9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:18.388468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 957/1928] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:17 2022] DELETE /identity/v3/users/6b8dfe73d8e84f578ede7d97eb0205a9 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:19.058461 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dafc9-527e-4c56-bba5-008202dde6b6 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:19.059690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a10dafc9-527e-4c56-bba5-008202dde6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:19.124947 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40af46-fcd7-4f78-8946-d27201f55ba2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:19.127153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1a40af46-fcd7-4f78-8946-d27201f55ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:19.210755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dafc9-527e-4c56-bba5-008202dde6b6 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:19.235417 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40af46-fcd7-4f78-8946-d27201f55ba2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:19.236096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:19.253164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ebb2c-5cbd-4652-b897-e4f71c1c51d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:19.254060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ebb2c-5cbd-4652-b897-e4f71c1c51d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:19.254366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ebb2c-5cbd-4652-b897-e4f71c1c51d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:19.254854 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ebb2c-5cbd-4652-b897-e4f71c1c51d1 admin admin] PATH_INFO: `/v3/projects/94ced6f1bb9f4545aad05e543831c87f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:19.256357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ebb2c-5cbd-4652-b897-e4f71c1c51d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ced6f1bb9f4545aad05e543831c87f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:19.258228 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ebb2c-5cbd-4652-b897-e4f71c1c51d1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:19.305419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:19.306943 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:19.307700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:19.308242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b admin admin] PATH_INFO: `/v3/projects/bad1a1fec9a34735b8b03bcc07baf1cd` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:19.310996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bad1a1fec9a34735b8b03bcc07baf1cd)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:19.314535 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:19.337493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:19.390398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-855ebb2c-5cbd-4652-b897-e4f71c1c51d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ced6f1bb9f4545aad05e543831c87f', 'request_id': 'req-855ebb2c-5cbd-4652-b897-e4f71c1c51d1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:19.401382 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-855ebb2c-5cbd-4652-b897-e4f71c1c51d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ced6f1bb9f4545aad05e543831c87f', 'request_id': 'req-855ebb2c-5cbd-4652-b897-e4f71c1c51d1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:19.413516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-855ebb2c-5cbd-4652-b897-e4f71c1c51d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ced6f1bb9f4545aad05e543831c87f', 'request_id': 'req-855ebb2c-5cbd-4652-b897-e4f71c1c51d1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:19.415719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bad1a1fec9a34735b8b03bcc07baf1cd', 'request_id': 'req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:19.430403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bad1a1fec9a34735b8b03bcc07baf1cd', 'request_id': 'req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:19.444492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bad1a1fec9a34735b8b03bcc07baf1cd', 'request_id': 'req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:19.450922 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-855ebb2c-5cbd-4652-b897-e4f71c1c51d1 admin admin] The token cache is being invalidate because project 94ced6f1bb9f4545aad05e543831c87f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:19.451466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-855ebb2c-5cbd-4652-b897-e4f71c1c51d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:19.452305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-855ebb2c-5cbd-4652-b897-e4f71c1c51d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:19.454570 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 958/1929] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:19 2022] DELETE /identity/v3/projects/94ced6f1bb9f4545aad05e543831c87f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:19.461785 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a544b5c-4dee-4754-a287-53514f6aadd9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:19.462705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a544b5c-4dee-4754-a287-53514f6aadd9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:19.463034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a544b5c-4dee-4754-a287-53514f6aadd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:19.467604 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b admin admin] The token cache is being invalidate because project bad1a1fec9a34735b8b03bcc07baf1cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:19.467901 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:19.468595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:19.470462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 972/1930] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:19 2022] DELETE /identity/v3/projects/bad1a1fec9a34735b8b03bcc07baf1cd => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:19.473832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:19.475351 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:19.492535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0a544b5c-4dee-4754-a287-53514f6aadd9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:19.494824 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0a544b5c-4dee-4754-a287-53514f6aadd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:19.571401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c105fe-f83b-4023-b7d8-ff6817fd2f6b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:19.577353 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f3301-4ce5-4f33-b8f1-f81990a3086c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:19.587846 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f3301-4ce5-4f33-b8f1-f81990a3086c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:19.587846 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f3301-4ce5-4f33-b8f1-f81990a3086c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:19.587846 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f3301-4ce5-4f33-b8f1-f81990a3086c admin admin] PATH_INFO: `/v3/users/2f9baa38402a43228ba41e3bd589aa3e` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:19.587846 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f3301-4ce5-4f33-b8f1-f81990a3086c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f9baa38402a43228ba41e3bd589aa3e)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:19.590074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f3301-4ce5-4f33-b8f1-f81990a3086c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:19.595566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 959/1931] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:19.602513 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e88726-986c-4d5e-b64b-3c18079765e0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:19.602806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e88726-986c-4d5e-b64b-3c18079765e0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:19.603353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e88726-986c-4d5e-b64b-3c18079765e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:19.626126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d5e88726-986c-4d5e-b64b-3c18079765e0 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:19.627179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d5e88726-986c-4d5e-b64b-3c18079765e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:19.642465 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 960/1932] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:19.647705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e88726-986c-4d5e-b64b-3c18079765e0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:19.658219 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e88726-986c-4d5e-b64b-3c18079765e0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:19.663897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d6904-5799-41de-9960-1946e589b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:19.664491 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d6904-5799-41de-9960-1946e589b20c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:19.664784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d6904-5799-41de-9960-1946e589b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:19.665118 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d6904-5799-41de-9960-1946e589b20c admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:19.666001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d6904-5799-41de-9960-1946e589b20c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:19.666327 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d6904-5799-41de-9960-1946e589b20c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:19.668121 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-093f3301-4ce5-4f33-b8f1-f81990a3086c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f9baa38402a43228ba41e3bd589aa3e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:19.668276 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d6904-5799-41de-9960-1946e589b20c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:19.685427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 961/1933] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:19.685856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:19.686912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d6904-5799-41de-9960-1946e589b20c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:19.700361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d6904-5799-41de-9960-1946e589b20c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:19.707020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde1e08-5d36-4201-a6b0-7feb781aeb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:19.708102 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1e08-5d36-4201-a6b0-7feb781aeb9f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:19.708372 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1e08-5d36-4201-a6b0-7feb781aeb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:19.708880 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1e08-5d36-4201-a6b0-7feb781aeb9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:19.709581 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde1e08-5d36-4201-a6b0-7feb781aeb9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:19.711113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-093f3301-4ce5-4f33-b8f1-f81990a3086c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f9baa38402a43228ba41e3bd589aa3e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:19.711613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde1e08-5d36-4201-a6b0-7feb781aeb9f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:19.712536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-093f3301-4ce5-4f33-b8f1-f81990a3086c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f9baa38402a43228ba41e3bd589aa3e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:19.713272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-093f3301-4ce5-4f33-b8f1-f81990a3086c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f9baa38402a43228ba41e3bd589aa3e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:19.723651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-093f3301-4ce5-4f33-b8f1-f81990a3086c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f9baa38402a43228ba41e3bd589aa3e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:19.742415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 962/1934] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:19 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:19.746649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 973/1935] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:19 2022] DELETE /identity/v3/users/2f9baa38402a43228ba41e3bd589aa3e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:19.747771 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde1e08-5d36-4201-a6b0-7feb781aeb9f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:19.749637 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1fde1e08-5d36-4201-a6b0-7feb781aeb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:19.854539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde1e08-5d36-4201-a6b0-7feb781aeb9f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:19.881196 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:19.938475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e43d6-f9ed-454b-a864-1005878d0a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:19.939299 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e43d6-f9ed-454b-a864-1005878d0a21 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:19.939742 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e43d6-f9ed-454b-a864-1005878d0a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:19.940288 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e43d6-f9ed-454b-a864-1005878d0a21 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:19.941492 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e43d6-f9ed-454b-a864-1005878d0a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:19.943205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e43d6-f9ed-454b-a864-1005878d0a21 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:19.967531 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 963/1936] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:19 2022] POST /identity/v3/users => generated 305 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:19.974160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f3301-4ce5-4f33-b8f1-f81990a3086c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:19.987894 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f3301-4ce5-4f33-b8f1-f81990a3086c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:19.993223 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc20c9-0761-49a7-b4dc-0524fd0ead2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:19.993994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc20c9-0761-49a7-b4dc-0524fd0ead2e admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:19.994775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc20c9-0761-49a7-b4dc-0524fd0ead2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:19.994856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc20c9-0761-49a7-b4dc-0524fd0ead2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:19.995692 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc20c9-0761-49a7-b4dc-0524fd0ead2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:19.997403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc20c9-0761-49a7-b4dc-0524fd0ead2e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:20.025549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 974/1937] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:17:20.029790 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e43d6-f9ed-454b-a864-1005878d0a21 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:20.054934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e43d6-f9ed-454b-a864-1005878d0a21 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:20.063344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc4374-bb3f-429a-8049-0835c85486ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:20.065204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc4374-bb3f-429a-8049-0835c85486ce admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:20.066167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc4374-bb3f-429a-8049-0835c85486ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:20.066802 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc4374-bb3f-429a-8049-0835c85486ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:20.068243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc4374-bb3f-429a-8049-0835c85486ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:20.070324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc4374-bb3f-429a-8049-0835c85486ce admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:20.088206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 964/1938] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:20.090114 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc20c9-0761-49a7-b4dc-0524fd0ead2e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:20.106333 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc20c9-0761-49a7-b4dc-0524fd0ead2e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:20.111792 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02f786-7414-4bad-88ff-9f3f8a76e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:20.113984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02f786-7414-4bad-88ff-9f3f8a76e43e admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:20.114393 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02f786-7414-4bad-88ff-9f3f8a76e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:20.114819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02f786-7414-4bad-88ff-9f3f8a76e43e admin admin] PATH_INFO: `/v3/projects/02345de5e99942a086a21e1a31be10c4/users/faa588b89a18447bb0fdaf2fcaff9a5a/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:20.133701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02f786-7414-4bad-88ff-9f3f8a76e43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=02345de5e99942a086a21e1a31be10c4, user_id=faa588b89a18447bb0fdaf2fcaff9a5a, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:20.136911 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02f786-7414-4bad-88ff-9f3f8a76e43e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:20.165532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 975/1939] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:20 2022] PUT /identity/v3/projects/02345de5e99942a086a21e1a31be10c4/users/faa588b89a18447bb0fdaf2fcaff9a5a/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:20.179090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b74a2-e9cc-4f7b-9081-cb985cc3690d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:20.179633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b74a2-e9cc-4f7b-9081-cb985cc3690d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:20.179724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b74a2-e9cc-4f7b-9081-cb985cc3690d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:20.199358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02f786-7414-4bad-88ff-9f3f8a76e43e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:20.205071 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5a02f786-7414-4bad-88ff-9f3f8a76e43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:20.225060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cd2b74a2-e9cc-4f7b-9081-cb985cc3690d None None] MFA Rules not processed for user `faa588b89a18447bb0fdaf2fcaff9a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:20.226754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cd2b74a2-e9cc-4f7b-9081-cb985cc3690d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:20.326248 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 965/1940] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:20.327604 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b74a2-e9cc-4f7b-9081-cb985cc3690d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:20.362645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02f786-7414-4bad-88ff-9f3f8a76e43e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:20.368240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cfe5a-155a-4901-b67f-06101950691b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:20.369798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cfe5a-155a-4901-b67f-06101950691b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:20.370372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cfe5a-155a-4901-b67f-06101950691b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:20.372167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cfe5a-155a-4901-b67f-06101950691b admin admin] PATH_INFO: `/v3/projects/b4e2f08bf3734f55b2ea0d020684cfc9` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:20.373921 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89cfe5a-155a-4901-b67f-06101950691b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e2f08bf3734f55b2ea0d020684cfc9)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:20.376244 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89cfe5a-155a-4901-b67f-06101950691b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:20.452291 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f89cfe5a-155a-4901-b67f-06101950691b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e2f08bf3734f55b2ea0d020684cfc9', 'request_id': 'req-f89cfe5a-155a-4901-b67f-06101950691b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:20.453211 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b74a2-e9cc-4f7b-9081-cb985cc3690d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:20.460163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f89cfe5a-155a-4901-b67f-06101950691b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e2f08bf3734f55b2ea0d020684cfc9', 'request_id': 'req-f89cfe5a-155a-4901-b67f-06101950691b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:20.470140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f89cfe5a-155a-4901-b67f-06101950691b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e2f08bf3734f55b2ea0d020684cfc9', 'request_id': 'req-f89cfe5a-155a-4901-b67f-06101950691b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:20.488281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f89cfe5a-155a-4901-b67f-06101950691b admin admin] The token cache is being invalidate because project b4e2f08bf3734f55b2ea0d020684cfc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:20.488865 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f89cfe5a-155a-4901-b67f-06101950691b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:20.489825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f89cfe5a-155a-4901-b67f-06101950691b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:20.491896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 976/1941] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:20 2022] DELETE /identity/v3/projects/b4e2f08bf3734f55b2ea0d020684cfc9 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:20.499497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51166b5e-d35e-4144-8f33-8da909d2ddad None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:20.499794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51166b5e-d35e-4144-8f33-8da909d2ddad None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:20.500080 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51166b5e-d35e-4144-8f33-8da909d2ddad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:20.511344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:20.522914 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-51166b5e-d35e-4144-8f33-8da909d2ddad None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:20.524322 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-51166b5e-d35e-4144-8f33-8da909d2ddad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:20.552366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc1214-b01d-406a-b00f-2d50c13cc8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:20.553936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc1214-b01d-406a-b00f-2d50c13cc8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:20.554471 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc1214-b01d-406a-b00f-2d50c13cc8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:20.555008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc1214-b01d-406a-b00f-2d50c13cc8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:20.555760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc1214-b01d-406a-b00f-2d50c13cc8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:20.558409 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc1214-b01d-406a-b00f-2d50c13cc8d4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:20.559370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:20.615312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 977/1942] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:20.623939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 966/1943] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:20 2022] POST /identity/v3/projects => generated 409 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:20.628496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc1214-b01d-406a-b00f-2d50c13cc8d4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:20.628758 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7aa70-ffff-4307-b67d-35ea251ab874 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:20.629642 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7aa70-ffff-4307-b67d-35ea251ab874 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:20.629642 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7aa70-ffff-4307-b67d-35ea251ab874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:20.634410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cfbc1214-b01d-406a-b00f-2d50c13cc8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:20.668473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-eff7aa70-ffff-4307-b67d-35ea251ab874 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:20.669764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-eff7aa70-ffff-4307-b67d-35ea251ab874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:20.760359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc1214-b01d-406a-b00f-2d50c13cc8d4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:20.766798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6265086-b605-45c6-8e40-50f685b8840b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:20.767652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6265086-b605-45c6-8e40-50f685b8840b admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:20.768063 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6265086-b605-45c6-8e40-50f685b8840b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:20.768862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6265086-b605-45c6-8e40-50f685b8840b admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:20.769600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6265086-b605-45c6-8e40-50f685b8840b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:20.771703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6265086-b605-45c6-8e40-50f685b8840b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:20.805167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 967/1944] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:20 2022] POST /identity/v3/users => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:17:20.809086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6265086-b605-45c6-8e40-50f685b8840b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:20.821375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6265086-b605-45c6-8e40-50f685b8840b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:20.827491 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb43cc4-82f9-4d26-b912-8211ce3cbc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:20.828546 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb43cc4-82f9-4d26-b912-8211ce3cbc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:20.828835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb43cc4-82f9-4d26-b912-8211ce3cbc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:20.829115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb43cc4-82f9-4d26-b912-8211ce3cbc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:20.830217 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb43cc4-82f9-4d26-b912-8211ce3cbc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:20.831917 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb43cc4-82f9-4d26-b912-8211ce3cbc6b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:20.838849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 978/1945] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:20.841490 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7aa70-ffff-4307-b67d-35ea251ab874 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:20.854766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7aa70-ffff-4307-b67d-35ea251ab874 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:20.863962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 968/1946] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:20.871934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb43cc4-82f9-4d26-b912-8211ce3cbc6b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:20.872338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df8d2b-d0cb-4518-a912-e5264fcb1081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:20.873275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df8d2b-d0cb-4518-a912-e5264fcb1081 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:20.873568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df8d2b-d0cb-4518-a912-e5264fcb1081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:20.873854 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df8d2b-d0cb-4518-a912-e5264fcb1081 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:20.874659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df8d2b-d0cb-4518-a912-e5264fcb1081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:20.874976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df8d2b-d0cb-4518-a912-e5264fcb1081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:20.876614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df8d2b-d0cb-4518-a912-e5264fcb1081 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:20.887674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb43cc4-82f9-4d26-b912-8211ce3cbc6b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:20.905776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 979/1947] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:17:20.907234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df8d2b-d0cb-4518-a912-e5264fcb1081 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:20.908475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306997b-2bba-464d-bcca-a70af7d1a527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:20.912193 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306997b-2bba-464d-bcca-a70af7d1a527 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:20.912579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306997b-2bba-464d-bcca-a70af7d1a527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:20.912944 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306997b-2bba-464d-bcca-a70af7d1a527 admin admin] PATH_INFO: `/v3/projects/f1d3bc0ecebf4c2bb6917a00dd8a0310/users/cd1075e46c7a4c448e82b6cc884979e8/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:20.933240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df8d2b-d0cb-4518-a912-e5264fcb1081 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:20.942368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08f8db-b094-4827-8d6c-d526d116d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:20.944809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08f8db-b094-4827-8d6c-d526d116d454 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:20.946084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08f8db-b094-4827-8d6c-d526d116d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:20.951940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08f8db-b094-4827-8d6c-d526d116d454 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:20.954320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08f8db-b094-4827-8d6c-d526d116d454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:20.959800 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08f8db-b094-4827-8d6c-d526d116d454 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:20.960872 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306997b-2bba-464d-bcca-a70af7d1a527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d3bc0ecebf4c2bb6917a00dd8a0310, user_id=cd1075e46c7a4c448e82b6cc884979e8, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:20.979156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306997b-2bba-464d-bcca-a70af7d1a527 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:21.007241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 969/1948] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:20 2022] PUT /identity/v3/projects/f1d3bc0ecebf4c2bb6917a00dd8a0310/users/cd1075e46c7a4c448e82b6cc884979e8/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:21.011635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306997b-2bba-464d-bcca-a70af7d1a527 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:21.032022 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 980/1949] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:20 2022] POST /identity/v3/projects => generated 399 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:21.036471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08f8db-b094-4827-8d6c-d526d116d454 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:21.108632 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306997b-2bba-464d-bcca-a70af7d1a527 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:21.127123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08f8db-b094-4827-8d6c-d526d116d454 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:21.132322 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad4b6e-1110-4df6-9669-8c13b82ef3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:21.133023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad4b6e-1110-4df6-9669-8c13b82ef3ec admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:21.133929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad4b6e-1110-4df6-9669-8c13b82ef3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:21.134224 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad4b6e-1110-4df6-9669-8c13b82ef3ec admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:21.134980 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad4b6e-1110-4df6-9669-8c13b82ef3ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:21.136961 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad4b6e-1110-4df6-9669-8c13b82ef3ec admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:21.140370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:21.175825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 981/1950] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:21 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:17:21.180715 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad4b6e-1110-4df6-9669-8c13b82ef3ec admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:21.194604 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad4b6e-1110-4df6-9669-8c13b82ef3ec admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:21.199734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6809ff-462c-49b2-94ec-d8041d0935d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:21.200531 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6809ff-462c-49b2-94ec-d8041d0935d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:21.200869 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6809ff-462c-49b2-94ec-d8041d0935d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:21.201229 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6809ff-462c-49b2-94ec-d8041d0935d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:21.201659 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4602-20ef-4bd3-9295-51b8d86dbc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:21.202191 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6809ff-462c-49b2-94ec-d8041d0935d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:21.203101 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4602-20ef-4bd3-9295-51b8d86dbc25 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:21.203744 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4602-20ef-4bd3-9295-51b8d86dbc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:21.204010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6809ff-462c-49b2-94ec-d8041d0935d6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:21.204330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4602-20ef-4bd3-9295-51b8d86dbc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:21.205256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4602-20ef-4bd3-9295-51b8d86dbc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:21.208005 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4602-20ef-4bd3-9295-51b8d86dbc25 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:21.222831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 982/1951] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:17:21.224334 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 970/1952] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:21.227075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6809ff-462c-49b2-94ec-d8041d0935d6 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:21.228683 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4602-20ef-4bd3-9295-51b8d86dbc25 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:21.239661 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6809ff-462c-49b2-94ec-d8041d0935d6 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:21.243829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4602-20ef-4bd3-9295-51b8d86dbc25 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:21.245802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceaee47-e931-416a-aa01-e7684c08fdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:21.246546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceaee47-e931-416a-aa01-e7684c08fdae admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:21.246853 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceaee47-e931-416a-aa01-e7684c08fdae admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:21.247193 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceaee47-e931-416a-aa01-e7684c08fdae admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:21.247996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceaee47-e931-416a-aa01-e7684c08fdae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:21.249770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceaee47-e931-416a-aa01-e7684c08fdae admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:21.251156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebbd97-2037-498a-afa4-ad69f81553e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:21.252232 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebbd97-2037-498a-afa4-ad69f81553e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:21.252779 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebbd97-2037-498a-afa4-ad69f81553e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:21.253425 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebbd97-2037-498a-afa4-ad69f81553e4 admin admin] PATH_INFO: `/v3/projects/f1d3bc0ecebf4c2bb6917a00dd8a0310/users/cd1075e46c7a4c448e82b6cc884979e8/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:21.253541 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:21.255655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebbd97-2037-498a-afa4-ad69f81553e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d3bc0ecebf4c2bb6917a00dd8a0310, user_id=cd1075e46c7a4c448e82b6cc884979e8, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:21.258849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebbd97-2037-498a-afa4-ad69f81553e4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:21.266755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 983/1953] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:21.269548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceaee47-e931-416a-aa01-e7684c08fdae admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:21.273263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 971/1954] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:21 2022] PUT /identity/v3/projects/f1d3bc0ecebf4c2bb6917a00dd8a0310/users/cd1075e46c7a4c448e82b6cc884979e8/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:21.284532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1c6b1-7c5f-4735-bd42-c7db45f5fd27 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:21.284962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1c6b1-7c5f-4735-bd42-c7db45f5fd27 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:21.285676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1c6b1-7c5f-4735-bd42-c7db45f5fd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:21.288193 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceaee47-e931-416a-aa01-e7684c08fdae admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:21.316691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0ef1c6b1-7c5f-4735-bd42-c7db45f5fd27 None None] MFA Rules not processed for user `cd1075e46c7a4c448e82b6cc884979e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:21.318011 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0ef1c6b1-7c5f-4735-bd42-c7db45f5fd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:21.412637 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66501a7c-e150-44a3-a4b6-a522e38039fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:21.413813 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66501a7c-e150-44a3-a4b6-a522e38039fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:21.414356 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66501a7c-e150-44a3-a4b6-a522e38039fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:21.414725 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66501a7c-e150-44a3-a4b6-a522e38039fc admin admin] PATH_INFO: `/v3/projects/c9eb5a38f8b5402da25cf8ec46c6d1d9/users/f9071fed7ca7461c9d190d5e9353a842/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:21.440134 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66501a7c-e150-44a3-a4b6-a522e38039fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9eb5a38f8b5402da25cf8ec46c6d1d9, user_id=f9071fed7ca7461c9d190d5e9353a842, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:21.449345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66501a7c-e150-44a3-a4b6-a522e38039fc admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:21.480974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 972/1955] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:21 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:21.500456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1c6b1-7c5f-4735-bd42-c7db45f5fd27 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:21.502793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 984/1956] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:21 2022] PUT /identity/v3/projects/c9eb5a38f8b5402da25cf8ec46c6d1d9/users/f9071fed7ca7461c9d190d5e9353a842/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:21.505149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0ef1c6b1-7c5f-4735-bd42-c7db45f5fd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:21.507674 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcb662-6df5-4b5e-8e3a-b346b1f4f186 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:21.508088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcb662-6df5-4b5e-8e3a-b346b1f4f186 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:21.508475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcb662-6df5-4b5e-8e3a-b346b1f4f186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:21.585373 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0adcb662-6df5-4b5e-8e3a-b346b1f4f186 None None] MFA Rules not processed for user `f9071fed7ca7461c9d190d5e9353a842`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:21.587460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0adcb662-6df5-4b5e-8e3a-b346b1f4f186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:21.612655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1c6b1-7c5f-4735-bd42-c7db45f5fd27 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:21.704925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:21.720308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bd9ee-50db-4b32-8f03-89e633864ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:21.721310 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bd9ee-50db-4b32-8f03-89e633864ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:21.721713 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bd9ee-50db-4b32-8f03-89e633864ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:21.721997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bd9ee-50db-4b32-8f03-89e633864ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:21.733137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 985/1957] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:21.739015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcb662-6df5-4b5e-8e3a-b346b1f4f186 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:21.817675 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcb662-6df5-4b5e-8e3a-b346b1f4f186 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:21.823642 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de98ce-f800-4d81-9f9c-867197797d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:21.824428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de98ce-f800-4d81-9f9c-867197797d70 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:21.824610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de98ce-f800-4d81-9f9c-867197797d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:21.824893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de98ce-f800-4d81-9f9c-867197797d70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:21.825590 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de98ce-f800-4d81-9f9c-867197797d70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:21.827694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de98ce-f800-4d81-9f9c-867197797d70 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:21.831553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bd9ee-50db-4b32-8f03-89e633864ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:21.833394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bd9ee-50db-4b32-8f03-89e633864ef0 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:21.845611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 973/1958] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:21 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:21.855285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:21.873213 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 986/1959] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:21 2022] POST /identity/v3/projects => generated 401 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:17:21.874223 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bd9ee-50db-4b32-8f03-89e633864ef0 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:21.888047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bd9ee-50db-4b32-8f03-89e633864ef0 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:21.975977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf3f6b-3bd8-4aca-89ed-25139c56fdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:21.977376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf3f6b-3bd8-4aca-89ed-25139c56fdbe admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:21.977935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf3f6b-3bd8-4aca-89ed-25139c56fdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:21.979370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf3f6b-3bd8-4aca-89ed-25139c56fdbe admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:21.980211 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf3f6b-3bd8-4aca-89ed-25139c56fdbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:21.983154 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf3f6b-3bd8-4aca-89ed-25139c56fdbe admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:22.019331 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 974/1960] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:21 2022] POST /identity/v3/users => generated 307 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:22.023263 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de98ce-f800-4d81-9f9c-867197797d70 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:22.034905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de98ce-f800-4d81-9f9c-867197797d70 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:22.039638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7fc1c-f62a-4791-96fa-4dc6057541b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:22.040311 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7fc1c-f62a-4791-96fa-4dc6057541b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:22.040603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7fc1c-f62a-4791-96fa-4dc6057541b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:22.040880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7fc1c-f62a-4791-96fa-4dc6057541b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:22.041686 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7fc1c-f62a-4791-96fa-4dc6057541b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:22.043564 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7fc1c-f62a-4791-96fa-4dc6057541b7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:22.057167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 987/1961] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:22.062296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf3f6b-3bd8-4aca-89ed-25139c56fdbe admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:22.074449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf3f6b-3bd8-4aca-89ed-25139c56fdbe admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:22.083394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc38d94-73a5-4d76-853b-4c3926107535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:22.084276 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc38d94-73a5-4d76-853b-4c3926107535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:22.084560 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc38d94-73a5-4d76-853b-4c3926107535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:22.084841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc38d94-73a5-4d76-853b-4c3926107535 admin admin] PATH_INFO: `/v3/projects/9a8cd61d09c848beba76eeed9021f7c1/users/c5217ac29ef5470aa785bd9fe8eed5e4/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:22.100849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7fc1c-f62a-4791-96fa-4dc6057541b7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:22.102726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c7e7fc1c-f62a-4791-96fa-4dc6057541b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:22.116559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc38d94-73a5-4d76-853b-4c3926107535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8cd61d09c848beba76eeed9021f7c1, user_id=c5217ac29ef5470aa785bd9fe8eed5e4, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:22.119836 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc38d94-73a5-4d76-853b-4c3926107535 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:22.120311 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7fc1c-f62a-4791-96fa-4dc6057541b7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:22.125521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e986ab-299e-417a-9660-6ab6dd0ea0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:22.126420 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e986ab-299e-417a-9660-6ab6dd0ea0d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:22.126862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e986ab-299e-417a-9660-6ab6dd0ea0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:22.127217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e986ab-299e-417a-9660-6ab6dd0ea0d9 admin admin] PATH_INFO: `/v3/users/d967b6c6cf374fe68e2ab2f73e18b6cb` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:22.128867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e986ab-299e-417a-9660-6ab6dd0ea0d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d967b6c6cf374fe68e2ab2f73e18b6cb)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:22.131030 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e986ab-299e-417a-9660-6ab6dd0ea0d9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:22.138656 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 975/1962] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:22 2022] PUT /identity/v3/projects/9a8cd61d09c848beba76eeed9021f7c1/users/c5217ac29ef5470aa785bd9fe8eed5e4/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:22.141596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc38d94-73a5-4d76-853b-4c3926107535 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:22.141596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ecc38d94-73a5-4d76-853b-4c3926107535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:22.197494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82e986ab-299e-417a-9660-6ab6dd0ea0d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd967b6c6cf374fe68e2ab2f73e18b6cb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:22.216768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc38d94-73a5-4d76-853b-4c3926107535 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:22.227142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418b723-7389-45fe-8f33-936fb36dd1c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:22.227955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418b723-7389-45fe-8f33-936fb36dd1c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:22.228506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418b723-7389-45fe-8f33-936fb36dd1c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:22.228723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418b723-7389-45fe-8f33-936fb36dd1c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:22.230776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8418b723-7389-45fe-8f33-936fb36dd1c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:22.246180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82e986ab-299e-417a-9660-6ab6dd0ea0d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd967b6c6cf374fe68e2ab2f73e18b6cb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:22.248682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82e986ab-299e-417a-9660-6ab6dd0ea0d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd967b6c6cf374fe68e2ab2f73e18b6cb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:22.250958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82e986ab-299e-417a-9660-6ab6dd0ea0d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd967b6c6cf374fe68e2ab2f73e18b6cb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:22.254006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:22.271147 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-82e986ab-299e-417a-9660-6ab6dd0ea0d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd967b6c6cf374fe68e2ab2f73e18b6cb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:22.305785 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 988/1963] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:22 2022] DELETE /identity/v3/users/d967b6c6cf374fe68e2ab2f73e18b6cb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:22.305785 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e986ab-299e-417a-9660-6ab6dd0ea0d9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:22.307831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-82e986ab-299e-417a-9660-6ab6dd0ea0d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:22.333682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418b723-7389-45fe-8f33-936fb36dd1c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:22.335921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418b723-7389-45fe-8f33-936fb36dd1c0 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:22.375829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 976/1964] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:22 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:22.377998 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543005-3de2-4d19-8f00-381d98bae4ee None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:22.378361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543005-3de2-4d19-8f00-381d98bae4ee None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:22.378946 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543005-3de2-4d19-8f00-381d98bae4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:22.436674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a1543005-3de2-4d19-8f00-381d98bae4ee None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:22.438602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a1543005-3de2-4d19-8f00-381d98bae4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:22.452099 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 977/1965] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:22.457527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e986ab-299e-417a-9660-6ab6dd0ea0d9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:22.460652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1543005-3de2-4d19-8f00-381d98bae4ee None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:22.462205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a1543005-3de2-4d19-8f00-381d98bae4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:22.462602 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe872c2-2484-40f9-ae90-260a070b2d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:22.463657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe872c2-2484-40f9-ae90-260a070b2d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:22.464009 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe872c2-2484-40f9-ae90-260a070b2d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:22.466313 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe872c2-2484-40f9-ae90-260a070b2d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:22.467710 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe872c2-2484-40f9-ae90-260a070b2d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:22.469618 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe872c2-2484-40f9-ae90-260a070b2d0e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:22.486402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 989/1966] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:22.487710 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe872c2-2484-40f9-ae90-260a070b2d0e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:22.508842 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe872c2-2484-40f9-ae90-260a070b2d0e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:22.517783 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c57d3-a01f-460a-ab64-9c745876ab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:22.521010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c57d3-a01f-460a-ab64-9c745876ab10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:22.521150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c57d3-a01f-460a-ab64-9c745876ab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:22.521440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c57d3-a01f-460a-ab64-9c745876ab10 admin admin] PATH_INFO: `/v3/projects/9a8cd61d09c848beba76eeed9021f7c1/users/c5217ac29ef5470aa785bd9fe8eed5e4/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:22.525500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c57d3-a01f-460a-ab64-9c745876ab10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8cd61d09c848beba76eeed9021f7c1, user_id=c5217ac29ef5470aa785bd9fe8eed5e4, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:22.530154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c57d3-a01f-460a-ab64-9c745876ab10 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:22.544420 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1543005-3de2-4d19-8f00-381d98bae4ee None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:22.546452 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 990/1967] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:22 2022] PUT /identity/v3/projects/9a8cd61d09c848beba76eeed9021f7c1/users/c5217ac29ef5470aa785bd9fe8eed5e4/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:22.557480 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594b3c3-3f07-4d76-9e08-701580d40c5c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:22.557774 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594b3c3-3f07-4d76-9e08-701580d40c5c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:22.558183 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594b3c3-3f07-4d76-9e08-701580d40c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:22.590965 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0594b3c3-3f07-4d76-9e08-701580d40c5c None None] MFA Rules not processed for user `c5217ac29ef5470aa785bd9fe8eed5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:22.592837 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0594b3c3-3f07-4d76-9e08-701580d40c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:22.613072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f2016-e159-4b38-9b22-975fbc947a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:22.614174 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f2016-e159-4b38-9b22-975fbc947a31 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:22.614499 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f2016-e159-4b38-9b22-975fbc947a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:22.614786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f2016-e159-4b38-9b22-975fbc947a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:22.634614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:22.695662 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 991/1968] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:22 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:22.712173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594b3c3-3f07-4d76-9e08-701580d40c5c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:22.715738 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0594b3c3-3f07-4d76-9e08-701580d40c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:22.737435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f2016-e159-4b38-9b22-975fbc947a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:22.740556 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f2016-e159-4b38-9b22-975fbc947a31 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:22.760984 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 978/1969] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:22.830422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594b3c3-3f07-4d76-9e08-701580d40c5c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:22.835361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1b1af-ad99-4436-85ab-1008600f740a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:22.836181 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1b1af-ad99-4436-85ab-1008600f740a service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:22.836476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1b1af-ad99-4436-85ab-1008600f740a service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:22.836759 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1b1af-ad99-4436-85ab-1008600f740a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:22.851825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1b1af-ad99-4436-85ab-1008600f740a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:22.856612 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1b1af-ad99-4436-85ab-1008600f740a service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:22.883668 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 992/1970] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:22 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:22.973317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f2016-e159-4b38-9b22-975fbc947a31 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:22.987353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f2016-e159-4b38-9b22-975fbc947a31 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:22.992825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9ca70-508a-4d89-97bc-2042c6920681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:22.995154 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9ca70-508a-4d89-97bc-2042c6920681 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:22.995640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9ca70-508a-4d89-97bc-2042c6920681 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:22.996098 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9ca70-508a-4d89-97bc-2042c6920681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:23.000066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-78e9ca70-508a-4d89-97bc-2042c6920681 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:23.031558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:23.118499 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9ca70-508a-4d89-97bc-2042c6920681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:23.120166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9ca70-508a-4d89-97bc-2042c6920681 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:23.146617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 979/1971] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:23.240925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1b1af-ad99-4436-85ab-1008600f740a service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:23.242727 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c3f1b1af-ad99-4436-85ab-1008600f740a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:23.277765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1b1af-ad99-4436-85ab-1008600f740a service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:23.292045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75781cec-c4ae-4548-9767-916a116fff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:23.292608 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75781cec-c4ae-4548-9767-916a116fff18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:23.292960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75781cec-c4ae-4548-9767-916a116fff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:23.293264 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75781cec-c4ae-4548-9767-916a116fff18 admin admin] PATH_INFO: `/v3/projects/f60b6599161f408bbfa82eaf06bb7b25` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:23.296153 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75781cec-c4ae-4548-9767-916a116fff18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60b6599161f408bbfa82eaf06bb7b25)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:23.298513 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75781cec-c4ae-4548-9767-916a116fff18 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:23.389278 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-75781cec-c4ae-4548-9767-916a116fff18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60b6599161f408bbfa82eaf06bb7b25', 'request_id': 'req-75781cec-c4ae-4548-9767-916a116fff18'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:23.401770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-75781cec-c4ae-4548-9767-916a116fff18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60b6599161f408bbfa82eaf06bb7b25', 'request_id': 'req-75781cec-c4ae-4548-9767-916a116fff18'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:23.410954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-75781cec-c4ae-4548-9767-916a116fff18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60b6599161f408bbfa82eaf06bb7b25', 'request_id': 'req-75781cec-c4ae-4548-9767-916a116fff18'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:23.431798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-75781cec-c4ae-4548-9767-916a116fff18 admin admin] The token cache is being invalidate because project f60b6599161f408bbfa82eaf06bb7b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:23.431798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-75781cec-c4ae-4548-9767-916a116fff18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:23.432298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-75781cec-c4ae-4548-9767-916a116fff18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:23.437547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 993/1972] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:23 2022] DELETE /identity/v3/projects/f60b6599161f408bbfa82eaf06bb7b25 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:23.438582 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9ca70-508a-4d89-97bc-2042c6920681 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:23.455076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9ca70-508a-4d89-97bc-2042c6920681 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:23.550735 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f14908-db21-4d53-b22e-5d0549dd44bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:23.551894 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f14908-db21-4d53-b22e-5d0549dd44bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:23.552255 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f14908-db21-4d53-b22e-5d0549dd44bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:23.552644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f14908-db21-4d53-b22e-5d0549dd44bb admin admin] PATH_INFO: `/v3/users/e3dc9c3576544f14ba2ccc2d345ec51d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:23.553988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f14908-db21-4d53-b22e-5d0549dd44bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3dc9c3576544f14ba2ccc2d345ec51d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:23.556498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f14908-db21-4d53-b22e-5d0549dd44bb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:23.632387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e0f14908-db21-4d53-b22e-5d0549dd44bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3dc9c3576544f14ba2ccc2d345ec51d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:23.633308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e0f14908-db21-4d53-b22e-5d0549dd44bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3dc9c3576544f14ba2ccc2d345ec51d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:23.649379 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e0f14908-db21-4d53-b22e-5d0549dd44bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3dc9c3576544f14ba2ccc2d345ec51d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:23.650109 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e0f14908-db21-4d53-b22e-5d0549dd44bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3dc9c3576544f14ba2ccc2d345ec51d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:23.657973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-e0f14908-db21-4d53-b22e-5d0549dd44bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3dc9c3576544f14ba2ccc2d345ec51d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:23.678613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 980/1973] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:23 2022] DELETE /identity/v3/users/e3dc9c3576544f14ba2ccc2d345ec51d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:24.076159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75781cec-c4ae-4548-9767-916a116fff18 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:24.079373 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-75781cec-c4ae-4548-9767-916a116fff18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:24.105690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75781cec-c4ae-4548-9767-916a116fff18 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:24.181164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:24.208033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8976d2-fbc5-4724-b4aa-0bb7eb28f159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:24.208906 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8976d2-fbc5-4724-b4aa-0bb7eb28f159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:24.209190 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8976d2-fbc5-4724-b4aa-0bb7eb28f159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:24.209448 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8976d2-fbc5-4724-b4aa-0bb7eb28f159 admin admin] PATH_INFO: `/v3/projects/fad040937ae74267b2e83438082220d0` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:24.210845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8976d2-fbc5-4724-b4aa-0bb7eb28f159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad040937ae74267b2e83438082220d0)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:24.212779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8976d2-fbc5-4724-b4aa-0bb7eb28f159 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:24.279036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6a8976d2-fbc5-4724-b4aa-0bb7eb28f159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad040937ae74267b2e83438082220d0', 'request_id': 'req-6a8976d2-fbc5-4724-b4aa-0bb7eb28f159'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:24.286869 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6a8976d2-fbc5-4724-b4aa-0bb7eb28f159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad040937ae74267b2e83438082220d0', 'request_id': 'req-6a8976d2-fbc5-4724-b4aa-0bb7eb28f159'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:24.295685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6a8976d2-fbc5-4724-b4aa-0bb7eb28f159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad040937ae74267b2e83438082220d0', 'request_id': 'req-6a8976d2-fbc5-4724-b4aa-0bb7eb28f159'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:24.311579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6a8976d2-fbc5-4724-b4aa-0bb7eb28f159 admin admin] The token cache is being invalidate because project fad040937ae74267b2e83438082220d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:24.312045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6a8976d2-fbc5-4724-b4aa-0bb7eb28f159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:24.312854 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6a8976d2-fbc5-4724-b4aa-0bb7eb28f159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:24.315671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 994/1974] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:24 2022] DELETE /identity/v3/projects/fad040937ae74267b2e83438082220d0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:24.320708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66181182-93b8-4c7e-b120-a8e38f584806 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:24.321005 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66181182-93b8-4c7e-b120-a8e38f584806 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:24.321289 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66181182-93b8-4c7e-b120-a8e38f584806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:24.340131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-66181182-93b8-4c7e-b120-a8e38f584806 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:24.341285 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-66181182-93b8-4c7e-b120-a8e38f584806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:24.391396 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:24.453344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 981/1975] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:24.463589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30cc0a-9cf5-433b-b3e0-81bcc34d1236 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:24.464348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30cc0a-9cf5-433b-b3e0-81bcc34d1236 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:24.465128 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30cc0a-9cf5-433b-b3e0-81bcc34d1236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:24.495040 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6d30cc0a-9cf5-433b-b3e0-81bcc34d1236 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:24.496678 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6d30cc0a-9cf5-433b-b3e0-81bcc34d1236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:24.517741 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 995/1976] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:24.523750 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66181182-93b8-4c7e-b120-a8e38f584806 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:24.537989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66181182-93b8-4c7e-b120-a8e38f584806 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:24.543494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49221703-0b0d-4306-a9f3-887b8157f99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:24.544708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49221703-0b0d-4306-a9f3-887b8157f99e admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:24.545192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49221703-0b0d-4306-a9f3-887b8157f99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:24.545665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49221703-0b0d-4306-a9f3-887b8157f99e admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:24.546716 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49221703-0b0d-4306-a9f3-887b8157f99e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:24.547219 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49221703-0b0d-4306-a9f3-887b8157f99e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:24.549955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49221703-0b0d-4306-a9f3-887b8157f99e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:24.564665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 982/1977] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:24.569255 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30cc0a-9cf5-433b-b3e0-81bcc34d1236 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:24.584921 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30cc0a-9cf5-433b-b3e0-81bcc34d1236 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:24.597094 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151c064-5b0d-4cce-9e1d-4366cbba9f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:24.597707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49221703-0b0d-4306-a9f3-887b8157f99e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:24.598473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151c064-5b0d-4cce-9e1d-4366cbba9f46 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:24.598927 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151c064-5b0d-4cce-9e1d-4366cbba9f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:24.599348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151c064-5b0d-4cce-9e1d-4366cbba9f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:24.600158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-49221703-0b0d-4306-a9f3-887b8157f99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:24.600351 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151c064-5b0d-4cce-9e1d-4366cbba9f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:24.603052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151c064-5b0d-4cce-9e1d-4366cbba9f46 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:24.633290 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49221703-0b0d-4306-a9f3-887b8157f99e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:24.646895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 996/1978] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:24 2022] POST /identity/v3/projects => generated 363 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:24.647204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af47be-5e18-48ad-a854-365a51d3e182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:24.648655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af47be-5e18-48ad-a854-365a51d3e182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:24.650816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151c064-5b0d-4cce-9e1d-4366cbba9f46 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:24.651198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af47be-5e18-48ad-a854-365a51d3e182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:24.652064 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af47be-5e18-48ad-a854-365a51d3e182 admin admin] PATH_INFO: `/v3/users/7c242b41547a4e1ba4aa61d402c0775f` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:24.654241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af47be-5e18-48ad-a854-365a51d3e182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c242b41547a4e1ba4aa61d402c0775f)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:24.656508 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af47be-5e18-48ad-a854-365a51d3e182 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:24.749451 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-76af47be-5e18-48ad-a854-365a51d3e182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c242b41547a4e1ba4aa61d402c0775f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:24.750212 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-76af47be-5e18-48ad-a854-365a51d3e182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c242b41547a4e1ba4aa61d402c0775f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:24.772499 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-76af47be-5e18-48ad-a854-365a51d3e182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c242b41547a4e1ba4aa61d402c0775f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:24.773346 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-76af47be-5e18-48ad-a854-365a51d3e182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c242b41547a4e1ba4aa61d402c0775f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:24.777638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151c064-5b0d-4cce-9e1d-4366cbba9f46 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:24.782444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-76af47be-5e18-48ad-a854-365a51d3e182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c242b41547a4e1ba4aa61d402c0775f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:24.785842 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4874c2-34d4-4dd8-8899-a6172db90352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:24.787110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4874c2-34d4-4dd8-8899-a6172db90352 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:24.787930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4874c2-34d4-4dd8-8899-a6172db90352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:24.788268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4874c2-34d4-4dd8-8899-a6172db90352 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:24.790295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4874c2-34d4-4dd8-8899-a6172db90352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:24.791853 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4874c2-34d4-4dd8-8899-a6172db90352 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:24.823967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 983/1979] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:24 2022] DELETE /identity/v3/users/7c242b41547a4e1ba4aa61d402c0775f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:24.828248 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8dc71-ecd0-4927-b628-3c7a8f64e1d6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:24.828930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8dc71-ecd0-4927-b628-3c7a8f64e1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:24.829683 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8dc71-ecd0-4927-b628-3c7a8f64e1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:24.830241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 997/1980] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:24 2022] POST /identity/v3/users => generated 282 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:24.839103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4874c2-34d4-4dd8-8899-a6172db90352 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:24.841358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-af4874c2-34d4-4dd8-8899-a6172db90352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:24.852379 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5bd8dc71-ecd0-4927-b628-3c7a8f64e1d6 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:24.853871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5bd8dc71-ecd0-4927-b628-3c7a8f64e1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:24.879570 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4874c2-34d4-4dd8-8899-a6172db90352 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:24.959062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:24.999567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 984/1981] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:25.000795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73fd65-a3cc-4416-85e2-af74cdc07787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:25.001513 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73fd65-a3cc-4416-85e2-af74cdc07787 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:25.001802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73fd65-a3cc-4416-85e2-af74cdc07787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:25.005503 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73fd65-a3cc-4416-85e2-af74cdc07787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:25.006295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73fd65-a3cc-4416-85e2-af74cdc07787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:25.007990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73fd65-a3cc-4416-85e2-af74cdc07787 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:25.011202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8dc71-ecd0-4927-b628-3c7a8f64e1d6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:25.015383 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5bd8dc71-ecd0-4927-b628-3c7a8f64e1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:25.036982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 998/1982] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:25.036982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73fd65-a3cc-4416-85e2-af74cdc07787 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:25.038862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-dd73fd65-a3cc-4416-85e2-af74cdc07787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:25.054125 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73fd65-a3cc-4416-85e2-af74cdc07787 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:25.063707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:25.066020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7a93c-80e7-4f49-b792-d9015b3f7292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:25.067319 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7a93c-80e7-4f49-b792-d9015b3f7292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:25.067610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7a93c-80e7-4f49-b792-d9015b3f7292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:25.067891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7a93c-80e7-4f49-b792-d9015b3f7292 admin admin] PATH_INFO: `/v3/users/f851df6cf8f7421ba4eba5246b38443c` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:25.071337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7a93c-80e7-4f49-b792-d9015b3f7292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f851df6cf8f7421ba4eba5246b38443c)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:25.074906 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7a93c-80e7-4f49-b792-d9015b3f7292 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:25.117464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8dc71-ecd0-4927-b628-3c7a8f64e1d6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:25.124464 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842459b-0fcc-4259-8116-38e1d7f6f67b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:25.125387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842459b-0fcc-4259-8116-38e1d7f6f67b service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:25.126943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842459b-0fcc-4259-8116-38e1d7f6f67b service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:25.128034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842459b-0fcc-4259-8116-38e1d7f6f67b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:25.143981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842459b-0fcc-4259-8116-38e1d7f6f67b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:25.144979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842459b-0fcc-4259-8116-38e1d7f6f67b service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:25.156242 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 985/1983] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:25.157177 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842459b-0fcc-4259-8116-38e1d7f6f67b service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:25.169074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-00f7a93c-80e7-4f49-b792-d9015b3f7292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f851df6cf8f7421ba4eba5246b38443c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:25.169809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842459b-0fcc-4259-8116-38e1d7f6f67b service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:25.177338 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3dde0-ea56-43ba-b067-11e07726e577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:25.178324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3dde0-ea56-43ba-b067-11e07726e577 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:25.178905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3dde0-ea56-43ba-b067-11e07726e577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:25.179384 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3dde0-ea56-43ba-b067-11e07726e577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:25.180267 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3dde0-ea56-43ba-b067-11e07726e577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:25.183186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3dde0-ea56-43ba-b067-11e07726e577 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:25.195047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-00f7a93c-80e7-4f49-b792-d9015b3f7292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f851df6cf8f7421ba4eba5246b38443c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:25.197039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-00f7a93c-80e7-4f49-b792-d9015b3f7292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f851df6cf8f7421ba4eba5246b38443c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:25.197458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 986/1984] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:25.198295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-00f7a93c-80e7-4f49-b792-d9015b3f7292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f851df6cf8f7421ba4eba5246b38443c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:25.201767 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3dde0-ea56-43ba-b067-11e07726e577 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:25.203789 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-afc3dde0-ea56-43ba-b067-11e07726e577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:25.209927 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-00f7a93c-80e7-4f49-b792-d9015b3f7292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f851df6cf8f7421ba4eba5246b38443c'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:25.220961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3dde0-ea56-43ba-b067-11e07726e577 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:25.231017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d5de5-c582-4921-8446-31ebd5c3bb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:25.232022 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d5de5-c582-4921-8446-31ebd5c3bb39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:25.232381 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d5de5-c582-4921-8446-31ebd5c3bb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:25.232731 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d5de5-c582-4921-8446-31ebd5c3bb39 admin admin] PATH_INFO: `/v3/projects/68fa26d88a6e4be292ef036169fc667a/users/a966808f77af477e9366ef16dacbdf0a/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:25.263331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 999/1985] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:25 2022] DELETE /identity/v3/users/f851df6cf8f7421ba4eba5246b38443c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:25.264875 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316edb8-157a-4ff7-b512-9132e6a91990 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:25.265171 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316edb8-157a-4ff7-b512-9132e6a91990 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:25.265453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316edb8-157a-4ff7-b512-9132e6a91990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:25.273788 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d5de5-c582-4921-8446-31ebd5c3bb39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fa26d88a6e4be292ef036169fc667a, user_id=a966808f77af477e9366ef16dacbdf0a, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:25.276670 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d5de5-c582-4921-8446-31ebd5c3bb39 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:25.320433 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 987/1986] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:25 2022] PUT /identity/v3/projects/68fa26d88a6e4be292ef036169fc667a/users/a966808f77af477e9366ef16dacbdf0a/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:25.332351 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cac37-ca41-419e-bd5b-f7dbf6e49dd5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:25.332852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cac37-ca41-419e-bd5b-f7dbf6e49dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:25.333324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cac37-ca41-419e-bd5b-f7dbf6e49dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:25.337126 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7316edb8-157a-4ff7-b512-9132e6a91990 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:25.338399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7316edb8-157a-4ff7-b512-9132e6a91990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:25.394707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-159cac37-ca41-419e-bd5b-f7dbf6e49dd5 None None] MFA Rules not processed for user `a966808f77af477e9366ef16dacbdf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:25.396309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-159cac37-ca41-419e-bd5b-f7dbf6e49dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:25.466501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1000/1987] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:25.480852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316edb8-157a-4ff7-b512-9132e6a91990 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:25.510042 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7316edb8-157a-4ff7-b512-9132e6a91990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:25.548669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 988/1988] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:25.550677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cac37-ca41-419e-bd5b-f7dbf6e49dd5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:25.582237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cac37-ca41-419e-bd5b-f7dbf6e49dd5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:25.593800 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa01c2e-e310-4a29-80ec-2bee62e9d117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:25.595524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01c2e-e310-4a29-80ec-2bee62e9d117 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:25.596647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01c2e-e310-4a29-80ec-2bee62e9d117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:25.597184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01c2e-e310-4a29-80ec-2bee62e9d117 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:25.598563 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa01c2e-e310-4a29-80ec-2bee62e9d117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:25.604483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa01c2e-e310-4a29-80ec-2bee62e9d117 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:25.673215 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316edb8-157a-4ff7-b512-9132e6a91990 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:25.679612 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433974d-5ebc-4683-99e3-5bfcd4f9ee98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:25.680448 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433974d-5ebc-4683-99e3-5bfcd4f9ee98 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:25.680998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433974d-5ebc-4683-99e3-5bfcd4f9ee98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:25.680998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433974d-5ebc-4683-99e3-5bfcd4f9ee98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:25.686123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 989/1989] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:25 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:25.687730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa01c2e-e310-4a29-80ec-2bee62e9d117 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:25.730037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:25.750419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433974d-5ebc-4683-99e3-5bfcd4f9ee98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:25.755170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433974d-5ebc-4683-99e3-5bfcd4f9ee98 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:25.792884 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1001/1990] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:25.837056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa01c2e-e310-4a29-80ec-2bee62e9d117 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:25.848235 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dd656-6edd-4dcc-b440-31991163c889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:25.849079 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dd656-6edd-4dcc-b440-31991163c889 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:25.849435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dd656-6edd-4dcc-b440-31991163c889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:25.849780 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dd656-6edd-4dcc-b440-31991163c889 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:25.850586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dd656-6edd-4dcc-b440-31991163c889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:25.853630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dd656-6edd-4dcc-b440-31991163c889 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:25.888303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:25.901867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 990/1991] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:25 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:25.902087 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433974d-5ebc-4683-99e3-5bfcd4f9ee98 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:25.920081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433974d-5ebc-4683-99e3-5bfcd4f9ee98 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:25.932107 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a31fa-7a1b-4ec7-a0dc-352738c591e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:25.933571 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a31fa-7a1b-4ec7-a0dc-352738c591e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:25.933956 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a31fa-7a1b-4ec7-a0dc-352738c591e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:25.934250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a31fa-7a1b-4ec7-a0dc-352738c591e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:25.935581 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a31fa-7a1b-4ec7-a0dc-352738c591e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:25.937647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a31fa-7a1b-4ec7-a0dc-352738c591e6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:25.955656 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dd656-6edd-4dcc-b440-31991163c889 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:25.958314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d80dd656-6edd-4dcc-b440-31991163c889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:25.981388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1002/1992] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:25.984116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dd656-6edd-4dcc-b440-31991163c889 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:25.985541 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a31fa-7a1b-4ec7-a0dc-352738c591e6 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:26.016186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed96bfd-1940-478f-9b35-e5200853d29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:26.017195 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96bfd-1940-478f-9b35-e5200853d29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:26.017491 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96bfd-1940-478f-9b35-e5200853d29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:26.017816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96bfd-1940-478f-9b35-e5200853d29d admin admin] PATH_INFO: `/v3/projects/ab4dd29ed3d64bc7bc540d3001f68e58` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:26.027414 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed96bfd-1940-478f-9b35-e5200853d29d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4dd29ed3d64bc7bc540d3001f68e58)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:26.029903 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed96bfd-1940-478f-9b35-e5200853d29d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:26.032740 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a31fa-7a1b-4ec7-a0dc-352738c591e6 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:26.043520 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3cbc7-58c1-4bd3-b697-5f944d441d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:26.044794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3cbc7-58c1-4bd3-b697-5f944d441d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:26.045093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3cbc7-58c1-4bd3-b697-5f944d441d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:26.045381 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3cbc7-58c1-4bd3-b697-5f944d441d9c admin admin] PATH_INFO: `/v3/projects/7c3ad13321a9433d8d9901174f55d9f9/users/a47578c42b1c47a0a1b8ffb4b06af777/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:26.075788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3cbc7-58c1-4bd3-b697-5f944d441d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3ad13321a9433d8d9901174f55d9f9, user_id=a47578c42b1c47a0a1b8ffb4b06af777, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:26.083328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3cbc7-58c1-4bd3-b697-5f944d441d9c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:26.108501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1003/1993] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:25 2022] PUT /identity/v3/projects/7c3ad13321a9433d8d9901174f55d9f9/users/a47578c42b1c47a0a1b8ffb4b06af777/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:26.114094 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3cbc7-58c1-4bd3-b697-5f944d441d9c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:26.138099 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3ed96bfd-1940-478f-9b35-e5200853d29d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4dd29ed3d64bc7bc540d3001f68e58', 'request_id': 'req-3ed96bfd-1940-478f-9b35-e5200853d29d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:26.145812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3ed96bfd-1940-478f-9b35-e5200853d29d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4dd29ed3d64bc7bc540d3001f68e58', 'request_id': 'req-3ed96bfd-1940-478f-9b35-e5200853d29d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:26.156486 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3ed96bfd-1940-478f-9b35-e5200853d29d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4dd29ed3d64bc7bc540d3001f68e58', 'request_id': 'req-3ed96bfd-1940-478f-9b35-e5200853d29d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:26.177707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3ed96bfd-1940-478f-9b35-e5200853d29d admin admin] The token cache is being invalidate because project ab4dd29ed3d64bc7bc540d3001f68e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:26.178105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3ed96bfd-1940-478f-9b35-e5200853d29d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:26.181437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3ed96bfd-1940-478f-9b35-e5200853d29d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:26.187674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 991/1994] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:25 2022] DELETE /identity/v3/projects/ab4dd29ed3d64bc7bc540d3001f68e58 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:26.243550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3cbc7-58c1-4bd3-b697-5f944d441d9c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:26.404953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70264f-5a1a-479e-a05a-bc5a7392c539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:26.406027 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70264f-5a1a-479e-a05a-bc5a7392c539 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:26.406353 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70264f-5a1a-479e-a05a-bc5a7392c539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:26.406666 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70264f-5a1a-479e-a05a-bc5a7392c539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:26.407491 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70264f-5a1a-479e-a05a-bc5a7392c539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:26.409858 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70264f-5a1a-479e-a05a-bc5a7392c539 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:26.425800 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1004/1995] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:26.427111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed96bfd-1940-478f-9b35-e5200853d29d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:26.428602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3ed96bfd-1940-478f-9b35-e5200853d29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:26.444461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed96bfd-1940-478f-9b35-e5200853d29d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:26.450598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf8331-fd73-4f24-ac07-987e62e8c350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:26.451630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf8331-fd73-4f24-ac07-987e62e8c350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:26.451918 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf8331-fd73-4f24-ac07-987e62e8c350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:26.452197 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf8331-fd73-4f24-ac07-987e62e8c350 admin admin] PATH_INFO: `/v3/projects/7c3ad13321a9433d8d9901174f55d9f9/users/a47578c42b1c47a0a1b8ffb4b06af777/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:26.454205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf8331-fd73-4f24-ac07-987e62e8c350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3ad13321a9433d8d9901174f55d9f9, user_id=a47578c42b1c47a0a1b8ffb4b06af777, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:26.457385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf8331-fd73-4f24-ac07-987e62e8c350 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:26.474484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 992/1996] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:26 2022] PUT /identity/v3/projects/7c3ad13321a9433d8d9901174f55d9f9/users/a47578c42b1c47a0a1b8ffb4b06af777/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:26.482895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94def4e4-1cdf-44a4-bc01-aeb6c3f914f2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:26.483279 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94def4e4-1cdf-44a4-bc01-aeb6c3f914f2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:26.483476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94def4e4-1cdf-44a4-bc01-aeb6c3f914f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:26.515186 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-94def4e4-1cdf-44a4-bc01-aeb6c3f914f2 None None] MFA Rules not processed for user `a47578c42b1c47a0a1b8ffb4b06af777`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:26.516564 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-94def4e4-1cdf-44a4-bc01-aeb6c3f914f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:26.612745 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:26.655818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1005/1997] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:26 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:26.673564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf8331-fd73-4f24-ac07-987e62e8c350 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:26.677245 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e0bf8331-fd73-4f24-ac07-987e62e8c350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:26.783469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf8331-fd73-4f24-ac07-987e62e8c350 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:26.787954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340bce8-7223-4bc8-8a84-75aba736ee84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:26.789180 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340bce8-7223-4bc8-8a84-75aba736ee84 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:26.789718 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340bce8-7223-4bc8-8a84-75aba736ee84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:26.790225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340bce8-7223-4bc8-8a84-75aba736ee84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:26.811066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340bce8-7223-4bc8-8a84-75aba736ee84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:26.813116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340bce8-7223-4bc8-8a84-75aba736ee84 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:26.827254 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 993/1998] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:26 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:26.893883 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94def4e4-1cdf-44a4-bc01-aeb6c3f914f2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:26.895653 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-94def4e4-1cdf-44a4-bc01-aeb6c3f914f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:26.973767 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340bce8-7223-4bc8-8a84-75aba736ee84 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:26.985945 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340bce8-7223-4bc8-8a84-75aba736ee84 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:26.994284 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3225388-bccc-4fcf-b1e9-61d3c8e82451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:26.995490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3225388-bccc-4fcf-b1e9-61d3c8e82451 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:26.995959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3225388-bccc-4fcf-b1e9-61d3c8e82451 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:26.996515 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3225388-bccc-4fcf-b1e9-61d3c8e82451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:26.999572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b3225388-bccc-4fcf-b1e9-61d3c8e82451 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:27.005320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94def4e4-1cdf-44a4-bc01-aeb6c3f914f2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:27.010241 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f64e0-fb33-47cf-9aeb-34073e7261a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:27.011159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f64e0-fb33-47cf-9aeb-34073e7261a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:27.011445 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f64e0-fb33-47cf-9aeb-34073e7261a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:27.011727 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f64e0-fb33-47cf-9aeb-34073e7261a1 admin admin] PATH_INFO: `/v3/projects/750032d92ac9487da4da75216fc533c9` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:27.012936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f64e0-fb33-47cf-9aeb-34073e7261a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=750032d92ac9487da4da75216fc533c9)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:27.015206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f64e0-fb33-47cf-9aeb-34073e7261a1 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:27.074081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-092f64e0-fb33-47cf-9aeb-34073e7261a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750032d92ac9487da4da75216fc533c9', 'request_id': 'req-092f64e0-fb33-47cf-9aeb-34073e7261a1'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:27.079562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3225388-bccc-4fcf-b1e9-61d3c8e82451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:27.079990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-092f64e0-fb33-47cf-9aeb-34073e7261a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750032d92ac9487da4da75216fc533c9', 'request_id': 'req-092f64e0-fb33-47cf-9aeb-34073e7261a1'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:27.081200 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3225388-bccc-4fcf-b1e9-61d3c8e82451 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:27.088134 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-092f64e0-fb33-47cf-9aeb-34073e7261a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750032d92ac9487da4da75216fc533c9', 'request_id': 'req-092f64e0-fb33-47cf-9aeb-34073e7261a1'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:27.091862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 994/1999] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:26 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:27.124027 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-092f64e0-fb33-47cf-9aeb-34073e7261a1 admin admin] The token cache is being invalidate because project 750032d92ac9487da4da75216fc533c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:27.124419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-092f64e0-fb33-47cf-9aeb-34073e7261a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:27.126650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-092f64e0-fb33-47cf-9aeb-34073e7261a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:27.130312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1006/2000] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:26 2022] DELETE /identity/v3/projects/750032d92ac9487da4da75216fc533c9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:27.135172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3225388-bccc-4fcf-b1e9-61d3c8e82451 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:27.152169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3225388-bccc-4fcf-b1e9-61d3c8e82451 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:27.166756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:27.295322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81746dd-038f-4a93-ae59-f1253b96f706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:27.297630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81746dd-038f-4a93-ae59-f1253b96f706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:27.298088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81746dd-038f-4a93-ae59-f1253b96f706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:27.298457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81746dd-038f-4a93-ae59-f1253b96f706 admin admin] PATH_INFO: `/v3/users/26db248e5171408295d797ea3da56bee` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:27.304252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81746dd-038f-4a93-ae59-f1253b96f706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26db248e5171408295d797ea3da56bee)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:27.308014 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81746dd-038f-4a93-ae59-f1253b96f706 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:27.398183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c81746dd-038f-4a93-ae59-f1253b96f706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26db248e5171408295d797ea3da56bee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:27.399053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c81746dd-038f-4a93-ae59-f1253b96f706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26db248e5171408295d797ea3da56bee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:27.415625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c81746dd-038f-4a93-ae59-f1253b96f706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26db248e5171408295d797ea3da56bee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:27.416634 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c81746dd-038f-4a93-ae59-f1253b96f706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26db248e5171408295d797ea3da56bee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:27.426912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c81746dd-038f-4a93-ae59-f1253b96f706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26db248e5171408295d797ea3da56bee'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:27.443253 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 995/2001] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:27 2022] DELETE /identity/v3/users/26db248e5171408295d797ea3da56bee => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:27.766281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f64e0-fb33-47cf-9aeb-34073e7261a1 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:27.769983 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-092f64e0-fb33-47cf-9aeb-34073e7261a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:27.791571 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f64e0-fb33-47cf-9aeb-34073e7261a1 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:27.823792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81746dd-038f-4a93-ae59-f1253b96f706 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:27.824880 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c81746dd-038f-4a93-ae59-f1253b96f706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:27.911196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b861562-be18-49e7-a299-1ed38b973504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:27.912726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b861562-be18-49e7-a299-1ed38b973504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:27.913213 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b861562-be18-49e7-a299-1ed38b973504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:27.913989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b861562-be18-49e7-a299-1ed38b973504 admin admin] PATH_INFO: `/v3/projects/8cc097c7e23748218b33f065b37d731e` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:27.916402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b861562-be18-49e7-a299-1ed38b973504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc097c7e23748218b33f065b37d731e)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:27.919160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b861562-be18-49e7-a299-1ed38b973504 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:27.953423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:27.962475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81746dd-038f-4a93-ae59-f1253b96f706 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:27.976547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181378c3-b061-465e-a92c-1c65206f525b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:27.977446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181378c3-b061-465e-a92c-1c65206f525b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:27.977733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181378c3-b061-465e-a92c-1c65206f525b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:27.978536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181378c3-b061-465e-a92c-1c65206f525b admin admin] PATH_INFO: `/v3/users/f9071fed7ca7461c9d190d5e9353a842` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:27.979467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181378c3-b061-465e-a92c-1c65206f525b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9071fed7ca7461c9d190d5e9353a842)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:27.981404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181378c3-b061-465e-a92c-1c65206f525b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:28.003756 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2b861562-be18-49e7-a299-1ed38b973504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc097c7e23748218b33f065b37d731e', 'request_id': 'req-2b861562-be18-49e7-a299-1ed38b973504'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:28.011661 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2b861562-be18-49e7-a299-1ed38b973504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc097c7e23748218b33f065b37d731e', 'request_id': 'req-2b861562-be18-49e7-a299-1ed38b973504'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:28.023467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2b861562-be18-49e7-a299-1ed38b973504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc097c7e23748218b33f065b37d731e', 'request_id': 'req-2b861562-be18-49e7-a299-1ed38b973504'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:28.049616 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2b861562-be18-49e7-a299-1ed38b973504 admin admin] The token cache is being invalidate because project 8cc097c7e23748218b33f065b37d731e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:28.050238 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2b861562-be18-49e7-a299-1ed38b973504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:28.051808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2b861562-be18-49e7-a299-1ed38b973504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:28.057626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1007/2002] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:27 2022] DELETE /identity/v3/projects/8cc097c7e23748218b33f065b37d731e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:28.067204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:28.069715 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30115e62-a2d9-4a6f-b8cf-1260b16c85a1 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:28.069928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30115e62-a2d9-4a6f-b8cf-1260b16c85a1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:28.070209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30115e62-a2d9-4a6f-b8cf-1260b16c85a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:28.093086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-181378c3-b061-465e-a92c-1c65206f525b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9071fed7ca7461c9d190d5e9353a842'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:28.094641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-181378c3-b061-465e-a92c-1c65206f525b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9071fed7ca7461c9d190d5e9353a842'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:28.101869 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-30115e62-a2d9-4a6f-b8cf-1260b16c85a1 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:28.103737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-30115e62-a2d9-4a6f-b8cf-1260b16c85a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:28.114937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-181378c3-b061-465e-a92c-1c65206f525b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9071fed7ca7461c9d190d5e9353a842'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:28.116165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-181378c3-b061-465e-a92c-1c65206f525b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9071fed7ca7461c9d190d5e9353a842'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:28.131186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-181378c3-b061-465e-a92c-1c65206f525b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9071fed7ca7461c9d190d5e9353a842'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:28.148867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 996/2003] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:27 2022] DELETE /identity/v3/users/f9071fed7ca7461c9d190d5e9353a842 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:28.153219 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c54a4-c254-4d1c-83d6-1728f0165793 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:28.153602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c54a4-c254-4d1c-83d6-1728f0165793 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:28.153943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c54a4-c254-4d1c-83d6-1728f0165793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:28.173588 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-831c54a4-c254-4d1c-83d6-1728f0165793 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:28.175401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-831c54a4-c254-4d1c-83d6-1728f0165793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:28.177470 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1008/2004] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:28.185770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6aa8b3-f774-4170-b0da-3dba908cfe21 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:28.186067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6aa8b3-f774-4170-b0da-3dba908cfe21 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:28.186354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6aa8b3-f774-4170-b0da-3dba908cfe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:28.208050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0d6aa8b3-f774-4170-b0da-3dba908cfe21 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:28.209293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0d6aa8b3-f774-4170-b0da-3dba908cfe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:28.250336 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 997/2005] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:28.261672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c54a4-c254-4d1c-83d6-1728f0165793 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:28.263881 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-831c54a4-c254-4d1c-83d6-1728f0165793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:28.290080 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1009/2006] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:28.291773 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6aa8b3-f774-4170-b0da-3dba908cfe21 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:28.303410 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6aa8b3-f774-4170-b0da-3dba908cfe21 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:28.309752 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cdd28-f459-48ba-884f-4db4ead8cfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:28.310466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cdd28-f459-48ba-884f-4db4ead8cfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:28.310755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cdd28-f459-48ba-884f-4db4ead8cfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:28.311040 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cdd28-f459-48ba-884f-4db4ead8cfc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:28.311788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cdd28-f459-48ba-884f-4db4ead8cfc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:28.312096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cdd28-f459-48ba-884f-4db4ead8cfc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:28.313831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cdd28-f459-48ba-884f-4db4ead8cfc9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:28.329212 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c54a4-c254-4d1c-83d6-1728f0165793 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:28.329412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1010/2007] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:28.334899 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e7d9d-d6f0-4b09-96f1-dfea8c37a15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:28.335054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cdd28-f459-48ba-884f-4db4ead8cfc9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:28.336202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e7d9d-d6f0-4b09-96f1-dfea8c37a15f service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:28.336409 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e7d9d-d6f0-4b09-96f1-dfea8c37a15f service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:28.336792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e7d9d-d6f0-4b09-96f1-dfea8c37a15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:28.349256 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cdd28-f459-48ba-884f-4db4ead8cfc9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:28.351250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e7d9d-d6f0-4b09-96f1-dfea8c37a15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:28.352724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e7d9d-d6f0-4b09-96f1-dfea8c37a15f service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:28.364171 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf6907-d574-487e-9cc3-af4663bc7559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:28.364734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 998/2008] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:28.365077 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf6907-d574-487e-9cc3-af4663bc7559 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:28.365362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf6907-d574-487e-9cc3-af4663bc7559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:28.365734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf6907-d574-487e-9cc3-af4663bc7559 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:28.370624 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf6907-d574-487e-9cc3-af4663bc7559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:28.373120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf6907-d574-487e-9cc3-af4663bc7559 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:28.413965 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1011/2009] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:28 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:28.418154 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e7d9d-d6f0-4b09-96f1-dfea8c37a15f service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:28.433212 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e7d9d-d6f0-4b09-96f1-dfea8c37a15f service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:28.541402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:28.568581 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1a573-1b55-45cc-97cb-080860bf8578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:28.569271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1a573-1b55-45cc-97cb-080860bf8578 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:28.569561 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1a573-1b55-45cc-97cb-080860bf8578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:28.570215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1a573-1b55-45cc-97cb-080860bf8578 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:28.572627 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1a573-1b55-45cc-97cb-080860bf8578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:28.575945 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1a573-1b55-45cc-97cb-080860bf8578 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:28.620607 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 999/2010] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:28 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:28.625637 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf6907-d574-487e-9cc3-af4663bc7559 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:28.642149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf6907-d574-487e-9cc3-af4663bc7559 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:28.654129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc26698-9d53-450d-a33d-0e26851d3f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:28.654754 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26698-9d53-450d-a33d-0e26851d3f5f admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:28.655045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26698-9d53-450d-a33d-0e26851d3f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:28.655327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26698-9d53-450d-a33d-0e26851d3f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:28.656062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc26698-9d53-450d-a33d-0e26851d3f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:28.657679 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc26698-9d53-450d-a33d-0e26851d3f5f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:28.682390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1a573-1b55-45cc-97cb-080860bf8578 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:28.684422 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6ae1a573-1b55-45cc-97cb-080860bf8578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:28.693158 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1012/2011] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:28.697990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc26698-9d53-450d-a33d-0e26851d3f5f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:28.706233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1a573-1b55-45cc-97cb-080860bf8578 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:28.708644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:28.716073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2e2f5-954c-42a4-ba2f-16d78f1db78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:28.719404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2e2f5-954c-42a4-ba2f-16d78f1db78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:28.719826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc26698-9d53-450d-a33d-0e26851d3f5f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:28.720368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2e2f5-954c-42a4-ba2f-16d78f1db78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:28.722195 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2e2f5-954c-42a4-ba2f-16d78f1db78c admin admin] PATH_INFO: `/v3/users/faa588b89a18447bb0fdaf2fcaff9a5a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:28.724392 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2e2f5-954c-42a4-ba2f-16d78f1db78c admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa588b89a18447bb0fdaf2fcaff9a5a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:28.741193 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2e2f5-954c-42a4-ba2f-16d78f1db78c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:28.744103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df2105-2eed-46c0-ba13-189cb28adb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:28.746599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df2105-2eed-46c0-ba13-189cb28adb8a admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:28.747865 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df2105-2eed-46c0-ba13-189cb28adb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:28.748158 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df2105-2eed-46c0-ba13-189cb28adb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:28.748902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df2105-2eed-46c0-ba13-189cb28adb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:28.751376 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df2105-2eed-46c0-ba13-189cb28adb8a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:28.777957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1013/2012] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:28.781257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df2105-2eed-46c0-ba13-189cb28adb8a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:28.801704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df2105-2eed-46c0-ba13-189cb28adb8a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:28.812868 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949da82c-c521-46d4-bef3-c185be4c26c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:28.813922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949da82c-c521-46d4-bef3-c185be4c26c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:28.817462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949da82c-c521-46d4-bef3-c185be4c26c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:28.817796 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949da82c-c521-46d4-bef3-c185be4c26c8 admin admin] PATH_INFO: `/v3/projects/eb3be2cbefe64aa0a5f6b1f5ca03c4fc/users/ece896ab5e1f45d490e9a90a88f8948f/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:28.873608 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0a2e2f5-954c-42a4-ba2f-16d78f1db78c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa588b89a18447bb0fdaf2fcaff9a5a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:28.876017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949da82c-c521-46d4-bef3-c185be4c26c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb3be2cbefe64aa0a5f6b1f5ca03c4fc, user_id=ece896ab5e1f45d490e9a90a88f8948f, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:28.880441 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949da82c-c521-46d4-bef3-c185be4c26c8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:28.883056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0a2e2f5-954c-42a4-ba2f-16d78f1db78c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa588b89a18447bb0fdaf2fcaff9a5a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:28.903304 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1014/2013] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:28 2022] PUT /identity/v3/projects/eb3be2cbefe64aa0a5f6b1f5ca03c4fc/users/ece896ab5e1f45d490e9a90a88f8948f/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:28.903502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0a2e2f5-954c-42a4-ba2f-16d78f1db78c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa588b89a18447bb0fdaf2fcaff9a5a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:28.904214 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0a2e2f5-954c-42a4-ba2f-16d78f1db78c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa588b89a18447bb0fdaf2fcaff9a5a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:28.915422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cce999-7dc8-404d-a7f1-b21a23d5e824 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:28.916672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0a2e2f5-954c-42a4-ba2f-16d78f1db78c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa588b89a18447bb0fdaf2fcaff9a5a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:28.919122 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cce999-7dc8-404d-a7f1-b21a23d5e824 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:28.921599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cce999-7dc8-404d-a7f1-b21a23d5e824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:28.957890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1000/2014] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:28 2022] DELETE /identity/v3/users/faa588b89a18447bb0fdaf2fcaff9a5a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:28.957890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01358b0-227e-4f64-80e2-b42b1bc2c294 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:28.957890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01358b0-227e-4f64-80e2-b42b1bc2c294 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:28.957890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01358b0-227e-4f64-80e2-b42b1bc2c294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:28.982942 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-58cce999-7dc8-404d-a7f1-b21a23d5e824 None None] MFA Rules not processed for user `ece896ab5e1f45d490e9a90a88f8948f`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:28.984326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-58cce999-7dc8-404d-a7f1-b21a23d5e824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:29.004749 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a01358b0-227e-4f64-80e2-b42b1bc2c294 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:29.008626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a01358b0-227e-4f64-80e2-b42b1bc2c294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:29.087923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1015/2015] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:29.091555 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cce999-7dc8-404d-a7f1-b21a23d5e824 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:29.093545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-58cce999-7dc8-404d-a7f1-b21a23d5e824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:29.177143 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1001/2016] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:29.181445 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01358b0-227e-4f64-80e2-b42b1bc2c294 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:29.183434 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a01358b0-227e-4f64-80e2-b42b1bc2c294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:29.205460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01358b0-227e-4f64-80e2-b42b1bc2c294 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:29.218202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb4509-2139-4672-a2d2-9756424272ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:29.219210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb4509-2139-4672-a2d2-9756424272ed admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:29.219795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb4509-2139-4672-a2d2-9756424272ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:29.219991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb4509-2139-4672-a2d2-9756424272ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:29.220575 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb4509-2139-4672-a2d2-9756424272ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:29.223536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb4509-2139-4672-a2d2-9756424272ed admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:29.232682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cce999-7dc8-404d-a7f1-b21a23d5e824 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:29.244474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813b04-6fc5-42c3-853a-fcef4a76130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:29.245367 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813b04-6fc5-42c3-853a-fcef4a76130a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:29.245708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813b04-6fc5-42c3-853a-fcef4a76130a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:29.245988 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80813b04-6fc5-42c3-853a-fcef4a76130a admin admin] PATH_INFO: `/v3/projects/c9eb5a38f8b5402da25cf8ec46c6d1d9` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:29.247830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80813b04-6fc5-42c3-853a-fcef4a76130a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9eb5a38f8b5402da25cf8ec46c6d1d9)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:29.249978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80813b04-6fc5-42c3-853a-fcef4a76130a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:29.270389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1002/2017] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:29 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:29.271801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb4509-2139-4672-a2d2-9756424272ed admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:29.273806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6cdb4509-2139-4672-a2d2-9756424272ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:29.314150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-80813b04-6fc5-42c3-853a-fcef4a76130a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9eb5a38f8b5402da25cf8ec46c6d1d9', 'request_id': 'req-80813b04-6fc5-42c3-853a-fcef4a76130a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:29.323036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-80813b04-6fc5-42c3-853a-fcef4a76130a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9eb5a38f8b5402da25cf8ec46c6d1d9', 'request_id': 'req-80813b04-6fc5-42c3-853a-fcef4a76130a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:29.325773 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:29.330080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:29.342569 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-80813b04-6fc5-42c3-853a-fcef4a76130a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9eb5a38f8b5402da25cf8ec46c6d1d9', 'request_id': 'req-80813b04-6fc5-42c3-853a-fcef4a76130a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:29.365372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-80813b04-6fc5-42c3-853a-fcef4a76130a admin admin] The token cache is being invalidate because project c9eb5a38f8b5402da25cf8ec46c6d1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:29.365694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-80813b04-6fc5-42c3-853a-fcef4a76130a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:29.366987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-80813b04-6fc5-42c3-853a-fcef4a76130a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:29.369175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1016/2018] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:29 2022] DELETE /identity/v3/projects/c9eb5a38f8b5402da25cf8ec46c6d1d9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:29.370047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813b04-6fc5-42c3-853a-fcef4a76130a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:29.378681 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-80813b04-6fc5-42c3-853a-fcef4a76130a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:29.388578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb4509-2139-4672-a2d2-9756424272ed admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:29.470374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd948a31-814d-4669-a8af-57b98155b577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:29.472047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd948a31-814d-4669-a8af-57b98155b577 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:29.472448 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd948a31-814d-4669-a8af-57b98155b577 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:29.472732 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd948a31-814d-4669-a8af-57b98155b577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:29.474688 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dd948a31-814d-4669-a8af-57b98155b577 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:29.485647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80813b04-6fc5-42c3-853a-fcef4a76130a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:29.495406 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef4687-2fa0-4fba-bc88-935dd33476e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:29.497494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef4687-2fa0-4fba-bc88-935dd33476e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:29.499511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef4687-2fa0-4fba-bc88-935dd33476e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:29.499511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef4687-2fa0-4fba-bc88-935dd33476e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:29.499693 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef4687-2fa0-4fba-bc88-935dd33476e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:29.501629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef4687-2fa0-4fba-bc88-935dd33476e1 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:29.503744 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd948a31-814d-4669-a8af-57b98155b577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:29.505449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd948a31-814d-4669-a8af-57b98155b577 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:29.520527 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1003/2019] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:29.521783 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd948a31-814d-4669-a8af-57b98155b577 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:29.523586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dd948a31-814d-4669-a8af-57b98155b577 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:29.539084 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd948a31-814d-4669-a8af-57b98155b577 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:29.544834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1017/2020] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:29 2022] POST /identity/v3/users => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:29.545191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19a7f4-c197-4a16-9bea-fcc213c7f3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:29.546632 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a7f4-c197-4a16-9bea-fcc213c7f3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:29.547724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a7f4-c197-4a16-9bea-fcc213c7f3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:29.548333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a7f4-c197-4a16-9bea-fcc213c7f3ee admin admin] PATH_INFO: `/v3/users/c5217ac29ef5470aa785bd9fe8eed5e4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:29.548664 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef4687-2fa0-4fba-bc88-935dd33476e1 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:29.551558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19a7f4-c197-4a16-9bea-fcc213c7f3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5217ac29ef5470aa785bd9fe8eed5e4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:29.553932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19a7f4-c197-4a16-9bea-fcc213c7f3ee admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:29.572020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef4687-2fa0-4fba-bc88-935dd33476e1 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:29.579101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e217a21-50d7-47a1-858d-6ff0e3a19ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:29.580364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e217a21-50d7-47a1-858d-6ff0e3a19ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:29.580659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e217a21-50d7-47a1-858d-6ff0e3a19ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:29.580941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e217a21-50d7-47a1-858d-6ff0e3a19ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:29.581855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e217a21-50d7-47a1-858d-6ff0e3a19ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:29.583521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e217a21-50d7-47a1-858d-6ff0e3a19ff7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:29.598005 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1018/2021] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:17:29.602502 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e217a21-50d7-47a1-858d-6ff0e3a19ff7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:29.616329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e217a21-50d7-47a1-858d-6ff0e3a19ff7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:29.624130 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a2075-08a8-4ec1-93cc-b5f4a286ca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:29.625615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a2075-08a8-4ec1-93cc-b5f4a286ca23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:29.626186 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a2075-08a8-4ec1-93cc-b5f4a286ca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:29.627119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a2075-08a8-4ec1-93cc-b5f4a286ca23 admin admin] PATH_INFO: `/v3/projects/d61417ce665a4b67a34b0e59d694b132/users/d706cac851a144cf832daa3e6cfbf947/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:29.639046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8d19a7f4-c197-4a16-9bea-fcc213c7f3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5217ac29ef5470aa785bd9fe8eed5e4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:29.639788 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8d19a7f4-c197-4a16-9bea-fcc213c7f3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5217ac29ef5470aa785bd9fe8eed5e4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:29.649026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a2075-08a8-4ec1-93cc-b5f4a286ca23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61417ce665a4b67a34b0e59d694b132, user_id=d706cac851a144cf832daa3e6cfbf947, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:29.652816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a2075-08a8-4ec1-93cc-b5f4a286ca23 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:29.658172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8d19a7f4-c197-4a16-9bea-fcc213c7f3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5217ac29ef5470aa785bd9fe8eed5e4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:29.660270 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8d19a7f4-c197-4a16-9bea-fcc213c7f3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5217ac29ef5470aa785bd9fe8eed5e4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:29.670239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8d19a7f4-c197-4a16-9bea-fcc213c7f3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5217ac29ef5470aa785bd9fe8eed5e4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:29.677852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1019/2022] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:29 2022] PUT /identity/v3/projects/d61417ce665a4b67a34b0e59d694b132/users/d706cac851a144cf832daa3e6cfbf947/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:29.682939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a2075-08a8-4ec1-93cc-b5f4a286ca23 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:29.685663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c11a2075-08a8-4ec1-93cc-b5f4a286ca23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:29.690034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1004/2023] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:29 2022] DELETE /identity/v3/users/c5217ac29ef5470aa785bd9fe8eed5e4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:29.796828 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a2075-08a8-4ec1-93cc-b5f4a286ca23 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:29.862299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:29.895799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133e80c-851c-4e4e-bbe0-5e731a81f96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:29.896621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133e80c-851c-4e4e-bbe0-5e731a81f96a admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:29.897083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133e80c-851c-4e4e-bbe0-5e731a81f96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:29.897426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133e80c-851c-4e4e-bbe0-5e731a81f96a admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:29.900111 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133e80c-851c-4e4e-bbe0-5e731a81f96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:29.902161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133e80c-851c-4e4e-bbe0-5e731a81f96a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:29.916425 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1020/2024] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:29.920318 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19a7f4-c197-4a16-9bea-fcc213c7f3ee admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:29.951402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19a7f4-c197-4a16-9bea-fcc213c7f3ee admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:29.966722 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd4f7d-bb2a-48db-8112-1beb06f9e13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:29.967652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd4f7d-bb2a-48db-8112-1beb06f9e13a admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:29.967933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd4f7d-bb2a-48db-8112-1beb06f9e13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:29.968210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd4f7d-bb2a-48db-8112-1beb06f9e13a admin admin] PATH_INFO: `/v3/projects/d61417ce665a4b67a34b0e59d694b132/users/d706cac851a144cf832daa3e6cfbf947/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:29.974273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd4f7d-bb2a-48db-8112-1beb06f9e13a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61417ce665a4b67a34b0e59d694b132, user_id=d706cac851a144cf832daa3e6cfbf947, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:29.977282 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd4f7d-bb2a-48db-8112-1beb06f9e13a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:30.007179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1005/2025] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:29 2022] PUT /identity/v3/projects/d61417ce665a4b67a34b0e59d694b132/users/d706cac851a144cf832daa3e6cfbf947/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:30.019839 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea68ad4-5c54-4c29-8dc4-785269f82ab3 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:30.023401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea68ad4-5c54-4c29-8dc4-785269f82ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:30.023918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea68ad4-5c54-4c29-8dc4-785269f82ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:30.090447 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-cea68ad4-5c54-4c29-8dc4-785269f82ab3 None None] MFA Rules not processed for user `d706cac851a144cf832daa3e6cfbf947`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:30.096487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cea68ad4-5c54-4c29-8dc4-785269f82ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:30.384805 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1021/2026] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:30.401178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd4f7d-bb2a-48db-8112-1beb06f9e13a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:30.403779 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b6fd4f7d-bb2a-48db-8112-1beb06f9e13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:30.451515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea68ad4-5c54-4c29-8dc4-785269f82ab3 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:30.453092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cea68ad4-5c54-4c29-8dc4-785269f82ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:30.527380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:30.534273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd4f7d-bb2a-48db-8112-1beb06f9e13a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:30.548359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56714a1c-0085-4514-8a09-8b98a2fa1836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:30.550685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56714a1c-0085-4514-8a09-8b98a2fa1836 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:30.552991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56714a1c-0085-4514-8a09-8b98a2fa1836 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:30.553283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56714a1c-0085-4514-8a09-8b98a2fa1836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:30.567919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56714a1c-0085-4514-8a09-8b98a2fa1836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:30.569480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56714a1c-0085-4514-8a09-8b98a2fa1836 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:30.593310 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1006/2027] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:30.594674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56714a1c-0085-4514-8a09-8b98a2fa1836 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:30.598579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea68ad4-5c54-4c29-8dc4-785269f82ab3 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:30.605574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-56714a1c-0085-4514-8a09-8b98a2fa1836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:30.606274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938513ea-80de-4dd1-8c0f-47f6782b1761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:30.607815 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938513ea-80de-4dd1-8c0f-47f6782b1761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:30.608201 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938513ea-80de-4dd1-8c0f-47f6782b1761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:30.608700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938513ea-80de-4dd1-8c0f-47f6782b1761 admin admin] PATH_INFO: `/v3/projects/02345de5e99942a086a21e1a31be10c4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:30.610980 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938513ea-80de-4dd1-8c0f-47f6782b1761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02345de5e99942a086a21e1a31be10c4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:30.621305 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938513ea-80de-4dd1-8c0f-47f6782b1761 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:30.650175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56714a1c-0085-4514-8a09-8b98a2fa1836 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:30.659905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91174c10-7716-4775-b755-49e0f00c2dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:30.660811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91174c10-7716-4775-b755-49e0f00c2dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:30.661097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91174c10-7716-4775-b755-49e0f00c2dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:30.661374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91174c10-7716-4775-b755-49e0f00c2dc0 admin admin] PATH_INFO: `/v3/users/a966808f77af477e9366ef16dacbdf0a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:30.662664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91174c10-7716-4775-b755-49e0f00c2dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a966808f77af477e9366ef16dacbdf0a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:30.664628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91174c10-7716-4775-b755-49e0f00c2dc0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:30.710660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-938513ea-80de-4dd1-8c0f-47f6782b1761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02345de5e99942a086a21e1a31be10c4', 'request_id': 'req-938513ea-80de-4dd1-8c0f-47f6782b1761'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:30.718003 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-938513ea-80de-4dd1-8c0f-47f6782b1761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02345de5e99942a086a21e1a31be10c4', 'request_id': 'req-938513ea-80de-4dd1-8c0f-47f6782b1761'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:30.732930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-938513ea-80de-4dd1-8c0f-47f6782b1761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02345de5e99942a086a21e1a31be10c4', 'request_id': 'req-938513ea-80de-4dd1-8c0f-47f6782b1761'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:30.759263 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:30.768505 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-938513ea-80de-4dd1-8c0f-47f6782b1761 admin admin] The token cache is being invalidate because project 02345de5e99942a086a21e1a31be10c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:30.770639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-938513ea-80de-4dd1-8c0f-47f6782b1761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:30.772739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-91174c10-7716-4775-b755-49e0f00c2dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a966808f77af477e9366ef16dacbdf0a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:30.774024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-91174c10-7716-4775-b755-49e0f00c2dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a966808f77af477e9366ef16dacbdf0a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:30.774187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-938513ea-80de-4dd1-8c0f-47f6782b1761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:30.776129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1022/2028] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:30 2022] DELETE /identity/v3/projects/02345de5e99942a086a21e1a31be10c4 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:30.779384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938513ea-80de-4dd1-8c0f-47f6782b1761 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:30.780833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-938513ea-80de-4dd1-8c0f-47f6782b1761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:30.808081 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-91174c10-7716-4775-b755-49e0f00c2dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a966808f77af477e9366ef16dacbdf0a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:30.809664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-91174c10-7716-4775-b755-49e0f00c2dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a966808f77af477e9366ef16dacbdf0a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:30.822762 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-91174c10-7716-4775-b755-49e0f00c2dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a966808f77af477e9366ef16dacbdf0a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:30.850138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1007/2029] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:30 2022] DELETE /identity/v3/users/a966808f77af477e9366ef16dacbdf0a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:30.850829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91174c10-7716-4775-b755-49e0f00c2dc0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:30.853986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-91174c10-7716-4775-b755-49e0f00c2dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:30.900652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938513ea-80de-4dd1-8c0f-47f6782b1761 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:31.001997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91174c10-7716-4775-b755-49e0f00c2dc0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:31.005116 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de97e6-cb02-40d1-90aa-9586cfb0fb38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:31.006011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de97e6-cb02-40d1-90aa-9586cfb0fb38 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:31.006536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de97e6-cb02-40d1-90aa-9586cfb0fb38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:31.006964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de97e6-cb02-40d1-90aa-9586cfb0fb38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:31.009904 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d7de97e6-cb02-40d1-90aa-9586cfb0fb38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:31.015768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d914e16-31c8-4c7c-a8db-cec7a0497e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:31.016997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d914e16-31c8-4c7c-a8db-cec7a0497e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:31.017314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d914e16-31c8-4c7c-a8db-cec7a0497e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:31.017681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d914e16-31c8-4c7c-a8db-cec7a0497e74 admin admin] PATH_INFO: `/v3/users/cd1075e46c7a4c448e82b6cc884979e8` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:31.020363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d914e16-31c8-4c7c-a8db-cec7a0497e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd1075e46c7a4c448e82b6cc884979e8)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:31.023224 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d914e16-31c8-4c7c-a8db-cec7a0497e74 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:31.121314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2d914e16-31c8-4c7c-a8db-cec7a0497e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd1075e46c7a4c448e82b6cc884979e8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:31.122822 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2d914e16-31c8-4c7c-a8db-cec7a0497e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd1075e46c7a4c448e82b6cc884979e8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:31.150632 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2d914e16-31c8-4c7c-a8db-cec7a0497e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd1075e46c7a4c448e82b6cc884979e8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:31.151474 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2d914e16-31c8-4c7c-a8db-cec7a0497e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd1075e46c7a4c448e82b6cc884979e8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:31.153930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:31.169219 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de97e6-cb02-40d1-90aa-9586cfb0fb38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:31.169413 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2d914e16-31c8-4c7c-a8db-cec7a0497e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd1075e46c7a4c448e82b6cc884979e8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:31.170908 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de97e6-cb02-40d1-90aa-9586cfb0fb38 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:31.191056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1008/2030] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:30 2022] DELETE /identity/v3/users/cd1075e46c7a4c448e82b6cc884979e8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:31.191056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84663e-db6d-4a49-9ac6-8a7c408fe0a0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:31.191056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84663e-db6d-4a49-9ac6-8a7c408fe0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:31.191056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84663e-db6d-4a49-9ac6-8a7c408fe0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:31.191458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1023/2031] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:31.213326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de97e6-cb02-40d1-90aa-9586cfb0fb38 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:31.217957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d7de97e6-cb02-40d1-90aa-9586cfb0fb38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:31.238386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3b84663e-db6d-4a49-9ac6-8a7c408fe0a0 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:31.238386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3b84663e-db6d-4a49-9ac6-8a7c408fe0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:31.266978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de97e6-cb02-40d1-90aa-9586cfb0fb38 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:31.465515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923ad28-8607-4bfb-8e01-4134c62294d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:31.466846 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923ad28-8607-4bfb-8e01-4134c62294d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:31.467335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923ad28-8607-4bfb-8e01-4134c62294d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:31.468021 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923ad28-8607-4bfb-8e01-4134c62294d7 admin admin] PATH_INFO: `/v3/projects/9a8cd61d09c848beba76eeed9021f7c1` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:31.471772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923ad28-8607-4bfb-8e01-4134c62294d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8cd61d09c848beba76eeed9021f7c1)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:31.476048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923ad28-8607-4bfb-8e01-4134c62294d7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:31.483512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1009/2032] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:31.495154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:31.504694 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84663e-db6d-4a49-9ac6-8a7c408fe0a0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:31.506863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3b84663e-db6d-4a49-9ac6-8a7c408fe0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:31.553245 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3923ad28-8607-4bfb-8e01-4134c62294d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8cd61d09c848beba76eeed9021f7c1', 'request_id': 'req-3923ad28-8607-4bfb-8e01-4134c62294d7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:31.561536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3923ad28-8607-4bfb-8e01-4134c62294d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8cd61d09c848beba76eeed9021f7c1', 'request_id': 'req-3923ad28-8607-4bfb-8e01-4134c62294d7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:31.571970 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3923ad28-8607-4bfb-8e01-4134c62294d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8cd61d09c848beba76eeed9021f7c1', 'request_id': 'req-3923ad28-8607-4bfb-8e01-4134c62294d7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:31.604576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3923ad28-8607-4bfb-8e01-4134c62294d7 admin admin] The token cache is being invalidate because project 9a8cd61d09c848beba76eeed9021f7c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:31.606513 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3923ad28-8607-4bfb-8e01-4134c62294d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:31.609293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3923ad28-8607-4bfb-8e01-4134c62294d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:31.619645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1024/2033] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:31 2022] DELETE /identity/v3/projects/9a8cd61d09c848beba76eeed9021f7c1 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:31.621995 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa028ac-61d8-4972-ba2a-6e309607c828 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:31.624783 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa028ac-61d8-4972-ba2a-6e309607c828 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:31.624995 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa028ac-61d8-4972-ba2a-6e309607c828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:31.636839 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84663e-db6d-4a49-9ac6-8a7c408fe0a0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:31.660285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6aa028ac-61d8-4972-ba2a-6e309607c828 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:31.661439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6aa028ac-61d8-4972-ba2a-6e309607c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:31.732200 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25a882-5be3-4b8c-8b39-0cea2784c777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:31.733847 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25a882-5be3-4b8c-8b39-0cea2784c777 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:31.734142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25a882-5be3-4b8c-8b39-0cea2784c777 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:31.734422 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25a882-5be3-4b8c-8b39-0cea2784c777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:31.736643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7a25a882-5be3-4b8c-8b39-0cea2784c777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:31.781122 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1025/2034] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:31.782079 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa028ac-61d8-4972-ba2a-6e309607c828 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:31.789538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6aa028ac-61d8-4972-ba2a-6e309607c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:31.816568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa028ac-61d8-4972-ba2a-6e309607c828 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:31.829259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f5735-07b3-4c7f-9fdc-9b3bcc4fc241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:31.833731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f5735-07b3-4c7f-9fdc-9b3bcc4fc241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:31.834143 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f5735-07b3-4c7f-9fdc-9b3bcc4fc241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:31.834568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f5735-07b3-4c7f-9fdc-9b3bcc4fc241 admin admin] PATH_INFO: `/v3/users/ece896ab5e1f45d490e9a90a88f8948f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:31.836887 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f5735-07b3-4c7f-9fdc-9b3bcc4fc241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece896ab5e1f45d490e9a90a88f8948f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:31.839717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f5735-07b3-4c7f-9fdc-9b3bcc4fc241 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:31.848443 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:31.877865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25a882-5be3-4b8c-8b39-0cea2784c777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:31.880011 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25a882-5be3-4b8c-8b39-0cea2784c777 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:31.897949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1010/2035] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:31.901345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846724ef-3b0d-4f32-a7bf-c31665ccb06f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:31.901643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846724ef-3b0d-4f32-a7bf-c31665ccb06f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:31.901973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846724ef-3b0d-4f32-a7bf-c31665ccb06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:31.927421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-846724ef-3b0d-4f32-a7bf-c31665ccb06f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:31.930401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-846724ef-3b0d-4f32-a7bf-c31665ccb06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:31.956571 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1011/2036] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:31.959475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846724ef-3b0d-4f32-a7bf-c31665ccb06f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:31.969796 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-348f5735-07b3-4c7f-9fdc-9b3bcc4fc241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece896ab5e1f45d490e9a90a88f8948f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:31.970274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-846724ef-3b0d-4f32-a7bf-c31665ccb06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:31.992440 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846724ef-3b0d-4f32-a7bf-c31665ccb06f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:31.996133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-348f5735-07b3-4c7f-9fdc-9b3bcc4fc241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece896ab5e1f45d490e9a90a88f8948f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:31.996911 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-348f5735-07b3-4c7f-9fdc-9b3bcc4fc241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece896ab5e1f45d490e9a90a88f8948f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:31.997623 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-348f5735-07b3-4c7f-9fdc-9b3bcc4fc241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece896ab5e1f45d490e9a90a88f8948f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:31.997855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf76cd8-a838-4ff8-afff-7d558f599f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:31.998805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf76cd8-a838-4ff8-afff-7d558f599f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:31.999087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf76cd8-a838-4ff8-afff-7d558f599f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:31.999357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf76cd8-a838-4ff8-afff-7d558f599f55 admin admin] PATH_INFO: `/v3/projects/f1d3bc0ecebf4c2bb6917a00dd8a0310` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.000561 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf76cd8-a838-4ff8-afff-7d558f599f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d3bc0ecebf4c2bb6917a00dd8a0310)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:32.002870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf76cd8-a838-4ff8-afff-7d558f599f55 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:32.007629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-348f5735-07b3-4c7f-9fdc-9b3bcc4fc241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece896ab5e1f45d490e9a90a88f8948f'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:32.022336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1026/2037] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:31 2022] DELETE /identity/v3/users/ece896ab5e1f45d490e9a90a88f8948f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:32.025366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f5735-07b3-4c7f-9fdc-9b3bcc4fc241 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:32.026544 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-348f5735-07b3-4c7f-9fdc-9b3bcc4fc241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:32.045662 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:32.065016 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-baf76cd8-a838-4ff8-afff-7d558f599f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d3bc0ecebf4c2bb6917a00dd8a0310', 'request_id': 'req-baf76cd8-a838-4ff8-afff-7d558f599f55'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:32.070931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-baf76cd8-a838-4ff8-afff-7d558f599f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d3bc0ecebf4c2bb6917a00dd8a0310', 'request_id': 'req-baf76cd8-a838-4ff8-afff-7d558f599f55'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:32.079863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-baf76cd8-a838-4ff8-afff-7d558f599f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d3bc0ecebf4c2bb6917a00dd8a0310', 'request_id': 'req-baf76cd8-a838-4ff8-afff-7d558f599f55'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:32.098133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-baf76cd8-a838-4ff8-afff-7d558f599f55 admin admin] The token cache is being invalidate because project f1d3bc0ecebf4c2bb6917a00dd8a0310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:32.098754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-baf76cd8-a838-4ff8-afff-7d558f599f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:32.100329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-baf76cd8-a838-4ff8-afff-7d558f599f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:32.103046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1012/2038] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:31 2022] DELETE /identity/v3/projects/f1d3bc0ecebf4c2bb6917a00dd8a0310 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:32.104468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be5586-0cd3-4810-b68f-8332168f663a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:32.104581 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f5735-07b3-4c7f-9fdc-9b3bcc4fc241 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:32.105047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be5586-0cd3-4810-b68f-8332168f663a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:32.105504 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be5586-0cd3-4810-b68f-8332168f663a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.135064 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a8be5586-0cd3-4810-b68f-8332168f663a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:32.136415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a8be5586-0cd3-4810-b68f-8332168f663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:32.198630 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999405bc-e33c-4262-84e2-8de78d16afe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:32.199971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999405bc-e33c-4262-84e2-8de78d16afe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:32.201798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999405bc-e33c-4262-84e2-8de78d16afe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:32.202164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999405bc-e33c-4262-84e2-8de78d16afe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.204044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999405bc-e33c-4262-84e2-8de78d16afe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:32.204444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999405bc-e33c-4262-84e2-8de78d16afe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:32.207396 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999405bc-e33c-4262-84e2-8de78d16afe4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:32.218838 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1013/2039] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:32.220239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16428f-6054-4e28-b3d5-af39f1a605b9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:32.220565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16428f-6054-4e28-b3d5-af39f1a605b9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:32.221558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16428f-6054-4e28-b3d5-af39f1a605b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.230398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1027/2040] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:32.231606 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999405bc-e33c-4262-84e2-8de78d16afe4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:32.233357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-999405bc-e33c-4262-84e2-8de78d16afe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:32.242882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cf16428f-6054-4e28-b3d5-af39f1a605b9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:32.244162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cf16428f-6054-4e28-b3d5-af39f1a605b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:32.253355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1014/2041] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:32.254298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16428f-6054-4e28-b3d5-af39f1a605b9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:32.259773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cf16428f-6054-4e28-b3d5-af39f1a605b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:32.279747 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16428f-6054-4e28-b3d5-af39f1a605b9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:32.286780 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc949102-c205-48a0-91ed-7796a935eec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:32.287832 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc949102-c205-48a0-91ed-7796a935eec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:32.288270 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc949102-c205-48a0-91ed-7796a935eec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:32.288695 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc949102-c205-48a0-91ed-7796a935eec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.289668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc949102-c205-48a0-91ed-7796a935eec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:32.292582 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc949102-c205-48a0-91ed-7796a935eec6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:32.323079 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999405bc-e33c-4262-84e2-8de78d16afe4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:32.327486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c7a22-fa09-46e0-a626-dbcb3863f5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:32.328284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c7a22-fa09-46e0-a626-dbcb3863f5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:32.328564 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c7a22-fa09-46e0-a626-dbcb3863f5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:32.328845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c7a22-fa09-46e0-a626-dbcb3863f5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.332638 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1015/2042] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:32 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:32.334383 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97b60a-25aa-4a0c-a336-aef91309be7a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:32.334892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97b60a-25aa-4a0c-a336-aef91309be7a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:32.335425 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97b60a-25aa-4a0c-a336-aef91309be7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.342640 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c7a22-fa09-46e0-a626-dbcb3863f5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:32.344255 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c7a22-fa09-46e0-a626-dbcb3863f5c6 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:32.356985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1028/2043] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:32.357614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0d97b60a-25aa-4a0c-a336-aef91309be7a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:32.359006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0d97b60a-25aa-4a0c-a336-aef91309be7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:32.359881 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c7a22-fa09-46e0-a626-dbcb3863f5c6 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:32.378475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c7a22-fa09-46e0-a626-dbcb3863f5c6 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:32.412726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:32.471924 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1016/2044] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:32.474421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e68d2-6f8a-4c36-aa08-de68d6ad6f7c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:32.477825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e68d2-6f8a-4c36-aa08-de68d6ad6f7c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:32.479283 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e68d2-6f8a-4c36-aa08-de68d6ad6f7c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.481975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1017/2045] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 16 16:17:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:17:32.483611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e68d2-6f8a-4c36-aa08-de68d6ad6f7c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:32.496190 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:32.511235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b66cf-6c8f-4850-9529-e5e58f2139b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:32.512552 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e68d2-6f8a-4c36-aa08-de68d6ad6f7c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:32.515985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b66cf-6c8f-4850-9529-e5e58f2139b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:32.516764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b66cf-6c8f-4850-9529-e5e58f2139b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:32.517135 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b66cf-6c8f-4850-9529-e5e58f2139b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.518823 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b66cf-6c8f-4850-9529-e5e58f2139b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:32.519142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888e7ed-ce43-480a-969b-0fc7260840cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:32.519823 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888e7ed-ce43-480a-969b-0fc7260840cd admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:32.520102 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888e7ed-ce43-480a-969b-0fc7260840cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:32.520378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888e7ed-ce43-480a-969b-0fc7260840cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.521112 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888e7ed-ce43-480a-969b-0fc7260840cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:32.521418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888e7ed-ce43-480a-969b-0fc7260840cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:32.521610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b66cf-6c8f-4850-9529-e5e58f2139b4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:32.524423 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888e7ed-ce43-480a-969b-0fc7260840cd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:32.546897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1018/2046] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:32.550370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1029/2047] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:32 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:32.550573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9aa59-977e-4904-9b09-05090ca06751 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:32.550573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9aa59-977e-4904-9b09-05090ca06751 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:32.551134 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b66cf-6c8f-4850-9529-e5e58f2139b4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:32.551252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9aa59-977e-4904-9b09-05090ca06751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.557937 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-561b66cf-6c8f-4850-9529-e5e58f2139b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:32.577460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b66cf-6c8f-4850-9529-e5e58f2139b4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:32.587785 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6dc3e2-8326-4fca-83e6-9816515febad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:32.589339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dc3e2-8326-4fca-83e6-9816515febad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:32.589755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dc3e2-8326-4fca-83e6-9816515febad admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:32.590633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dc3e2-8326-4fca-83e6-9816515febad admin admin] PATH_INFO: `/v3/users/f48deebede4d485b9a7824b0be6e281e` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.592561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6dc3e2-8326-4fca-83e6-9816515febad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48deebede4d485b9a7824b0be6e281e)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:32.595165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6dc3e2-8326-4fca-83e6-9816515febad admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:32.599395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-ccc9aa59-977e-4904-9b09-05090ca06751 None None] MFA Rules not processed for user `9e8222d303aa487ca2b5c5bed6124f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:32.600795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ccc9aa59-977e-4904-9b09-05090ca06751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:32.662178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7c6dc3e2-8326-4fca-83e6-9816515febad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48deebede4d485b9a7824b0be6e281e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:32.677958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7c6dc3e2-8326-4fca-83e6-9816515febad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48deebede4d485b9a7824b0be6e281e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:32.678838 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7c6dc3e2-8326-4fca-83e6-9816515febad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48deebede4d485b9a7824b0be6e281e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:32.679622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7c6dc3e2-8326-4fca-83e6-9816515febad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48deebede4d485b9a7824b0be6e281e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:32.683022 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1019/2048] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 16 16:17:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:32.683690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9aa59-977e-4904-9b09-05090ca06751 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:32.696485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9aa59-977e-4904-9b09-05090ca06751 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:32.701587 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7c6dc3e2-8326-4fca-83e6-9816515febad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48deebede4d485b9a7824b0be6e281e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:32.702856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4e81c-5e70-4723-8fde-17ee4a7c0a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:32.703436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4e81c-5e70-4723-8fde-17ee4a7c0a2f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:32.703813 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4e81c-5e70-4723-8fde-17ee4a7c0a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:32.704303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4e81c-5e70-4723-8fde-17ee4a7c0a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.704987 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4e81c-5e70-4723-8fde-17ee4a7c0a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:32.707599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4e81c-5e70-4723-8fde-17ee4a7c0a2f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:32.717419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1030/2049] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:32 2022] DELETE /identity/v3/users/f48deebede4d485b9a7824b0be6e281e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:32.718139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6dc3e2-8326-4fca-83e6-9816515febad admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:32.719609 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7c6dc3e2-8326-4fca-83e6-9816515febad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:32.741158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1020/2050] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:32 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:32.742342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4e81c-5e70-4723-8fde-17ee4a7c0a2f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:32.744139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-80b4e81c-5e70-4723-8fde-17ee4a7c0a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:32.796914 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6dc3e2-8326-4fca-83e6-9816515febad admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:32.838671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4e81c-5e70-4723-8fde-17ee4a7c0a2f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:32.846803 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908feda-241f-46c8-acd5-aa673d228cb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e8222d303aa487ca2b5c5bed6124f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:32.847453 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908feda-241f-46c8-acd5-aa673d228cb9 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:32.847734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908feda-241f-46c8-acd5-aa673d228cb9 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:32.848006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908feda-241f-46c8-acd5-aa673d228cb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.850651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c908feda-241f-46c8-acd5-aa673d228cb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:32.867030 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908feda-241f-46c8-acd5-aa673d228cb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:32.868645 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908feda-241f-46c8-acd5-aa673d228cb9 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:32.880077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1021/2051] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:32.882733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908feda-241f-46c8-acd5-aa673d228cb9 service placement] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:32.884091 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c908feda-241f-46c8-acd5-aa673d228cb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:32.911585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489fbf1-6f8c-44e6-b5ee-7f6b231f9dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:32.912746 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489fbf1-6f8c-44e6-b5ee-7f6b231f9dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:32.913194 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489fbf1-6f8c-44e6-b5ee-7f6b231f9dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:32.913490 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489fbf1-6f8c-44e6-b5ee-7f6b231f9dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.914714 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489fbf1-6f8c-44e6-b5ee-7f6b231f9dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:32.917843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489fbf1-6f8c-44e6-b5ee-7f6b231f9dc1 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:32.935999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1031/2052] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:32.935999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489fbf1-6f8c-44e6-b5ee-7f6b231f9dc1 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:32.936280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f489fbf1-6f8c-44e6-b5ee-7f6b231f9dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:32.945164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:32.951288 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489fbf1-6f8c-44e6-b5ee-7f6b231f9dc1 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:32.960875 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747cd03-6530-4ef5-a49f-6569827186cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:32.962803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747cd03-6530-4ef5-a49f-6569827186cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:32.962803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747cd03-6530-4ef5-a49f-6569827186cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:32.963273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747cd03-6530-4ef5-a49f-6569827186cd admin admin] PATH_INFO: `/v3/projects/eb3be2cbefe64aa0a5f6b1f5ca03c4fc` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:32.963538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:32.965221 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747cd03-6530-4ef5-a49f-6569827186cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb3be2cbefe64aa0a5f6b1f5ca03c4fc)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:32.968475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747cd03-6530-4ef5-a49f-6569827186cd admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:33.002681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908feda-241f-46c8-acd5-aa673d228cb9 service placement] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:33.007894 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1483c2-0dd4-452b-8fa7-192db7698c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:33.008697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1483c2-0dd4-452b-8fa7-192db7698c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:33.009098 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1483c2-0dd4-452b-8fa7-192db7698c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:33.009470 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1483c2-0dd4-452b-8fa7-192db7698c09 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:33.010240 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1483c2-0dd4-452b-8fa7-192db7698c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:33.012541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1483c2-0dd4-452b-8fa7-192db7698c09 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:33.027327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b747cd03-6530-4ef5-a49f-6569827186cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb3be2cbefe64aa0a5f6b1f5ca03c4fc', 'request_id': 'req-b747cd03-6530-4ef5-a49f-6569827186cd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.036316 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b747cd03-6530-4ef5-a49f-6569827186cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb3be2cbefe64aa0a5f6b1f5ca03c4fc', 'request_id': 'req-b747cd03-6530-4ef5-a49f-6569827186cd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.045475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1022/2053] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:32 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:33.045475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1483c2-0dd4-452b-8fa7-192db7698c09 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:33.045780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b747cd03-6530-4ef5-a49f-6569827186cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb3be2cbefe64aa0a5f6b1f5ca03c4fc', 'request_id': 'req-b747cd03-6530-4ef5-a49f-6569827186cd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.047651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6f1483c2-0dd4-452b-8fa7-192db7698c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:33.059617 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b747cd03-6530-4ef5-a49f-6569827186cd admin admin] The token cache is being invalidate because project eb3be2cbefe64aa0a5f6b1f5ca03c4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:33.059907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b747cd03-6530-4ef5-a49f-6569827186cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.060588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b747cd03-6530-4ef5-a49f-6569827186cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.061006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1483c2-0dd4-452b-8fa7-192db7698c09 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:33.062147 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1032/2054] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:32 2022] DELETE /identity/v3/projects/eb3be2cbefe64aa0a5f6b1f5ca03c4fc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:33.063035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747cd03-6530-4ef5-a49f-6569827186cd admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:33.064411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b747cd03-6530-4ef5-a49f-6569827186cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:33.125046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b8555-6314-424d-b0ff-5ebd2e037d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:33.125928 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b8555-6314-424d-b0ff-5ebd2e037d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:33.126239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b8555-6314-424d-b0ff-5ebd2e037d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:33.126557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b8555-6314-424d-b0ff-5ebd2e037d1e admin admin] PATH_INFO: `/v3/projects/68fa26d88a6e4be292ef036169fc667a` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:33.127853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b8555-6314-424d-b0ff-5ebd2e037d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fa26d88a6e4be292ef036169fc667a)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:33.129770 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b8555-6314-424d-b0ff-5ebd2e037d1e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:33.132635 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747cd03-6530-4ef5-a49f-6569827186cd admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:33.137446 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd059ce9-118b-4744-a80b-edf6cb6109f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:33.138099 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd059ce9-118b-4744-a80b-edf6cb6109f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:33.138488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd059ce9-118b-4744-a80b-edf6cb6109f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:33.138789 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd059ce9-118b-4744-a80b-edf6cb6109f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:33.139598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd059ce9-118b-4744-a80b-edf6cb6109f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:33.141468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd059ce9-118b-4744-a80b-edf6cb6109f7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:33.152033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1033/2055] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:33.152941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd059ce9-118b-4744-a80b-edf6cb6109f7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:33.154680 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fd059ce9-118b-4744-a80b-edf6cb6109f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:33.169120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd059ce9-118b-4744-a80b-edf6cb6109f7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:33.180233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-852b8555-6314-424d-b0ff-5ebd2e037d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fa26d88a6e4be292ef036169fc667a', 'request_id': 'req-852b8555-6314-424d-b0ff-5ebd2e037d1e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.185685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-852b8555-6314-424d-b0ff-5ebd2e037d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fa26d88a6e4be292ef036169fc667a', 'request_id': 'req-852b8555-6314-424d-b0ff-5ebd2e037d1e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.193321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-852b8555-6314-424d-b0ff-5ebd2e037d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fa26d88a6e4be292ef036169fc667a', 'request_id': 'req-852b8555-6314-424d-b0ff-5ebd2e037d1e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.206593 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-852b8555-6314-424d-b0ff-5ebd2e037d1e admin admin] The token cache is being invalidate because project 68fa26d88a6e4be292ef036169fc667a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:33.207008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-852b8555-6314-424d-b0ff-5ebd2e037d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.207734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-852b8555-6314-424d-b0ff-5ebd2e037d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.209553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1023/2056] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:33 2022] DELETE /identity/v3/projects/68fa26d88a6e4be292ef036169fc667a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:33.210769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b8555-6314-424d-b0ff-5ebd2e037d1e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:33.211745 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-852b8555-6314-424d-b0ff-5ebd2e037d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:33.229273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596b273-481a-4887-8df7-0d6dcda052d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:33.230140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596b273-481a-4887-8df7-0d6dcda052d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:33.230422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596b273-481a-4887-8df7-0d6dcda052d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:33.230727 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596b273-481a-4887-8df7-0d6dcda052d3 admin admin] PATH_INFO: `/v3/projects/fdbbf35cd82648878dc957fe3bf4ed5a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:33.231924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596b273-481a-4887-8df7-0d6dcda052d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdbbf35cd82648878dc957fe3bf4ed5a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:33.233923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596b273-481a-4887-8df7-0d6dcda052d3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:33.258808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:33.263407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:33.281924 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b8555-6314-424d-b0ff-5ebd2e037d1e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:33.283972 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c596b273-481a-4887-8df7-0d6dcda052d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdbbf35cd82648878dc957fe3bf4ed5a', 'request_id': 'req-c596b273-481a-4887-8df7-0d6dcda052d3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.289559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c596b273-481a-4887-8df7-0d6dcda052d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdbbf35cd82648878dc957fe3bf4ed5a', 'request_id': 'req-c596b273-481a-4887-8df7-0d6dcda052d3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.297236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c596b273-481a-4887-8df7-0d6dcda052d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdbbf35cd82648878dc957fe3bf4ed5a', 'request_id': 'req-c596b273-481a-4887-8df7-0d6dcda052d3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.309999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c596b273-481a-4887-8df7-0d6dcda052d3 admin admin] The token cache is being invalidate because project fdbbf35cd82648878dc957fe3bf4ed5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:33.310496 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c596b273-481a-4887-8df7-0d6dcda052d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.311273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c596b273-481a-4887-8df7-0d6dcda052d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.312927 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1034/2057] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:33 2022] DELETE /identity/v3/projects/fdbbf35cd82648878dc957fe3bf4ed5a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:33.313783 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596b273-481a-4887-8df7-0d6dcda052d3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:33.315561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c596b273-481a-4887-8df7-0d6dcda052d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:33.354130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dc792-d080-475d-9597-ebe100da425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:33.355065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dc792-d080-475d-9597-ebe100da425f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:33.355433 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dc792-d080-475d-9597-ebe100da425f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:33.355774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dc792-d080-475d-9597-ebe100da425f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:33.356610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dc792-d080-475d-9597-ebe100da425f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:33.358281 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dc792-d080-475d-9597-ebe100da425f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:33.369033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1024/2058] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:33.369856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dc792-d080-475d-9597-ebe100da425f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:33.372460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-930dc792-d080-475d-9597-ebe100da425f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:33.386992 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dc792-d080-475d-9597-ebe100da425f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:33.389977 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596b273-481a-4887-8df7-0d6dcda052d3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:33.391975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4131fb-2b9a-4dee-b1f4-2afea772b3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:33.393652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4131fb-2b9a-4dee-b1f4-2afea772b3db admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:33.393934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4131fb-2b9a-4dee-b1f4-2afea772b3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:33.394210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4131fb-2b9a-4dee-b1f4-2afea772b3db admin admin] PATH_INFO: `/v3/projects/127c97739ba84f19a4f98edc74623230/users/5f37cb91f4794328939f0302f1fd467d/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:33.395463 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f8121-808c-4590-8ba4-b9a241241cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:33.396456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f8121-808c-4590-8ba4-b9a241241cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:33.396824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f8121-808c-4590-8ba4-b9a241241cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:33.397183 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f8121-808c-4590-8ba4-b9a241241cea admin admin] PATH_INFO: `/v3/users/d706cac851a144cf832daa3e6cfbf947` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:33.398494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f8121-808c-4590-8ba4-b9a241241cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d706cac851a144cf832daa3e6cfbf947)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:33.400428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f8121-808c-4590-8ba4-b9a241241cea admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:33.409844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4131fb-2b9a-4dee-b1f4-2afea772b3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=127c97739ba84f19a4f98edc74623230, user_id=5f37cb91f4794328939f0302f1fd467d, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:33.412996 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4131fb-2b9a-4dee-b1f4-2afea772b3db admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:33.429522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1025/2059] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:33 2022] PUT /identity/v3/projects/127c97739ba84f19a4f98edc74623230/users/5f37cb91f4794328939f0302f1fd467d/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:33.430459 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4131fb-2b9a-4dee-b1f4-2afea772b3db admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:33.432130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ee4131fb-2b9a-4dee-b1f4-2afea772b3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:33.452480 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c37f8121-808c-4590-8ba4-b9a241241cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd706cac851a144cf832daa3e6cfbf947'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.466035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c37f8121-808c-4590-8ba4-b9a241241cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd706cac851a144cf832daa3e6cfbf947'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.466758 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c37f8121-808c-4590-8ba4-b9a241241cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd706cac851a144cf832daa3e6cfbf947'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.467401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c37f8121-808c-4590-8ba4-b9a241241cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd706cac851a144cf832daa3e6cfbf947'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.475554 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c37f8121-808c-4590-8ba4-b9a241241cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd706cac851a144cf832daa3e6cfbf947'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.491838 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1035/2060] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:33 2022] DELETE /identity/v3/users/d706cac851a144cf832daa3e6cfbf947 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:33.494753 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df32fcd-38cf-4509-b5ac-af23750ec259 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:33.494753 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df32fcd-38cf-4509-b5ac-af23750ec259 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:33.494753 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df32fcd-38cf-4509-b5ac-af23750ec259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:33.505852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4131fb-2b9a-4dee-b1f4-2afea772b3db admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:33.520376 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3df32fcd-38cf-4509-b5ac-af23750ec259 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:33.521775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3df32fcd-38cf-4509-b5ac-af23750ec259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:33.554294 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:33.596629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e6b97-c92b-4931-b7d4-7ed0fa24d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:33.599710 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e6b97-c92b-4931-b7d4-7ed0fa24d7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:33.600098 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e6b97-c92b-4931-b7d4-7ed0fa24d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:33.600452 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e6b97-c92b-4931-b7d4-7ed0fa24d7b1 admin admin] PATH_INFO: `/v3/users/a47578c42b1c47a0a1b8ffb4b06af777` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:33.607557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1036/2061] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:33.608360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e6b97-c92b-4931-b7d4-7ed0fa24d7b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47578c42b1c47a0a1b8ffb4b06af777)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:33.608479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df32fcd-38cf-4509-b5ac-af23750ec259 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:33.608594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e6b97-c92b-4931-b7d4-7ed0fa24d7b1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:33.608696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3df32fcd-38cf-4509-b5ac-af23750ec259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:33.623915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df32fcd-38cf-4509-b5ac-af23750ec259 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:33.625786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:33.633285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7528f-be77-4924-96d8-d55d59b1de28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:33.634123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7528f-be77-4924-96d8-d55d59b1de28 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:33.634472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7528f-be77-4924-96d8-d55d59b1de28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:33.634860 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7528f-be77-4924-96d8-d55d59b1de28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:33.635745 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7528f-be77-4924-96d8-d55d59b1de28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:33.638042 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7528f-be77-4924-96d8-d55d59b1de28 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:33.651703 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1037/2062] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:33.653458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0c24b-a767-4dad-b209-eb711fa10e60 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:33.654275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0c24b-a767-4dad-b209-eb711fa10e60 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:33.654275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0c24b-a767-4dad-b209-eb711fa10e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:33.678530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2b9e6b97-c92b-4931-b7d4-7ed0fa24d7b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47578c42b1c47a0a1b8ffb4b06af777'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.679119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2b9e6b97-c92b-4931-b7d4-7ed0fa24d7b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47578c42b1c47a0a1b8ffb4b06af777'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.691974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6fa0c24b-a767-4dad-b209-eb711fa10e60 None None] MFA Rules not processed for user `5f37cb91f4794328939f0302f1fd467d`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:33.693595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6fa0c24b-a767-4dad-b209-eb711fa10e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:33.698286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2b9e6b97-c92b-4931-b7d4-7ed0fa24d7b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47578c42b1c47a0a1b8ffb4b06af777'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.699069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2b9e6b97-c92b-4931-b7d4-7ed0fa24d7b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47578c42b1c47a0a1b8ffb4b06af777'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.710872 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2b9e6b97-c92b-4931-b7d4-7ed0fa24d7b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47578c42b1c47a0a1b8ffb4b06af777'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:33.734188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1026/2063] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:33 2022] DELETE /identity/v3/users/a47578c42b1c47a0a1b8ffb4b06af777 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:33.735369 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3d07b-76ea-487f-9118-afe115df3223 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:33.735661 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3d07b-76ea-487f-9118-afe115df3223 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:33.735938 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3d07b-76ea-487f-9118-afe115df3223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:33.763627 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-89f3d07b-76ea-487f-9118-afe115df3223 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:33.765303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-89f3d07b-76ea-487f-9118-afe115df3223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:33.795046 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1038/2064] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:33.800419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0c24b-a767-4dad-b209-eb711fa10e60 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:33.803890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6fa0c24b-a767-4dad-b209-eb711fa10e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:33.823642 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0c24b-a767-4dad-b209-eb711fa10e60 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:33.867036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1027/2065] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:33.868121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3d07b-76ea-487f-9118-afe115df3223 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:33.869653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-89f3d07b-76ea-487f-9118-afe115df3223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:33.895637 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3d07b-76ea-487f-9118-afe115df3223 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:33.897149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa474b-3e3a-490e-8d3c-fb23ee495c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:33.898227 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa474b-3e3a-490e-8d3c-fb23ee495c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:33.898549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa474b-3e3a-490e-8d3c-fb23ee495c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:33.898818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa474b-3e3a-490e-8d3c-fb23ee495c7e admin admin] PATH_INFO: `/v3/projects/6d2fd57779524db398ad5f3e6e3ca4c3/users/55fa43ea8b0a4620ab6cedddc5e8ac3d/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:33.902278 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083dcdb-a3ef-4a94-b8c9-0bb7cdb22f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:33.903107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083dcdb-a3ef-4a94-b8c9-0bb7cdb22f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:33.903497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083dcdb-a3ef-4a94-b8c9-0bb7cdb22f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:33.912737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083dcdb-a3ef-4a94-b8c9-0bb7cdb22f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:33.913609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083dcdb-a3ef-4a94-b8c9-0bb7cdb22f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:33.915724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083dcdb-a3ef-4a94-b8c9-0bb7cdb22f91 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:33.915845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa474b-3e3a-490e-8d3c-fb23ee495c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d2fd57779524db398ad5f3e6e3ca4c3, user_id=55fa43ea8b0a4620ab6cedddc5e8ac3d, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:33.918444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa474b-3e3a-490e-8d3c-fb23ee495c7e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:33.946030 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1039/2066] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:33 2022] PUT /identity/v3/projects/6d2fd57779524db398ad5f3e6e3ca4c3/users/55fa43ea8b0a4620ab6cedddc5e8ac3d/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:33.946030 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa474b-3e3a-490e-8d3c-fb23ee495c7e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:33.965122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1028/2067] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:33 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:33.966202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083dcdb-a3ef-4a94-b8c9-0bb7cdb22f91 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:33.967797 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a083dcdb-a3ef-4a94-b8c9-0bb7cdb22f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:33.988996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:34.019686 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa474b-3e3a-490e-8d3c-fb23ee495c7e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.040359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083dcdb-a3ef-4a94-b8c9-0bb7cdb22f91 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.045111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca54d02-aa7d-4dec-b346-48a05ef9c032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.045971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca54d02-aa7d-4dec-b346-48a05ef9c032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.046256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca54d02-aa7d-4dec-b346-48a05ef9c032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.046582 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca54d02-aa7d-4dec-b346-48a05ef9c032 admin admin] PATH_INFO: `/v3/projects/d61417ce665a4b67a34b0e59d694b132` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.047774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca54d02-aa7d-4dec-b346-48a05ef9c032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d61417ce665a4b67a34b0e59d694b132)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.050293 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca54d02-aa7d-4dec-b346-48a05ef9c032 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.068624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:34.098793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08819b-d5c4-4a62-b03f-59eabc675049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.100284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08819b-d5c4-4a62-b03f-59eabc675049 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.100581 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08819b-d5c4-4a62-b03f-59eabc675049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.101131 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08819b-d5c4-4a62-b03f-59eabc675049 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.101893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08819b-d5c4-4a62-b03f-59eabc675049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:34.102202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08819b-d5c4-4a62-b03f-59eabc675049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.104356 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08819b-d5c4-4a62-b03f-59eabc675049 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.115790 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6ca54d02-aa7d-4dec-b346-48a05ef9c032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61417ce665a4b67a34b0e59d694b132', 'request_id': 'req-6ca54d02-aa7d-4dec-b346-48a05ef9c032'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:34.122494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1040/2068] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:34.122494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae86d-8bda-42b6-81ae-818396754c51 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.122494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae86d-8bda-42b6-81ae-818396754c51 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.122494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae86d-8bda-42b6-81ae-818396754c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.123898 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6ca54d02-aa7d-4dec-b346-48a05ef9c032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61417ce665a4b67a34b0e59d694b132', 'request_id': 'req-6ca54d02-aa7d-4dec-b346-48a05ef9c032'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:34.132882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6ca54d02-aa7d-4dec-b346-48a05ef9c032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61417ce665a4b67a34b0e59d694b132', 'request_id': 'req-6ca54d02-aa7d-4dec-b346-48a05ef9c032'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:34.147473 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6ca54d02-aa7d-4dec-b346-48a05ef9c032 admin admin] The token cache is being invalidate because project d61417ce665a4b67a34b0e59d694b132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:34.147737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6ca54d02-aa7d-4dec-b346-48a05ef9c032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:34.148971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6ca54d02-aa7d-4dec-b346-48a05ef9c032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:34.151186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1029/2069] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:33 2022] DELETE /identity/v3/projects/d61417ce665a4b67a34b0e59d694b132 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:34.151863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca54d02-aa7d-4dec-b346-48a05ef9c032 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.153262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6ca54d02-aa7d-4dec-b346-48a05ef9c032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:34.157543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-415ae86d-8bda-42b6-81ae-818396754c51 None None] MFA Rules not processed for user `55fa43ea8b0a4620ab6cedddc5e8ac3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:34.159687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-415ae86d-8bda-42b6-81ae-818396754c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:34.225989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca54d02-aa7d-4dec-b346-48a05ef9c032 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.230685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c1135-618e-4d08-97bf-216800849e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.231359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c1135-618e-4d08-97bf-216800849e17 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.231643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c1135-618e-4d08-97bf-216800849e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.231932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c1135-618e-4d08-97bf-216800849e17 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.232625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c1135-618e-4d08-97bf-216800849e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.233772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1041/2070] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:34.234571 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c1135-618e-4d08-97bf-216800849e17 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.234869 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ae86d-8bda-42b6-81ae-818396754c51 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.236220 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-415ae86d-8bda-42b6-81ae-818396754c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:34.250594 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ae86d-8bda-42b6-81ae-818396754c51 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.255199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1030/2071] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:34 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:34.256004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c1135-618e-4d08-97bf-216800849e17 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.257200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134b373-5b56-4978-8002-3cd776f1caeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.257576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f96c1135-618e-4d08-97bf-216800849e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:34.258600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134b373-5b56-4978-8002-3cd776f1caeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.258888 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134b373-5b56-4978-8002-3cd776f1caeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.259163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134b373-5b56-4978-8002-3cd776f1caeb admin admin] PATH_INFO: `/v3/projects/7c3ad13321a9433d8d9901174f55d9f9` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.260373 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134b373-5b56-4978-8002-3cd776f1caeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3ad13321a9433d8d9901174f55d9f9)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.262284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134b373-5b56-4978-8002-3cd776f1caeb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.270205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c1135-618e-4d08-97bf-216800849e17 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.274849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f376d-9702-47ed-b537-39c7be8a03ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.275506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f376d-9702-47ed-b537-39c7be8a03ac admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.275791 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f376d-9702-47ed-b537-39c7be8a03ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.276075 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f376d-9702-47ed-b537-39c7be8a03ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.276759 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f376d-9702-47ed-b537-39c7be8a03ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.278676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f376d-9702-47ed-b537-39c7be8a03ac admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.305211 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1031/2072] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:34 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:34.306539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854cf27-7094-4929-87a5-975455c424c7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.306826 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854cf27-7094-4929-87a5-975455c424c7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.307123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854cf27-7094-4929-87a5-975455c424c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.316624 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7134b373-5b56-4978-8002-3cd776f1caeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3ad13321a9433d8d9901174f55d9f9', 'request_id': 'req-7134b373-5b56-4978-8002-3cd776f1caeb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:34.322398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7134b373-5b56-4978-8002-3cd776f1caeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3ad13321a9433d8d9901174f55d9f9', 'request_id': 'req-7134b373-5b56-4978-8002-3cd776f1caeb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:34.324098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:34.325948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a854cf27-7094-4929-87a5-975455c424c7 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:34.327210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a854cf27-7094-4929-87a5-975455c424c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:34.331671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7134b373-5b56-4978-8002-3cd776f1caeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3ad13321a9433d8d9901174f55d9f9', 'request_id': 'req-7134b373-5b56-4978-8002-3cd776f1caeb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:34.343156 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7134b373-5b56-4978-8002-3cd776f1caeb admin admin] The token cache is being invalidate because project 7c3ad13321a9433d8d9901174f55d9f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:34.343693 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7134b373-5b56-4978-8002-3cd776f1caeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:34.350851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7134b373-5b56-4978-8002-3cd776f1caeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:34.355879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1042/2073] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:34 2022] DELETE /identity/v3/projects/7c3ad13321a9433d8d9901174f55d9f9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:34.356815 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134b373-5b56-4978-8002-3cd776f1caeb admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.358186 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7134b373-5b56-4978-8002-3cd776f1caeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:34.409688 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1032/2074] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:34.409688 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854cf27-7094-4929-87a5-975455c424c7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.409688 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a854cf27-7094-4929-87a5-975455c424c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:34.416865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854cf27-7094-4929-87a5-975455c424c7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.421402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8520fd-9339-4ff8-9fc6-6a8cd49374b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.422055 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8520fd-9339-4ff8-9fc6-6a8cd49374b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.422335 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8520fd-9339-4ff8-9fc6-6a8cd49374b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.422640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8520fd-9339-4ff8-9fc6-6a8cd49374b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.423357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8520fd-9339-4ff8-9fc6-6a8cd49374b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.425056 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134b373-5b56-4978-8002-3cd776f1caeb admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.426124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8520fd-9339-4ff8-9fc6-6a8cd49374b5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.429787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29eea2-2121-4537-84c2-4e93ca66f8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.430481 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29eea2-2121-4537-84c2-4e93ca66f8ad admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.430811 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29eea2-2121-4537-84c2-4e93ca66f8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.431088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29eea2-2121-4537-84c2-4e93ca66f8ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.431516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:34.431778 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29eea2-2121-4537-84c2-4e93ca66f8ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.433936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29eea2-2121-4537-84c2-4e93ca66f8ad admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.437022 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1033/2075] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:34.441180 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8520fd-9339-4ff8-9fc6-6a8cd49374b5 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.443564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ac8520fd-9339-4ff8-9fc6-6a8cd49374b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:34.459345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8520fd-9339-4ff8-9fc6-6a8cd49374b5 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.462688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1043/2076] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:34 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:34.464197 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9853b-9601-4c90-b01c-1b40f1bed2a0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.464471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9853b-9601-4c90-b01c-1b40f1bed2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.464682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae5fdb-b5b4-4c7c-b7eb-f0138b78822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.464887 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9853b-9601-4c90-b01c-1b40f1bed2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.465461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae5fdb-b5b4-4c7c-b7eb-f0138b78822e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.465738 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae5fdb-b5b4-4c7c-b7eb-f0138b78822e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.466024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae5fdb-b5b4-4c7c-b7eb-f0138b78822e admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.466749 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae5fdb-b5b4-4c7c-b7eb-f0138b78822e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.468738 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae5fdb-b5b4-4c7c-b7eb-f0138b78822e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.484003 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-98c9853b-9601-4c90-b01c-1b40f1bed2a0 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:34.485265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-98c9853b-9601-4c90-b01c-1b40f1bed2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:34.492239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1034/2077] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:34 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:34.492239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02092e8d-cf46-4f8b-bd4f-97c4ee319fe5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.492239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02092e8d-cf46-4f8b-bd4f-97c4ee319fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.492239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02092e8d-cf46-4f8b-bd4f-97c4ee319fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.509087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-02092e8d-cf46-4f8b-bd4f-97c4ee319fe5 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:34.510321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-02092e8d-cf46-4f8b-bd4f-97c4ee319fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:34.563014 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1044/2078] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:34.563014 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9853b-9601-4c90-b01c-1b40f1bed2a0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.568898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9853b-9601-4c90-b01c-1b40f1bed2a0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.572129 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1035/2079] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:34.573084 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02092e8d-cf46-4f8b-bd4f-97c4ee319fe5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.574097 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39638a72-7094-4dda-abe4-e05c97b5fc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.575019 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39638a72-7094-4dda-abe4-e05c97b5fc10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.575517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39638a72-7094-4dda-abe4-e05c97b5fc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.575696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39638a72-7094-4dda-abe4-e05c97b5fc10 admin admin] PATH_INFO: `/v3/projects/d322b74611d14401a43e616e551c453a/users/5825025a16624cab80d5055d50e406bb/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.583110 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02092e8d-cf46-4f8b-bd4f-97c4ee319fe5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.588329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05593695-b66f-4cb4-a621-8ce3bdf9fb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.589112 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05593695-b66f-4cb4-a621-8ce3bdf9fb1a admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.589474 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05593695-b66f-4cb4-a621-8ce3bdf9fb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.589829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05593695-b66f-4cb4-a621-8ce3bdf9fb1a admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.590555 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05593695-b66f-4cb4-a621-8ce3bdf9fb1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.591890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39638a72-7094-4dda-abe4-e05c97b5fc10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d322b74611d14401a43e616e551c453a, user_id=5825025a16624cab80d5055d50e406bb, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.592519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05593695-b66f-4cb4-a621-8ce3bdf9fb1a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.594562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39638a72-7094-4dda-abe4-e05c97b5fc10 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.609915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1045/2080] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:34 2022] PUT /identity/v3/projects/d322b74611d14401a43e616e551c453a/users/5825025a16624cab80d5055d50e406bb/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:34.610772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39638a72-7094-4dda-abe4-e05c97b5fc10 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.617112 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1036/2081] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:34 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:34.618320 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112a071-dd78-4920-94be-45666001e785 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.618645 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112a071-dd78-4920-94be-45666001e785 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.618920 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112a071-dd78-4920-94be-45666001e785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.637298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-6112a071-dd78-4920-94be-45666001e785 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:34.638789 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6112a071-dd78-4920-94be-45666001e785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:34.666987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:34.683398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39638a72-7094-4dda-abe4-e05c97b5fc10 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.688268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe0a2d-9dfa-4e37-a3bd-1d27ff762a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.688944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0a2d-9dfa-4e37-a3bd-1d27ff762a25 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.689284 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0a2d-9dfa-4e37-a3bd-1d27ff762a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.689834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0a2d-9dfa-4e37-a3bd-1d27ff762a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.690340 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe0a2d-9dfa-4e37-a3bd-1d27ff762a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.691979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe0a2d-9dfa-4e37-a3bd-1d27ff762a25 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.700755 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1037/2082] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:34.701611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112a071-dd78-4920-94be-45666001e785 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.705725 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1046/2083] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:34.705725 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe0a2d-9dfa-4e37-a3bd-1d27ff762a25 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.711379 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112a071-dd78-4920-94be-45666001e785 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.715075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe0a2d-9dfa-4e37-a3bd-1d27ff762a25 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.715947 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0c6a7-96e7-439b-8df9-f815ec937234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.716601 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0c6a7-96e7-439b-8df9-f815ec937234 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.716889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0c6a7-96e7-439b-8df9-f815ec937234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.717161 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0c6a7-96e7-439b-8df9-f815ec937234 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.717879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0c6a7-96e7-439b-8df9-f815ec937234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:34.718185 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0c6a7-96e7-439b-8df9-f815ec937234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.719821 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0c6a7-96e7-439b-8df9-f815ec937234 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.720057 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd50eb-e1af-4d3e-b8e9-972b8dc93c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.722796 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd50eb-e1af-4d3e-b8e9-972b8dc93c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.722796 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd50eb-e1af-4d3e-b8e9-972b8dc93c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.722796 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd50eb-e1af-4d3e-b8e9-972b8dc93c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.722796 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd50eb-e1af-4d3e-b8e9-972b8dc93c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.724288 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd50eb-e1af-4d3e-b8e9-972b8dc93c52 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.741344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1038/2084] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:34.741344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0c6a7-96e7-439b-8df9-f815ec937234 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.741702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1047/2085] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:34.742666 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd50eb-e1af-4d3e-b8e9-972b8dc93c52 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.749646 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0c6a7-96e7-439b-8df9-f815ec937234 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.753860 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd50eb-e1af-4d3e-b8e9-972b8dc93c52 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.755034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd12a7-36ba-46e3-b390-498545537f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.755950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd12a7-36ba-46e3-b390-498545537f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.756490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd12a7-36ba-46e3-b390-498545537f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.756887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd12a7-36ba-46e3-b390-498545537f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.757861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd12a7-36ba-46e3-b390-498545537f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.758775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a672ff-0c20-4abe-a8a5-f13fad95ece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.759448 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a672ff-0c20-4abe-a8a5-f13fad95ece3 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.759737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a672ff-0c20-4abe-a8a5-f13fad95ece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.759965 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd12a7-36ba-46e3-b390-498545537f63 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.760074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a672ff-0c20-4abe-a8a5-f13fad95ece3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.760740 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a672ff-0c20-4abe-a8a5-f13fad95ece3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:34.761054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a672ff-0c20-4abe-a8a5-f13fad95ece3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.762696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a672ff-0c20-4abe-a8a5-f13fad95ece3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.775454 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1039/2086] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:34.775454 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd12a7-36ba-46e3-b390-498545537f63 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.783685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1048/2087] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:34.783685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a672ff-0c20-4abe-a8a5-f13fad95ece3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.791261 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd12a7-36ba-46e3-b390-498545537f63 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.795189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a672ff-0c20-4abe-a8a5-f13fad95ece3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.796176 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9996d94-bb5a-4be2-9edf-ae3af1619211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.796852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9996d94-bb5a-4be2-9edf-ae3af1619211 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.797141 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9996d94-bb5a-4be2-9edf-ae3af1619211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.797431 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9996d94-bb5a-4be2-9edf-ae3af1619211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.798165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9996d94-bb5a-4be2-9edf-ae3af1619211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.800329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9996d94-bb5a-4be2-9edf-ae3af1619211 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.801137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5583fa4-6ed0-4c3b-8021-8b5d35774116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.801868 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583fa4-6ed0-4c3b-8021-8b5d35774116 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.802221 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583fa4-6ed0-4c3b-8021-8b5d35774116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.802922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583fa4-6ed0-4c3b-8021-8b5d35774116 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.803334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5583fa4-6ed0-4c3b-8021-8b5d35774116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.805250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5583fa4-6ed0-4c3b-8021-8b5d35774116 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.816806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1040/2088] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:34.816806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9996d94-bb5a-4be2-9edf-ae3af1619211 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.824739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9996d94-bb5a-4be2-9edf-ae3af1619211 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.830582 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173d30b-fd38-4a2c-b83e-52de136c5d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.831718 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173d30b-fd38-4a2c-b83e-52de136c5d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.832003 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173d30b-fd38-4a2c-b83e-52de136c5d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.832285 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173d30b-fd38-4a2c-b83e-52de136c5d17 admin admin] PATH_INFO: `/v3/projects/d322b74611d14401a43e616e551c453a/users/5825025a16624cab80d5055d50e406bb/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.834316 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173d30b-fd38-4a2c-b83e-52de136c5d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d322b74611d14401a43e616e551c453a, user_id=5825025a16624cab80d5055d50e406bb, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.837328 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173d30b-fd38-4a2c-b83e-52de136c5d17 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.842028 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1049/2089] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:34 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:34.843140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5583fa4-6ed0-4c3b-8021-8b5d35774116 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.853209 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1041/2090] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:34 2022] PUT /identity/v3/projects/d322b74611d14401a43e616e551c453a/users/5825025a16624cab80d5055d50e406bb/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:34.854183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173d30b-fd38-4a2c-b83e-52de136c5d17 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.875343 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:34.916890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5583fa4-6ed0-4c3b-8021-8b5d35774116 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.934914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173d30b-fd38-4a2c-b83e-52de136c5d17 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:34.940362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd414a1-1b60-425e-b7d6-dfc3ef4fd09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.941096 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd414a1-1b60-425e-b7d6-dfc3ef4fd09a admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.941368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd414a1-1b60-425e-b7d6-dfc3ef4fd09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.941647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd414a1-1b60-425e-b7d6-dfc3ef4fd09a admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.942343 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd414a1-1b60-425e-b7d6-dfc3ef4fd09a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.944321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd414a1-1b60-425e-b7d6-dfc3ef4fd09a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.974467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1042/2091] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:34 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:34.974467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd414a1-1b60-425e-b7d6-dfc3ef4fd09a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:34.980136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37522a68-19ad-41ed-9875-c9cfacca85fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:34.980875 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37522a68-19ad-41ed-9875-c9cfacca85fe admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:34.981160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37522a68-19ad-41ed-9875-c9cfacca85fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:34.981469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37522a68-19ad-41ed-9875-c9cfacca85fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:34.982203 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37522a68-19ad-41ed-9875-c9cfacca85fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:34.983865 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37522a68-19ad-41ed-9875-c9cfacca85fe admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:34.997274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1050/2092] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:34.997274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37522a68-19ad-41ed-9875-c9cfacca85fe admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:35.005604 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37522a68-19ad-41ed-9875-c9cfacca85fe admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:35.036824 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd414a1-1b60-425e-b7d6-dfc3ef4fd09a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:35.041716 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dc243-fdf8-4563-b66e-5ca9a05e9ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:35.042649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dc243-fdf8-4563-b66e-5ca9a05e9ede admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.042936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dc243-fdf8-4563-b66e-5ca9a05e9ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.043232 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dc243-fdf8-4563-b66e-5ca9a05e9ede admin admin] PATH_INFO: `/v3/projects/1a92b5c9383f4497bea2a2971cca40e4/users/10638aa389dd4bb9bb82da7bf11c4b60/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.047687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:35.058790 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6dc243-fdf8-4563-b66e-5ca9a05e9ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a92b5c9383f4497bea2a2971cca40e4, user_id=10638aa389dd4bb9bb82da7bf11c4b60, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:35.061484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6dc243-fdf8-4563-b66e-5ca9a05e9ede admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:35.066761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61e48d-4599-4efd-b480-759b7c61ef65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:35.067563 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61e48d-4599-4efd-b480-759b7c61ef65 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.067910 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61e48d-4599-4efd-b480-759b7c61ef65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.068290 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61e48d-4599-4efd-b480-759b7c61ef65 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.068975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61e48d-4599-4efd-b480-759b7c61ef65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:35.071163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61e48d-4599-4efd-b480-759b7c61ef65 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:35.075313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1043/2093] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:34 2022] PUT /identity/v3/projects/1a92b5c9383f4497bea2a2971cca40e4/users/10638aa389dd4bb9bb82da7bf11c4b60/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:35.076664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338da5f-6286-4051-91e8-6dde59a42779 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.076956 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338da5f-6286-4051-91e8-6dde59a42779 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.077237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338da5f-6286-4051-91e8-6dde59a42779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.092775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1051/2094] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:34 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:35.093589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61e48d-4599-4efd-b480-759b7c61ef65 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:35.105502 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61e48d-4599-4efd-b480-759b7c61ef65 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:35.106131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8338da5f-6286-4051-91e8-6dde59a42779 None None] MFA Rules not processed for user `5825025a16624cab80d5055d50e406bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:35.107218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8338da5f-6286-4051-91e8-6dde59a42779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:35.165895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec1210-2ee0-4285-8846-f6f44ff9373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:35.166533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec1210-2ee0-4285-8846-f6f44ff9373e admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.166829 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec1210-2ee0-4285-8846-f6f44ff9373e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.167111 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec1210-2ee0-4285-8846-f6f44ff9373e admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.167806 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec1210-2ee0-4285-8846-f6f44ff9373e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:35.169955 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec1210-2ee0-4285-8846-f6f44ff9373e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:35.180980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1044/2095] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:35.181887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338da5f-6286-4051-91e8-6dde59a42779 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:35.193482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338da5f-6286-4051-91e8-6dde59a42779 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:35.194477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1052/2096] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:35 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:35.195880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193bac2-7ad0-4d8f-bbce-a755acf5af1a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.196172 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193bac2-7ad0-4d8f-bbce-a755acf5af1a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.196452 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193bac2-7ad0-4d8f-bbce-a755acf5af1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.201389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb1a4c-f0fb-4270-b992-692b7c65f177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:35.202360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb1a4c-f0fb-4270-b992-692b7c65f177 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.202682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb1a4c-f0fb-4270-b992-692b7c65f177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.202964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb1a4c-f0fb-4270-b992-692b7c65f177 admin admin] PATH_INFO: `/v3/projects/3117ff739921483ca2b017d3302f0170/users/63947729bec344c7a3ff4cb72126bdef/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.211348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:35.215008 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9193bac2-7ad0-4d8f-bbce-a755acf5af1a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:35.216236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9193bac2-7ad0-4d8f-bbce-a755acf5af1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:35.219817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb1a4c-f0fb-4270-b992-692b7c65f177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3117ff739921483ca2b017d3302f0170, user_id=63947729bec344c7a3ff4cb72126bdef, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:35.222553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb1a4c-f0fb-4270-b992-692b7c65f177 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:35.224734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1053/2097] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:35.225493 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193bac2-7ad0-4d8f-bbce-a755acf5af1a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:35.237232 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193bac2-7ad0-4d8f-bbce-a755acf5af1a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:35.237990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1045/2098] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:35 2022] PUT /identity/v3/projects/3117ff739921483ca2b017d3302f0170/users/63947729bec344c7a3ff4cb72126bdef/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:35.238922 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb1a4c-f0fb-4270-b992-692b7c65f177 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:35.240502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b0bb1a4c-f0fb-4270-b992-692b7c65f177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:35.298369 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb1a4c-f0fb-4270-b992-692b7c65f177 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:35.302139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38183e2-40d7-4e4d-b239-41ff1d8ea46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:35.302585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf0879-9d01-4030-96c2-0420e4671e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:35.302855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38183e2-40d7-4e4d-b239-41ff1d8ea46b admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.303147 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38183e2-40d7-4e4d-b239-41ff1d8ea46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.303273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf0879-9d01-4030-96c2-0420e4671e17 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.303431 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38183e2-40d7-4e4d-b239-41ff1d8ea46b admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.303526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf0879-9d01-4030-96c2-0420e4671e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.303752 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf0879-9d01-4030-96c2-0420e4671e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.304162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38183e2-40d7-4e4d-b239-41ff1d8ea46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:35.305559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-afaf0879-9d01-4030-96c2-0420e4671e17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:35.305809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38183e2-40d7-4e4d-b239-41ff1d8ea46b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:35.319798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1054/2099] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:35.319798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38183e2-40d7-4e4d-b239-41ff1d8ea46b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:35.328681 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38183e2-40d7-4e4d-b239-41ff1d8ea46b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:35.337667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8666820-1380-4370-b906-a124751195ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:35.338361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8666820-1380-4370-b906-a124751195ec admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.338687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8666820-1380-4370-b906-a124751195ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.338973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8666820-1380-4370-b906-a124751195ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.339710 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8666820-1380-4370-b906-a124751195ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:35.341346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8666820-1380-4370-b906-a124751195ec admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:35.362082 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1055/2100] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:35.362082 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8666820-1380-4370-b906-a124751195ec admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:35.362366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b8666820-1380-4370-b906-a124751195ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:35.390026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf0879-9d01-4030-96c2-0420e4671e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:35.391539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf0879-9d01-4030-96c2-0420e4671e17 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:35.402167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1046/2101] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:35.403497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820a7b8-eec6-4f22-8bf2-30f5c6da9f39 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.403788 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820a7b8-eec6-4f22-8bf2-30f5c6da9f39 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.404071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820a7b8-eec6-4f22-8bf2-30f5c6da9f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.414769 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:35.433935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7820a7b8-eec6-4f22-8bf2-30f5c6da9f39 None None] MFA Rules not processed for user `63947729bec344c7a3ff4cb72126bdef`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:35.434385 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8666820-1380-4370-b906-a124751195ec admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:35.435208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7820a7b8-eec6-4f22-8bf2-30f5c6da9f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:35.439624 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d8a50-9e17-4df6-8707-9ecced06e0e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:35.440521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8a50-9e17-4df6-8707-9ecced06e0e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.441759 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8a50-9e17-4df6-8707-9ecced06e0e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.442124 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8a50-9e17-4df6-8707-9ecced06e0e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.453323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d8a50-9e17-4df6-8707-9ecced06e0e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:35.455394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d8a50-9e17-4df6-8707-9ecced06e0e9 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:35.468556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1056/2102] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:35.469582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d8a50-9e17-4df6-8707-9ecced06e0e9 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:35.480193 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d8a50-9e17-4df6-8707-9ecced06e0e9 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:35.485146 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62de18e-0785-4156-aff3-7e9472bdda18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:35.485830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de18e-0785-4156-aff3-7e9472bdda18 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.486702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de18e-0785-4156-aff3-7e9472bdda18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.487057 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de18e-0785-4156-aff3-7e9472bdda18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.487740 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62de18e-0785-4156-aff3-7e9472bdda18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:35.489362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62de18e-0785-4156-aff3-7e9472bdda18 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:35.503247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1057/2103] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:35.504142 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62de18e-0785-4156-aff3-7e9472bdda18 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:35.518800 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62de18e-0785-4156-aff3-7e9472bdda18 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:35.526609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1047/2104] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:35.527041 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5334ade-0e56-4049-862e-e02c1c0f273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:35.527703 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820a7b8-eec6-4f22-8bf2-30f5c6da9f39 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:35.527807 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5334ade-0e56-4049-862e-e02c1c0f273d admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.528453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5334ade-0e56-4049-862e-e02c1c0f273d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.528749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5334ade-0e56-4049-862e-e02c1c0f273d admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.530446 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5334ade-0e56-4049-862e-e02c1c0f273d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:35.536017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5334ade-0e56-4049-862e-e02c1c0f273d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:35.541917 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820a7b8-eec6-4f22-8bf2-30f5c6da9f39 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:35.548938 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e176ff-0ba7-46f4-8e4a-104433ee37b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:35.550967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e176ff-0ba7-46f4-8e4a-104433ee37b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.551335 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e176ff-0ba7-46f4-8e4a-104433ee37b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.551782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e176ff-0ba7-46f4-8e4a-104433ee37b0 admin admin] PATH_INFO: `/v3/projects/04e1d961bd9f496281b059b2005b6505/users/6b40875874ed4d06956bdcd92a7d1959/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.552518 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1058/2105] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:35.553906 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5334ade-0e56-4049-862e-e02c1c0f273d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:35.569541 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5334ade-0e56-4049-862e-e02c1c0f273d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:35.573793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e176ff-0ba7-46f4-8e4a-104433ee37b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e1d961bd9f496281b059b2005b6505, user_id=6b40875874ed4d06956bdcd92a7d1959, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:35.577208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24598f-8c4a-4e13-93b3-7dd6ada1b623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:35.578555 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24598f-8c4a-4e13-93b3-7dd6ada1b623 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.579058 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24598f-8c4a-4e13-93b3-7dd6ada1b623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.579237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e176ff-0ba7-46f4-8e4a-104433ee37b0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:35.580794 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24598f-8c4a-4e13-93b3-7dd6ada1b623 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.581684 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24598f-8c4a-4e13-93b3-7dd6ada1b623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:35.584820 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24598f-8c4a-4e13-93b3-7dd6ada1b623 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:35.601936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1048/2106] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:35 2022] PUT /identity/v3/projects/04e1d961bd9f496281b059b2005b6505/users/6b40875874ed4d06956bdcd92a7d1959/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:35.602978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e176ff-0ba7-46f4-8e4a-104433ee37b0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:35.620020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:35.644635 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1059/2107] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:35 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:35.646367 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f206e18-39d2-4375-966a-a1bc3c58255a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.647346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f206e18-39d2-4375-966a-a1bc3c58255a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.648228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f206e18-39d2-4375-966a-a1bc3c58255a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.685576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9f206e18-39d2-4375-966a-a1bc3c58255a None None] MFA Rules not processed for user `6b40875874ed4d06956bdcd92a7d1959`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:35.686818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9f206e18-39d2-4375-966a-a1bc3c58255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:35.739828 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e176ff-0ba7-46f4-8e4a-104433ee37b0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:35.796507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1060/2108] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:35.797478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f206e18-39d2-4375-966a-a1bc3c58255a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:35.817440 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e13b0-aa38-4d7f-a0fb-ab660d2c1e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:35.818974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e13b0-aa38-4d7f-a0fb-ab660d2c1e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:35.819303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e13b0-aa38-4d7f-a0fb-ab660d2c1e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:35.819574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e13b0-aa38-4d7f-a0fb-ab660d2c1e06 admin admin] PATH_INFO: `/v3/projects/d0e9dee4820843a58e09d0b88422d990/users/fd14bf48bda44cfb988799ab849b0712/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:35.851452 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e13b0-aa38-4d7f-a0fb-ab660d2c1e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e9dee4820843a58e09d0b88422d990, user_id=fd14bf48bda44cfb988799ab849b0712, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:35.855053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e13b0-aa38-4d7f-a0fb-ab660d2c1e06 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:35.876389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1049/2109] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:35 2022] PUT /identity/v3/projects/d0e9dee4820843a58e09d0b88422d990/users/fd14bf48bda44cfb988799ab849b0712/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:35.878064 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e13b0-aa38-4d7f-a0fb-ab660d2c1e06 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:35.897469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f206e18-39d2-4375-966a-a1bc3c58255a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:35.955327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:36.011703 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0680fab-b2e3-4bbb-a8ae-a00670ae94b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:36.012598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0680fab-b2e3-4bbb-a8ae-a00670ae94b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:36.012968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0680fab-b2e3-4bbb-a8ae-a00670ae94b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:36.013280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0680fab-b2e3-4bbb-a8ae-a00670ae94b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:36.014170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0680fab-b2e3-4bbb-a8ae-a00670ae94b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:36.014505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e13b0-aa38-4d7f-a0fb-ab660d2c1e06 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:36.016756 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0680fab-b2e3-4bbb-a8ae-a00670ae94b6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:36.020231 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeecc14-2bdd-4aac-babc-7fdb43e2f756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:36.021362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeecc14-2bdd-4aac-babc-7fdb43e2f756 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:36.021880 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeecc14-2bdd-4aac-babc-7fdb43e2f756 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:36.022357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeecc14-2bdd-4aac-babc-7fdb43e2f756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:36.044703 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1061/2110] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:35 2022] POST /identity/v3/users => generated 295 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:36.046198 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44db890-4bbd-4c70-a958-49ac19f3aa41 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:36.046538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44db890-4bbd-4c70-a958-49ac19f3aa41 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:36.046828 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44db890-4bbd-4c70-a958-49ac19f3aa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:36.083979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f44db890-4bbd-4c70-a958-49ac19f3aa41 None None] MFA Rules not processed for user `fd14bf48bda44cfb988799ab849b0712`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:36.085257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f44db890-4bbd-4c70-a958-49ac19f3aa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:36.099653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:36.114664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeecc14-2bdd-4aac-babc-7fdb43e2f756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:36.117172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeecc14-2bdd-4aac-babc-7fdb43e2f756 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:36.148416 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1050/2111] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:36.151012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeecc14-2bdd-4aac-babc-7fdb43e2f756 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:36.179192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeecc14-2bdd-4aac-babc-7fdb43e2f756 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:36.193800 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0504c-5754-406a-a86a-8723597f6660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:36.195360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0504c-5754-406a-a86a-8723597f6660 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:36.196562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0504c-5754-406a-a86a-8723597f6660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:36.196928 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0504c-5754-406a-a86a-8723597f6660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:36.198953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0504c-5754-406a-a86a-8723597f6660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:36.202574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa0504c-5754-406a-a86a-8723597f6660 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:36.208537 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1062/2112] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:36.210680 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44db890-4bbd-4c70-a958-49ac19f3aa41 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:36.226695 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44db890-4bbd-4c70-a958-49ac19f3aa41 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:36.230573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1051/2113] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:36.234951 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0504c-5754-406a-a86a-8723597f6660 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:36.236199 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e870f-a570-4621-8bf4-7e76db1c6520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:36.238052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e870f-a570-4621-8bf4-7e76db1c6520 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:36.239850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e870f-a570-4621-8bf4-7e76db1c6520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:36.240244 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e870f-a570-4621-8bf4-7e76db1c6520 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:36.241124 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e870f-a570-4621-8bf4-7e76db1c6520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:36.247364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e870f-a570-4621-8bf4-7e76db1c6520 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:36.258981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0504c-5754-406a-a86a-8723597f6660 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:36.280758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e1b6b-64fb-488e-b304-6b254ff63e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:36.281714 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e1b6b-64fb-488e-b304-6b254ff63e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:36.282130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e1b6b-64fb-488e-b304-6b254ff63e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:36.282331 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e1b6b-64fb-488e-b304-6b254ff63e29 admin admin] PATH_INFO: `/v3/projects/85810a7081db493cbf747719183d0fde/users/49586c830ed74a6f9a94a6eba26c4065/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:36.304296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1063/2114] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:36 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:36.306741 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e870f-a570-4621-8bf4-7e76db1c6520 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:36.315434 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e1b6b-64fb-488e-b304-6b254ff63e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85810a7081db493cbf747719183d0fde, user_id=49586c830ed74a6f9a94a6eba26c4065, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:36.320888 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e1b6b-64fb-488e-b304-6b254ff63e29 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:36.345274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1052/2115] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:36 2022] PUT /identity/v3/projects/85810a7081db493cbf747719183d0fde/users/49586c830ed74a6f9a94a6eba26c4065/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:36.349760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e1b6b-64fb-488e-b304-6b254ff63e29 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:36.464330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e1b6b-64fb-488e-b304-6b254ff63e29 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:36.473133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e870f-a570-4621-8bf4-7e76db1c6520 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:36.473646 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e2180-ea6b-4cc2-aa93-60d9bdcdfae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:36.474831 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e2180-ea6b-4cc2-aa93-60d9bdcdfae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:36.475489 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e2180-ea6b-4cc2-aa93-60d9bdcdfae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:36.475734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e2180-ea6b-4cc2-aa93-60d9bdcdfae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:36.476735 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e2180-ea6b-4cc2-aa93-60d9bdcdfae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:36.479413 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e2180-ea6b-4cc2-aa93-60d9bdcdfae8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:36.490918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ecef9-74cd-45e9-a97d-33b24369bb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:36.491655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ecef9-74cd-45e9-a97d-33b24369bb70 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:36.491944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ecef9-74cd-45e9-a97d-33b24369bb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:36.492220 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ecef9-74cd-45e9-a97d-33b24369bb70 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:36.493377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ecef9-74cd-45e9-a97d-33b24369bb70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:36.495605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ecef9-74cd-45e9-a97d-33b24369bb70 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:36.507513 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1053/2116] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:17:36.513306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e2180-ea6b-4cc2-aa93-60d9bdcdfae8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:36.540397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e2180-ea6b-4cc2-aa93-60d9bdcdfae8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:36.553062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1064/2117] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:36 2022] POST /identity/v3/users => generated 290 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:36.555108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ecef9-74cd-45e9-a97d-33b24369bb70 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:36.560195 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0558b6-e5a2-4ec9-81a3-7e3b6cf05e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:36.561117 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0558b6-e5a2-4ec9-81a3-7e3b6cf05e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:36.561406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0558b6-e5a2-4ec9-81a3-7e3b6cf05e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:36.567526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0558b6-e5a2-4ec9-81a3-7e3b6cf05e4d admin admin] PATH_INFO: `/v3/projects/85810a7081db493cbf747719183d0fde/users/49586c830ed74a6f9a94a6eba26c4065/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:36.570310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ecef9-74cd-45e9-a97d-33b24369bb70 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:36.572353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0558b6-e5a2-4ec9-81a3-7e3b6cf05e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=85810a7081db493cbf747719183d0fde, user_id=49586c830ed74a6f9a94a6eba26c4065, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:36.576338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e99e7-226e-4bfe-bb21-068b8a0ee37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:36.577006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0558b6-e5a2-4ec9-81a3-7e3b6cf05e4d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:36.577220 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e99e7-226e-4bfe-bb21-068b8a0ee37c admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:36.577645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e99e7-226e-4bfe-bb21-068b8a0ee37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:36.578021 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e99e7-226e-4bfe-bb21-068b8a0ee37c admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:36.579038 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e99e7-226e-4bfe-bb21-068b8a0ee37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:36.581622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e99e7-226e-4bfe-bb21-068b8a0ee37c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:36.591957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1054/2118] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:36 2022] PUT /identity/v3/projects/85810a7081db493cbf747719183d0fde/users/49586c830ed74a6f9a94a6eba26c4065/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:36.598478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1065/2119] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:36.601962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0558b6-e5a2-4ec9-81a3-7e3b6cf05e4d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:36.604411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5bc2a-0bb2-49d0-825a-e5c46e1a7d05 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:36.604411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5bc2a-0bb2-49d0-825a-e5c46e1a7d05 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:36.604788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5bc2a-0bb2-49d0-825a-e5c46e1a7d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:36.643316 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:36.659150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5df5bc2a-0bb2-49d0-825a-e5c46e1a7d05 None None] MFA Rules not processed for user `49586c830ed74a6f9a94a6eba26c4065`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:36.668516 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5df5bc2a-0bb2-49d0-825a-e5c46e1a7d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:36.720853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0558b6-e5a2-4ec9-81a3-7e3b6cf05e4d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:36.728737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442a515-6b6d-42f9-8635-0c62b6c341e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:36.729654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442a515-6b6d-42f9-8635-0c62b6c341e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:36.729990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442a515-6b6d-42f9-8635-0c62b6c341e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:36.730274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442a515-6b6d-42f9-8635-0c62b6c341e0 admin admin] PATH_INFO: `/v3/projects/6212fc99653543c9869d366ba2cdfefe/users/cd40aaed3654475ebca66b08dc6565ab/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:36.757813 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442a515-6b6d-42f9-8635-0c62b6c341e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6212fc99653543c9869d366ba2cdfefe, user_id=cd40aaed3654475ebca66b08dc6565ab, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:36.762279 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442a515-6b6d-42f9-8635-0c62b6c341e0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:36.794718 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1055/2120] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:36 2022] PUT /identity/v3/projects/6212fc99653543c9869d366ba2cdfefe/users/cd40aaed3654475ebca66b08dc6565ab/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:36.795878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442a515-6b6d-42f9-8635-0c62b6c341e0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:36.831463 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1066/2121] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:36.841263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:36.844917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5bc2a-0bb2-49d0-825a-e5c46e1a7d05 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:36.902461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442a515-6b6d-42f9-8635-0c62b6c341e0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:36.908189 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b0612-7d81-4615-b7ce-4788fd5e37ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:36.909096 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b0612-7d81-4615-b7ce-4788fd5e37ed admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:36.909453 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b0612-7d81-4615-b7ce-4788fd5e37ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:36.909963 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b0612-7d81-4615-b7ce-4788fd5e37ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:36.910833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b0612-7d81-4615-b7ce-4788fd5e37ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:36.912540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b0612-7d81-4615-b7ce-4788fd5e37ed admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:36.916850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5bc2a-0bb2-49d0-825a-e5c46e1a7d05 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:36.934997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1056/2122] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:36.936014 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b0612-7d81-4615-b7ce-4788fd5e37ed admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:36.949317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b0612-7d81-4615-b7ce-4788fd5e37ed admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:36.955088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024d42a-2a36-48cb-8382-319435bdf35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:36.956002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024d42a-2a36-48cb-8382-319435bdf35b admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:36.956474 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024d42a-2a36-48cb-8382-319435bdf35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:36.956755 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024d42a-2a36-48cb-8382-319435bdf35b admin admin] PATH_INFO: `/v3/projects/6212fc99653543c9869d366ba2cdfefe/users/cd40aaed3654475ebca66b08dc6565ab/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:36.969600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024d42a-2a36-48cb-8382-319435bdf35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6212fc99653543c9869d366ba2cdfefe, user_id=cd40aaed3654475ebca66b08dc6565ab, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:36.973461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024d42a-2a36-48cb-8382-319435bdf35b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:36.981055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67d130-2e4f-47a2-a735-0e642e4b1828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:36.983571 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67d130-2e4f-47a2-a735-0e642e4b1828 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:36.983973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67d130-2e4f-47a2-a735-0e642e4b1828 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:36.984150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67d130-2e4f-47a2-a735-0e642e4b1828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:36.992669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1057/2123] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:36 2022] PUT /identity/v3/projects/6212fc99653543c9869d366ba2cdfefe/users/cd40aaed3654475ebca66b08dc6565ab/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:37.005038 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe2b2c-543d-42b9-91fe-f15929110fc4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:37.005796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe2b2c-543d-42b9-91fe-f15929110fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:37.006241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe2b2c-543d-42b9-91fe-f15929110fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:37.067814 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f2fe2b2c-543d-42b9-91fe-f15929110fc4 None None] MFA Rules not processed for user `cd40aaed3654475ebca66b08dc6565ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:37.069364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f2fe2b2c-543d-42b9-91fe-f15929110fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:37.110830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67d130-2e4f-47a2-a735-0e642e4b1828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:37.112493 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67d130-2e4f-47a2-a735-0e642e4b1828 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:37.126138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1067/2124] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:37.193902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67d130-2e4f-47a2-a735-0e642e4b1828 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:37.199500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:37.207612 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67d130-2e4f-47a2-a735-0e642e4b1828 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:37.217064 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1058/2125] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:37.301064 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ffb45-b633-45e8-be11-370b665ecbf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:37.302692 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ffb45-b633-45e8-be11-370b665ecbf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:37.304193 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ffb45-b633-45e8-be11-370b665ecbf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:37.304591 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ffb45-b633-45e8-be11-370b665ecbf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:37.309335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a35ffb45-b633-45e8-be11-370b665ecbf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:37.447862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ffb45-b633-45e8-be11-370b665ecbf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:37.449572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ffb45-b633-45e8-be11-370b665ecbf1 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:37.454721 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe2b2c-543d-42b9-91fe-f15929110fc4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:37.456875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f2fe2b2c-543d-42b9-91fe-f15929110fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:37.487225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe2b2c-543d-42b9-91fe-f15929110fc4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:37.489919 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1068/2126] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:37.498372 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264dc2-b12c-4a48-b5cc-d8074153a40e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:37.503262 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264dc2-b12c-4a48-b5cc-d8074153a40e service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:37.503995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264dc2-b12c-4a48-b5cc-d8074153a40e service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:37.503995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264dc2-b12c-4a48-b5cc-d8074153a40e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:37.540150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb264dc2-b12c-4a48-b5cc-d8074153a40e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:37.541633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb264dc2-b12c-4a48-b5cc-d8074153a40e service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:37.569754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1059/2127] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:40.099075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ffb45-b633-45e8-be11-370b665ecbf1 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:40.274552 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ffb45-b633-45e8-be11-370b665ecbf1 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:40.287221 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965dd63-6fd5-4352-8f3c-77583a88b67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:40.288115 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965dd63-6fd5-4352-8f3c-77583a88b67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:40.288565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965dd63-6fd5-4352-8f3c-77583a88b67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:40.288830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965dd63-6fd5-4352-8f3c-77583a88b67f admin admin] PATH_INFO: `/v3/users/fd14bf48bda44cfb988799ab849b0712` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:40.290100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965dd63-6fd5-4352-8f3c-77583a88b67f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd14bf48bda44cfb988799ab849b0712)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:40.292296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965dd63-6fd5-4352-8f3c-77583a88b67f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:40.428519 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c965dd63-6fd5-4352-8f3c-77583a88b67f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd14bf48bda44cfb988799ab849b0712'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:40.443200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:40.463993 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c965dd63-6fd5-4352-8f3c-77583a88b67f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd14bf48bda44cfb988799ab849b0712'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:40.465557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c965dd63-6fd5-4352-8f3c-77583a88b67f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd14bf48bda44cfb988799ab849b0712'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:40.467834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c965dd63-6fd5-4352-8f3c-77583a88b67f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd14bf48bda44cfb988799ab849b0712'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:40.485153 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c965dd63-6fd5-4352-8f3c-77583a88b67f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd14bf48bda44cfb988799ab849b0712'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:40.491192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264dc2-b12c-4a48-b5cc-d8074153a40e service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:40.509165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264dc2-b12c-4a48-b5cc-d8074153a40e service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:40.513035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1069/2128] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:40 2022] DELETE /identity/v3/users/fd14bf48bda44cfb988799ab849b0712 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:40.515361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249fd22-5b05-44a7-bb5b-8b3e237d7df0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:40.515663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249fd22-5b05-44a7-bb5b-8b3e237d7df0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:40.515952 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249fd22-5b05-44a7-bb5b-8b3e237d7df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:40.558850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0249fd22-5b05-44a7-bb5b-8b3e237d7df0 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:40.560174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0249fd22-5b05-44a7-bb5b-8b3e237d7df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:40.601768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830fa84-322c-4c68-a04f-4cada8bae31c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:40.602496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830fa84-322c-4c68-a04f-4cada8bae31c service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:40.602789 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830fa84-322c-4c68-a04f-4cada8bae31c service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:40.603233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830fa84-322c-4c68-a04f-4cada8bae31c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:40.607360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4830fa84-322c-4c68-a04f-4cada8bae31c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:40.661435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:40.662733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1070/2129] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:40.678863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249fd22-5b05-44a7-bb5b-8b3e237d7df0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:40.680472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0249fd22-5b05-44a7-bb5b-8b3e237d7df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:40.713451 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830fa84-322c-4c68-a04f-4cada8bae31c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:40.716037 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830fa84-322c-4c68-a04f-4cada8bae31c service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:40.729328 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1060/2130] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:40.781239 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249fd22-5b05-44a7-bb5b-8b3e237d7df0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:40.786756 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff906d-e388-48ca-bdec-b2be7a5d7caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:40.787954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff906d-e388-48ca-bdec-b2be7a5d7caf service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:40.788639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff906d-e388-48ca-bdec-b2be7a5d7caf service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:40.789065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff906d-e388-48ca-bdec-b2be7a5d7caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:40.807084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff906d-e388-48ca-bdec-b2be7a5d7caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:40.810248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff906d-e388-48ca-bdec-b2be7a5d7caf service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:40.832046 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1071/2131] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:41.264664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830fa84-322c-4c68-a04f-4cada8bae31c service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:41.266142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4830fa84-322c-4c68-a04f-4cada8bae31c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:41.298027 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830fa84-322c-4c68-a04f-4cada8bae31c service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:41.315255 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819453f-acfe-47b0-90b8-556e3f2a403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:41.316142 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819453f-acfe-47b0-90b8-556e3f2a403f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:41.316425 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819453f-acfe-47b0-90b8-556e3f2a403f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:41.316698 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819453f-acfe-47b0-90b8-556e3f2a403f admin admin] PATH_INFO: `/v3/projects/d0e9dee4820843a58e09d0b88422d990` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:41.317956 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819453f-acfe-47b0-90b8-556e3f2a403f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0e9dee4820843a58e09d0b88422d990)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:41.319922 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819453f-acfe-47b0-90b8-556e3f2a403f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:41.413674 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff906d-e388-48ca-bdec-b2be7a5d7caf service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:41.416560 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-dcff906d-e388-48ca-bdec-b2be7a5d7caf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:41.419141 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d819453f-acfe-47b0-90b8-556e3f2a403f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0e9dee4820843a58e09d0b88422d990', 'request_id': 'req-d819453f-acfe-47b0-90b8-556e3f2a403f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:41.429127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d819453f-acfe-47b0-90b8-556e3f2a403f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0e9dee4820843a58e09d0b88422d990', 'request_id': 'req-d819453f-acfe-47b0-90b8-556e3f2a403f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:41.440983 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d819453f-acfe-47b0-90b8-556e3f2a403f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0e9dee4820843a58e09d0b88422d990', 'request_id': 'req-d819453f-acfe-47b0-90b8-556e3f2a403f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:41.441559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff906d-e388-48ca-bdec-b2be7a5d7caf service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:41.467062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d819453f-acfe-47b0-90b8-556e3f2a403f admin admin] The token cache is being invalidate because project d0e9dee4820843a58e09d0b88422d990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:41.467354 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d819453f-acfe-47b0-90b8-556e3f2a403f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:41.468490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d819453f-acfe-47b0-90b8-556e3f2a403f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:41.471929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1061/2132] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:41 2022] DELETE /identity/v3/projects/d0e9dee4820843a58e09d0b88422d990 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:41.478948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819453f-acfe-47b0-90b8-556e3f2a403f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:41.482954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d819453f-acfe-47b0-90b8-556e3f2a403f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:41.532055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1d3e6-320b-481b-b556-dd5d30a66f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:41.533512 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1d3e6-320b-481b-b556-dd5d30a66f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:41.533798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1d3e6-320b-481b-b556-dd5d30a66f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:41.534275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1d3e6-320b-481b-b556-dd5d30a66f66 admin admin] PATH_INFO: `/v3/users/55fa43ea8b0a4620ab6cedddc5e8ac3d` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:41.546411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1d3e6-320b-481b-b556-dd5d30a66f66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55fa43ea8b0a4620ab6cedddc5e8ac3d)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:41.553975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1d3e6-320b-481b-b556-dd5d30a66f66 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:41.588824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:41.636464 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-13a1d3e6-320b-481b-b556-dd5d30a66f66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55fa43ea8b0a4620ab6cedddc5e8ac3d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:41.646625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819453f-acfe-47b0-90b8-556e3f2a403f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:41.663824 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d83bd-d8af-4618-b3ee-2ace5e6d910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:41.665470 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d83bd-d8af-4618-b3ee-2ace5e6d910a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:41.665582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-13a1d3e6-320b-481b-b556-dd5d30a66f66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55fa43ea8b0a4620ab6cedddc5e8ac3d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:41.665982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d83bd-d8af-4618-b3ee-2ace5e6d910a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:41.666402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d83bd-d8af-4618-b3ee-2ace5e6d910a admin admin] PATH_INFO: `/v3/users/cd40aaed3654475ebca66b08dc6565ab` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:41.669770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-13a1d3e6-320b-481b-b556-dd5d30a66f66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55fa43ea8b0a4620ab6cedddc5e8ac3d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:41.670396 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d83bd-d8af-4618-b3ee-2ace5e6d910a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd40aaed3654475ebca66b08dc6565ab)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:41.670849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-13a1d3e6-320b-481b-b556-dd5d30a66f66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55fa43ea8b0a4620ab6cedddc5e8ac3d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:41.673574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d83bd-d8af-4618-b3ee-2ace5e6d910a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:41.684926 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-13a1d3e6-320b-481b-b556-dd5d30a66f66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55fa43ea8b0a4620ab6cedddc5e8ac3d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:41.725430 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1072/2133] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:41 2022] DELETE /identity/v3/users/55fa43ea8b0a4620ab6cedddc5e8ac3d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:41.730968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9bf5d-94be-4695-9003-a21cf4688c80 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:41.731270 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9bf5d-94be-4695-9003-a21cf4688c80 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:41.731544 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9bf5d-94be-4695-9003-a21cf4688c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:41.756701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-66c9bf5d-94be-4695-9003-a21cf4688c80 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:41.758641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-66c9bf5d-94be-4695-9003-a21cf4688c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:41.789368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-de8d83bd-d8af-4618-b3ee-2ace5e6d910a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd40aaed3654475ebca66b08dc6565ab'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:41.789900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-de8d83bd-d8af-4618-b3ee-2ace5e6d910a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd40aaed3654475ebca66b08dc6565ab'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:41.797323 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:41.812274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-de8d83bd-d8af-4618-b3ee-2ace5e6d910a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd40aaed3654475ebca66b08dc6565ab'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:41.813299 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-de8d83bd-d8af-4618-b3ee-2ace5e6d910a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd40aaed3654475ebca66b08dc6565ab'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:41.832925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-de8d83bd-d8af-4618-b3ee-2ace5e6d910a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd40aaed3654475ebca66b08dc6565ab'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:41.851691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1062/2134] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:41 2022] DELETE /identity/v3/users/cd40aaed3654475ebca66b08dc6565ab => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:41.853400 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce14ed8-83f4-4834-b797-0d903e943ee0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:41.853928 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce14ed8-83f4-4834-b797-0d903e943ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:41.864356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce14ed8-83f4-4834-b797-0d903e943ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:41.881944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1073/2135] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:41.891820 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9bf5d-94be-4695-9003-a21cf4688c80 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:41.895104 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-66c9bf5d-94be-4695-9003-a21cf4688c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:41.912058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5ce14ed8-83f4-4834-b797-0d903e943ee0 None None] MFA Rules not processed for user `10638aa389dd4bb9bb82da7bf11c4b60`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:41.913428 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5ce14ed8-83f4-4834-b797-0d903e943ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:42.011161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9bf5d-94be-4695-9003-a21cf4688c80 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:42.063600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1063/2136] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:42.072300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce14ed8-83f4-4834-b797-0d903e943ee0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:42.074414 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5ce14ed8-83f4-4834-b797-0d903e943ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:42.111855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4071eb-0fa0-4cda-9a04-2c010cd67b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:42.114099 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4071eb-0fa0-4cda-9a04-2c010cd67b2c service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:42.114682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4071eb-0fa0-4cda-9a04-2c010cd67b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:42.115425 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4071eb-0fa0-4cda-9a04-2c010cd67b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:42.135924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:42.205217 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce14ed8-83f4-4834-b797-0d903e943ee0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:42.212352 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c481f0f-0b35-4802-a7c6-b60fa4964877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:42.212966 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c481f0f-0b35-4802-a7c6-b60fa4964877 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:42.213252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c481f0f-0b35-4802-a7c6-b60fa4964877 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:42.213532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c481f0f-0b35-4802-a7c6-b60fa4964877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:42.233894 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c481f0f-0b35-4802-a7c6-b60fa4964877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:42.235681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c481f0f-0b35-4802-a7c6-b60fa4964877 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:42.243483 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4071eb-0fa0-4cda-9a04-2c010cd67b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:42.245157 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4071eb-0fa0-4cda-9a04-2c010cd67b2c service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:42.250652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1064/2137] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:42.287354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1074/2138] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:42.287965 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c481f0f-0b35-4802-a7c6-b60fa4964877 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:42.289709 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8c481f0f-0b35-4802-a7c6-b60fa4964877 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:42.339810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c481f0f-0b35-4802-a7c6-b60fa4964877 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:42.368919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2cb5a-e045-4d24-bbc7-1fb50ca3ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:42.370094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2cb5a-e045-4d24-bbc7-1fb50ca3ad36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:42.370956 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2cb5a-e045-4d24-bbc7-1fb50ca3ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:42.371288 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2cb5a-e045-4d24-bbc7-1fb50ca3ad36 admin admin] PATH_INFO: `/v3/projects/6212fc99653543c9869d366ba2cdfefe` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:42.374682 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2cb5a-e045-4d24-bbc7-1fb50ca3ad36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6212fc99653543c9869d366ba2cdfefe)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:42.379022 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2cb5a-e045-4d24-bbc7-1fb50ca3ad36 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:42.451545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:42.473329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ac2cb5a-e045-4d24-bbc7-1fb50ca3ad36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6212fc99653543c9869d366ba2cdfefe', 'request_id': 'req-9ac2cb5a-e045-4d24-bbc7-1fb50ca3ad36'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:42.492657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ac2cb5a-e045-4d24-bbc7-1fb50ca3ad36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6212fc99653543c9869d366ba2cdfefe', 'request_id': 'req-9ac2cb5a-e045-4d24-bbc7-1fb50ca3ad36'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:42.505639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ac2cb5a-e045-4d24-bbc7-1fb50ca3ad36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6212fc99653543c9869d366ba2cdfefe', 'request_id': 'req-9ac2cb5a-e045-4d24-bbc7-1fb50ca3ad36'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:42.540445 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ac2cb5a-e045-4d24-bbc7-1fb50ca3ad36 admin admin] The token cache is being invalidate because project 6212fc99653543c9869d366ba2cdfefe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:42.540811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ac2cb5a-e045-4d24-bbc7-1fb50ca3ad36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:42.542050 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ac2cb5a-e045-4d24-bbc7-1fb50ca3ad36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:42.544144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1065/2139] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:42 2022] DELETE /identity/v3/projects/6212fc99653543c9869d366ba2cdfefe => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:42.551397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cfd68-66b7-4815-be42-380c3881c48d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:42.552401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cfd68-66b7-4815-be42-380c3881c48d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:42.553377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cfd68-66b7-4815-be42-380c3881c48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:42.586935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-fc5cfd68-66b7-4815-be42-380c3881c48d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:42.604222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fc5cfd68-66b7-4815-be42-380c3881c48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:42.771671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1075/2140] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:42.787020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70548fea-64f8-48d8-9c77-a32cceee3e7f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:42.787559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70548fea-64f8-48d8-9c77-a32cceee3e7f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:42.788599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70548fea-64f8-48d8-9c77-a32cceee3e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:42.823580 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-70548fea-64f8-48d8-9c77-a32cceee3e7f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:42.824011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cfd68-66b7-4815-be42-380c3881c48d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:42.825052 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-70548fea-64f8-48d8-9c77-a32cceee3e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:42.825405 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fc5cfd68-66b7-4815-be42-380c3881c48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:42.840019 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1066/2141] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:42.840933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70548fea-64f8-48d8-9c77-a32cceee3e7f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:42.855713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cfd68-66b7-4815-be42-380c3881c48d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:42.865553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7545f-9481-4b3d-82db-8dae55ad5660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:42.867256 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7545f-9481-4b3d-82db-8dae55ad5660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:42.867935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7545f-9481-4b3d-82db-8dae55ad5660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:42.868483 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7545f-9481-4b3d-82db-8dae55ad5660 admin admin] PATH_INFO: `/v3/projects/6d2fd57779524db398ad5f3e6e3ca4c3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:42.870377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7545f-9481-4b3d-82db-8dae55ad5660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d2fd57779524db398ad5f3e6e3ca4c3)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:42.872462 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70548fea-64f8-48d8-9c77-a32cceee3e7f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:42.876980 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7545f-9481-4b3d-82db-8dae55ad5660 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:42.879690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5186b-c3bd-4e41-a51b-25ca17df2517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:42.879837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5186b-c3bd-4e41-a51b-25ca17df2517 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:42.880061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5186b-c3bd-4e41-a51b-25ca17df2517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:42.880348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5186b-c3bd-4e41-a51b-25ca17df2517 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:42.883970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5186b-c3bd-4e41-a51b-25ca17df2517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:42.884298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5186b-c3bd-4e41-a51b-25ca17df2517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:42.885935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5186b-c3bd-4e41-a51b-25ca17df2517 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:42.931496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1067/2142] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:42.935633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5186b-c3bd-4e41-a51b-25ca17df2517 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:42.938271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e5b5186b-c3bd-4e41-a51b-25ca17df2517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:42.965487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-34f7545f-9481-4b3d-82db-8dae55ad5660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d2fd57779524db398ad5f3e6e3ca4c3', 'request_id': 'req-34f7545f-9481-4b3d-82db-8dae55ad5660'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:42.968481 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5186b-c3bd-4e41-a51b-25ca17df2517 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:42.974788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-34f7545f-9481-4b3d-82db-8dae55ad5660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d2fd57779524db398ad5f3e6e3ca4c3', 'request_id': 'req-34f7545f-9481-4b3d-82db-8dae55ad5660'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:42.986185 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-34f7545f-9481-4b3d-82db-8dae55ad5660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d2fd57779524db398ad5f3e6e3ca4c3', 'request_id': 'req-34f7545f-9481-4b3d-82db-8dae55ad5660'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:43.007487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-34f7545f-9481-4b3d-82db-8dae55ad5660 admin admin] The token cache is being invalidate because project 6d2fd57779524db398ad5f3e6e3ca4c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:43.008086 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-34f7545f-9481-4b3d-82db-8dae55ad5660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:43.008985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-34f7545f-9481-4b3d-82db-8dae55ad5660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:43.011615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1076/2143] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:42 2022] DELETE /identity/v3/projects/6d2fd57779524db398ad5f3e6e3ca4c3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:43.012549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7545f-9481-4b3d-82db-8dae55ad5660 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:43.022552 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-34f7545f-9481-4b3d-82db-8dae55ad5660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:43.077829 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:43.099050 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062e93a-f2af-43ad-a6be-14ea00904257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:43.100074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062e93a-f2af-43ad-a6be-14ea00904257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:43.101720 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062e93a-f2af-43ad-a6be-14ea00904257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:43.101720 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062e93a-f2af-43ad-a6be-14ea00904257 admin admin] PATH_INFO: `/v3/users/6b40875874ed4d06956bdcd92a7d1959` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:43.103161 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062e93a-f2af-43ad-a6be-14ea00904257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b40875874ed4d06956bdcd92a7d1959)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:43.106758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062e93a-f2af-43ad-a6be-14ea00904257 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:43.128399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7545f-9481-4b3d-82db-8dae55ad5660 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:43.134938 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee9b67-2a0e-4ee4-89e5-cc2778765109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:43.135761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee9b67-2a0e-4ee4-89e5-cc2778765109 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:43.136153 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee9b67-2a0e-4ee4-89e5-cc2778765109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:43.136533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee9b67-2a0e-4ee4-89e5-cc2778765109 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:43.137341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee9b67-2a0e-4ee4-89e5-cc2778765109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:43.139526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee9b67-2a0e-4ee4-89e5-cc2778765109 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:43.177360 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1077/2144] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:43 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:43.181107 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee9b67-2a0e-4ee4-89e5-cc2778765109 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:43.184025 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2bee9b67-2a0e-4ee4-89e5-cc2778765109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:43.186621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5062e93a-f2af-43ad-a6be-14ea00904257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b40875874ed4d06956bdcd92a7d1959'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:43.187602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5062e93a-f2af-43ad-a6be-14ea00904257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b40875874ed4d06956bdcd92a7d1959'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:43.205878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5062e93a-f2af-43ad-a6be-14ea00904257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b40875874ed4d06956bdcd92a7d1959'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:43.207085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5062e93a-f2af-43ad-a6be-14ea00904257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b40875874ed4d06956bdcd92a7d1959'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:43.223998 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-5062e93a-f2af-43ad-a6be-14ea00904257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b40875874ed4d06956bdcd92a7d1959'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:43.245790 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1068/2145] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:42 2022] DELETE /identity/v3/users/6b40875874ed4d06956bdcd92a7d1959 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:43.246882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062e93a-f2af-43ad-a6be-14ea00904257 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:43.248616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5062e93a-f2af-43ad-a6be-14ea00904257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:43.288515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee9b67-2a0e-4ee4-89e5-cc2778765109 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:43.289698 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:43.337837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062e93a-f2af-43ad-a6be-14ea00904257 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:43.353343 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a0edd-7064-4268-98a3-d3d5b9fe3626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:43.354592 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a0edd-7064-4268-98a3-d3d5b9fe3626 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:43.355040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a0edd-7064-4268-98a3-d3d5b9fe3626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:43.355408 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a0edd-7064-4268-98a3-d3d5b9fe3626 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:43.356217 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a0edd-7064-4268-98a3-d3d5b9fe3626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:43.358276 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a0edd-7064-4268-98a3-d3d5b9fe3626 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:43.384948 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5035c-1e44-4ecd-996d-d54f516f6ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:43.386091 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5035c-1e44-4ecd-996d-d54f516f6ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:43.386382 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5035c-1e44-4ecd-996d-d54f516f6ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:43.386740 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5035c-1e44-4ecd-996d-d54f516f6ef3 admin admin] PATH_INFO: `/v3/users/63947729bec344c7a3ff4cb72126bdef` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:43.392042 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5035c-1e44-4ecd-996d-d54f516f6ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63947729bec344c7a3ff4cb72126bdef)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:43.396337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5035c-1e44-4ecd-996d-d54f516f6ef3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:43.402600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1069/2146] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:43 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:43.402600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ceb10-02f2-4087-88a7-dd5fe6f5295a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:43.403357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ceb10-02f2-4087-88a7-dd5fe6f5295a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:43.403743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ceb10-02f2-4087-88a7-dd5fe6f5295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:43.446356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e01ceb10-02f2-4087-88a7-dd5fe6f5295a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:43.447701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e01ceb10-02f2-4087-88a7-dd5fe6f5295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:43.467298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1070/2147] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:43.477156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ceb10-02f2-4087-88a7-dd5fe6f5295a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:43.489138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-91a5035c-1e44-4ecd-996d-d54f516f6ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63947729bec344c7a3ff4cb72126bdef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:43.492711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ceb10-02f2-4087-88a7-dd5fe6f5295a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:43.507274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8b5a3-5651-41b5-8f9b-c00a21996da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:43.508625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8b5a3-5651-41b5-8f9b-c00a21996da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:43.509076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8b5a3-5651-41b5-8f9b-c00a21996da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:43.510709 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8b5a3-5651-41b5-8f9b-c00a21996da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:43.511123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:43.511690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8b5a3-5651-41b5-8f9b-c00a21996da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:43.513206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-91a5035c-1e44-4ecd-996d-d54f516f6ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63947729bec344c7a3ff4cb72126bdef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:43.513612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8b5a3-5651-41b5-8f9b-c00a21996da0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:43.514285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-91a5035c-1e44-4ecd-996d-d54f516f6ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63947729bec344c7a3ff4cb72126bdef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:43.515886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-91a5035c-1e44-4ecd-996d-d54f516f6ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63947729bec344c7a3ff4cb72126bdef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:43.528964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1071/2148] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:43.530123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8b5a3-5651-41b5-8f9b-c00a21996da0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:43.532989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e9e8b5a3-5651-41b5-8f9b-c00a21996da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:43.533500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-91a5035c-1e44-4ecd-996d-d54f516f6ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63947729bec344c7a3ff4cb72126bdef'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:43.565732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1078/2149] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:43 2022] DELETE /identity/v3/users/63947729bec344c7a3ff4cb72126bdef => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:43.565732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5035c-1e44-4ecd-996d-d54f516f6ef3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:43.566844 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-91a5035c-1e44-4ecd-996d-d54f516f6ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:43.648757 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8b5a3-5651-41b5-8f9b-c00a21996da0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:43.725313 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5035c-1e44-4ecd-996d-d54f516f6ef3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:43.741322 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464a8c8-4b22-45f8-9600-e2ea36a6bcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:43.742341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464a8c8-4b22-45f8-9600-e2ea36a6bcd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:43.742612 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464a8c8-4b22-45f8-9600-e2ea36a6bcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:43.742955 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464a8c8-4b22-45f8-9600-e2ea36a6bcd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:43.745072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464a8c8-4b22-45f8-9600-e2ea36a6bcd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:43.754327 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9602210-f393-42c4-90a9-32f292090e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:43.755377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9602210-f393-42c4-90a9-32f292090e0c service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:43.755912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9602210-f393-42c4-90a9-32f292090e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:43.756405 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9602210-f393-42c4-90a9-32f292090e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:43.759107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a9602210-f393-42c4-90a9-32f292090e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:43.761116 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464a8c8-4b22-45f8-9600-e2ea36a6bcd9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:43.775943 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1079/2150] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:43.778949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9602210-f393-42c4-90a9-32f292090e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:43.779454 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464a8c8-4b22-45f8-9600-e2ea36a6bcd9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:43.781139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9602210-f393-42c4-90a9-32f292090e0c service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:43.791677 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464a8c8-4b22-45f8-9600-e2ea36a6bcd9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:43.811713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92410766-b3d0-4e22-be68-c5f2c5963e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:43.813740 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92410766-b3d0-4e22-be68-c5f2c5963e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:43.815192 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92410766-b3d0-4e22-be68-c5f2c5963e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:43.816834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92410766-b3d0-4e22-be68-c5f2c5963e58 admin admin] PATH_INFO: `/v3/projects/0dfd692bbc154d7f9c18a3efe8cec0cd/users/9db2833cf5e34a33a359b7f3640dc8f5/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:43.827716 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1072/2151] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:43.843290 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92410766-b3d0-4e22-be68-c5f2c5963e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dfd692bbc154d7f9c18a3efe8cec0cd, user_id=9db2833cf5e34a33a359b7f3640dc8f5, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:43.846886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92410766-b3d0-4e22-be68-c5f2c5963e58 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:43.880522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1080/2152] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:43 2022] PUT /identity/v3/projects/0dfd692bbc154d7f9c18a3efe8cec0cd/users/9db2833cf5e34a33a359b7f3640dc8f5/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:43.882691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f6a98-621a-4165-b47c-bc08cd020b15 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:43.883047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f6a98-621a-4165-b47c-bc08cd020b15 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:43.883629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f6a98-621a-4165-b47c-bc08cd020b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:43.923132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3f4f6a98-621a-4165-b47c-bc08cd020b15 None None] MFA Rules not processed for user `9db2833cf5e34a33a359b7f3640dc8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:43.926165 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3f4f6a98-621a-4165-b47c-bc08cd020b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:44.019303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:44.056599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1073/2153] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:44.069611 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92410766-b3d0-4e22-be68-c5f2c5963e58 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:44.071747 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-92410766-b3d0-4e22-be68-c5f2c5963e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:44.147288 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f6a98-621a-4165-b47c-bc08cd020b15 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:44.149610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3f4f6a98-621a-4165-b47c-bc08cd020b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:44.208474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92410766-b3d0-4e22-be68-c5f2c5963e58 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:44.230964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be64b67-1d9b-4a1f-af97-7582117d90f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59174974208c469b8bb44d94d0e55427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:44.232095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be64b67-1d9b-4a1f-af97-7582117d90f8 service glance] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:44.232592 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be64b67-1d9b-4a1f-af97-7582117d90f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:44.233096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be64b67-1d9b-4a1f-af97-7582117d90f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:44.287818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be64b67-1d9b-4a1f-af97-7582117d90f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:44.290450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be64b67-1d9b-4a1f-af97-7582117d90f8 service glance] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:44.318682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1081/2154] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:44.319782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f6a98-621a-4165-b47c-bc08cd020b15 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:44.324790 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf343bb-20f7-4d81-af29-fb52f510c36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:44.331118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be64b67-1d9b-4a1f-af97-7582117d90f8 service glance] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:44.334372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6be64b67-1d9b-4a1f-af97-7582117d90f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:44.337148 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf343bb-20f7-4d81-af29-fb52f510c36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:44.337513 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf343bb-20f7-4d81-af29-fb52f510c36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:44.337842 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf343bb-20f7-4d81-af29-fb52f510c36f admin admin] PATH_INFO: `/v3/projects/3117ff739921483ca2b017d3302f0170` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:44.339986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf343bb-20f7-4d81-af29-fb52f510c36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3117ff739921483ca2b017d3302f0170)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:44.342773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf343bb-20f7-4d81-af29-fb52f510c36f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:44.393104 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be64b67-1d9b-4a1f-af97-7582117d90f8 service glance] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:44.400433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e1ec7-1aa2-4d52-bacf-2bb324f2d10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:44.401540 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1ec7-1aa2-4d52-bacf-2bb324f2d10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:44.401954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1ec7-1aa2-4d52-bacf-2bb324f2d10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:44.402331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1ec7-1aa2-4d52-bacf-2bb324f2d10a admin admin] PATH_INFO: `/v3/projects/04e1d961bd9f496281b059b2005b6505` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:44.404198 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e1ec7-1aa2-4d52-bacf-2bb324f2d10a admin admin] RBAC: Authorizing `identity:delete_project(project_id=04e1d961bd9f496281b059b2005b6505)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:44.408468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e1ec7-1aa2-4d52-bacf-2bb324f2d10a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:44.456544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9bf343bb-20f7-4d81-af29-fb52f510c36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3117ff739921483ca2b017d3302f0170', 'request_id': 'req-9bf343bb-20f7-4d81-af29-fb52f510c36f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:44.483100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-eb2e1ec7-1aa2-4d52-bacf-2bb324f2d10a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04e1d961bd9f496281b059b2005b6505', 'request_id': 'req-eb2e1ec7-1aa2-4d52-bacf-2bb324f2d10a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:44.483558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9bf343bb-20f7-4d81-af29-fb52f510c36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3117ff739921483ca2b017d3302f0170', 'request_id': 'req-9bf343bb-20f7-4d81-af29-fb52f510c36f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:44.484827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:44.493889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-eb2e1ec7-1aa2-4d52-bacf-2bb324f2d10a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04e1d961bd9f496281b059b2005b6505', 'request_id': 'req-eb2e1ec7-1aa2-4d52-bacf-2bb324f2d10a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:44.497152 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9bf343bb-20f7-4d81-af29-fb52f510c36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3117ff739921483ca2b017d3302f0170', 'request_id': 'req-9bf343bb-20f7-4d81-af29-fb52f510c36f'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:44.508581 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-eb2e1ec7-1aa2-4d52-bacf-2bb324f2d10a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04e1d961bd9f496281b059b2005b6505', 'request_id': 'req-eb2e1ec7-1aa2-4d52-bacf-2bb324f2d10a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:44.524849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-eb2e1ec7-1aa2-4d52-bacf-2bb324f2d10a admin admin] The token cache is being invalidate because project 04e1d961bd9f496281b059b2005b6505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:44.525566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-eb2e1ec7-1aa2-4d52-bacf-2bb324f2d10a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:44.528313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9bf343bb-20f7-4d81-af29-fb52f510c36f admin admin] The token cache is being invalidate because project 3117ff739921483ca2b017d3302f0170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:44.528667 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9bf343bb-20f7-4d81-af29-fb52f510c36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:44.530255 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9bf343bb-20f7-4d81-af29-fb52f510c36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:44.532022 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1074/2155] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:44 2022] DELETE /identity/v3/projects/3117ff739921483ca2b017d3302f0170 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:44.532709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-eb2e1ec7-1aa2-4d52-bacf-2bb324f2d10a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:44.536015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1082/2156] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:44 2022] DELETE /identity/v3/projects/04e1d961bd9f496281b059b2005b6505 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:44.536509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf343bb-20f7-4d81-af29-fb52f510c36f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:44.539845 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9bf343bb-20f7-4d81-af29-fb52f510c36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:44.541593 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab625bb-72f0-4afe-9693-275fe73c9360 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:44.542105 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab625bb-72f0-4afe-9693-275fe73c9360 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:44.542506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab625bb-72f0-4afe-9693-275fe73c9360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:44.576140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9ab625bb-72f0-4afe-9693-275fe73c9360 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:44.577997 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9ab625bb-72f0-4afe-9693-275fe73c9360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:44.638219 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf343bb-20f7-4d81-af29-fb52f510c36f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:44.671153 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1083/2157] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:44.672861 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7091-580e-467e-bd70-a0166e57176f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:44.673695 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7091-580e-467e-bd70-a0166e57176f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:44.673983 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7091-580e-467e-bd70-a0166e57176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:44.689566 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:44.703029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e8bc7091-580e-467e-bd70-a0166e57176f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:44.705032 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e8bc7091-580e-467e-bd70-a0166e57176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:44.715822 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1084/2158] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:44.720853 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc7091-580e-467e-bd70-a0166e57176f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:44.732829 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc7091-580e-467e-bd70-a0166e57176f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:44.738375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f41ba-cf2d-4ce2-9f3d-1e3222035aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:44.739224 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f41ba-cf2d-4ce2-9f3d-1e3222035aaa admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:44.739610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f41ba-cf2d-4ce2-9f3d-1e3222035aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:44.739991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f41ba-cf2d-4ce2-9f3d-1e3222035aaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:44.741889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f41ba-cf2d-4ce2-9f3d-1e3222035aaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:44.742416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f41ba-cf2d-4ce2-9f3d-1e3222035aaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:44.745033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f41ba-cf2d-4ce2-9f3d-1e3222035aaa admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:44.762489 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1085/2159] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:44.766837 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f41ba-cf2d-4ce2-9f3d-1e3222035aaa admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:44.777584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffb533-3e3c-45dc-8992-dea80e8f7158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:44.778689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffb533-3e3c-45dc-8992-dea80e8f7158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:44.778978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffb533-3e3c-45dc-8992-dea80e8f7158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:44.779257 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffb533-3e3c-45dc-8992-dea80e8f7158 admin admin] PATH_INFO: `/v3/users/49586c830ed74a6f9a94a6eba26c4065` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:44.780501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffb533-3e3c-45dc-8992-dea80e8f7158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49586c830ed74a6f9a94a6eba26c4065)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:44.780680 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f41ba-cf2d-4ce2-9f3d-1e3222035aaa admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:44.783040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffb533-3e3c-45dc-8992-dea80e8f7158 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:44.789511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156b25f-bf1a-484e-b2ac-093302284853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:44.789511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156b25f-bf1a-484e-b2ac-093302284853 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:44.789511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156b25f-bf1a-484e-b2ac-093302284853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:44.789738 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156b25f-bf1a-484e-b2ac-093302284853 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:44.790743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156b25f-bf1a-484e-b2ac-093302284853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:44.793171 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156b25f-bf1a-484e-b2ac-093302284853 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:44.859986 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1086/2160] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:44 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:44.873165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156b25f-bf1a-484e-b2ac-093302284853 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:44.893595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1fffb533-3e3c-45dc-8992-dea80e8f7158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49586c830ed74a6f9a94a6eba26c4065'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:44.897136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1fffb533-3e3c-45dc-8992-dea80e8f7158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49586c830ed74a6f9a94a6eba26c4065'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:44.926161 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1fffb533-3e3c-45dc-8992-dea80e8f7158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49586c830ed74a6f9a94a6eba26c4065'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:44.928736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1fffb533-3e3c-45dc-8992-dea80e8f7158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49586c830ed74a6f9a94a6eba26c4065'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:44.944867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1fffb533-3e3c-45dc-8992-dea80e8f7158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49586c830ed74a6f9a94a6eba26c4065'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:44.966452 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1075/2161] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:44 2022] DELETE /identity/v3/users/49586c830ed74a6f9a94a6eba26c4065 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:45.021379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156b25f-bf1a-484e-b2ac-093302284853 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:45.107069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe618-973c-4ef1-b9c5-1689286004f1 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:45.107835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe618-973c-4ef1-b9c5-1689286004f1 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:45.108268 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe618-973c-4ef1-b9c5-1689286004f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:45.114717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:45.144486 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4b8fe618-973c-4ef1-b9c5-1689286004f1 None None] MFA Rules not processed for user `10638aa389dd4bb9bb82da7bf11c4b60`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:45.146296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4b8fe618-973c-4ef1-b9c5-1689286004f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:45.151331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70d91c-724a-4b95-ab2a-264c5d42538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:45.154375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70d91c-724a-4b95-ab2a-264c5d42538c admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:45.155036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70d91c-724a-4b95-ab2a-264c5d42538c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:45.155580 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70d91c-724a-4b95-ab2a-264c5d42538c admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:45.157336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70d91c-724a-4b95-ab2a-264c5d42538c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:45.163614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70d91c-724a-4b95-ab2a-264c5d42538c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:45.217832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1087/2162] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:44 2022] POST /identity/v3/users => generated 293 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:45.221278 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70d91c-724a-4b95-ab2a-264c5d42538c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:45.228566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5b70d91c-724a-4b95-ab2a-264c5d42538c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:45.251999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70d91c-724a-4b95-ab2a-264c5d42538c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:45.257822 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069320dd-9e77-4ba0-a338-3df2c4d92b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:45.258678 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069320dd-9e77-4ba0-a338-3df2c4d92b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:45.259000 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069320dd-9e77-4ba0-a338-3df2c4d92b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:45.259352 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069320dd-9e77-4ba0-a338-3df2c4d92b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:45.260160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069320dd-9e77-4ba0-a338-3df2c4d92b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:45.262558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069320dd-9e77-4ba0-a338-3df2c4d92b0c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:45.277843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1088/2163] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:45.279141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069320dd-9e77-4ba0-a338-3df2c4d92b0c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:45.288798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1076/2164] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:45.291199 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069320dd-9e77-4ba0-a338-3df2c4d92b0c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:45.296812 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ca346-49df-44b2-b709-6a3edde8ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:45.297563 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ca346-49df-44b2-b709-6a3edde8ca16 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:45.297924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ca346-49df-44b2-b709-6a3edde8ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:45.298690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ca346-49df-44b2-b709-6a3edde8ca16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:45.299779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ca346-49df-44b2-b709-6a3edde8ca16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:45.301486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ca346-49df-44b2-b709-6a3edde8ca16 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:45.314964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1089/2165] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:17:45.319287 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fe618-973c-4ef1-b9c5-1689286004f1 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:45.333936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fe618-973c-4ef1-b9c5-1689286004f1 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:45.339717 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ff0a4-427d-4951-8605-b0ce29611b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:45.341324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ff0a4-427d-4951-8605-b0ce29611b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:45.341709 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ff0a4-427d-4951-8605-b0ce29611b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:45.342117 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ff0a4-427d-4951-8605-b0ce29611b0d admin admin] PATH_INFO: `/v3/projects/6e9f7b95e97e425fbaab72b46d774c09/users/e052821f9fd04272bf83ac2156b5f2c8/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:45.372403 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ff0a4-427d-4951-8605-b0ce29611b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9f7b95e97e425fbaab72b46d774c09, user_id=e052821f9fd04272bf83ac2156b5f2c8, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:45.380210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ff0a4-427d-4951-8605-b0ce29611b0d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:45.405240 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1077/2166] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:45 2022] PUT /identity/v3/projects/6e9f7b95e97e425fbaab72b46d774c09/users/e052821f9fd04272bf83ac2156b5f2c8/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:45.418082 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f6f39-bf93-4f6d-85a3-73517fb789d9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:45.418495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f6f39-bf93-4f6d-85a3-73517fb789d9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:45.418949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f6f39-bf93-4f6d-85a3-73517fb789d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:45.462242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-650f6f39-bf93-4f6d-85a3-73517fb789d9 None None] MFA Rules not processed for user `e052821f9fd04272bf83ac2156b5f2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:45.464295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-650f6f39-bf93-4f6d-85a3-73517fb789d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:45.536698 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ff0a4-427d-4951-8605-b0ce29611b0d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:45.540292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d75ff0a4-427d-4951-8605-b0ce29611b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:45.624210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:45.634985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1090/2167] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:45.656700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f6f39-bf93-4f6d-85a3-73517fb789d9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:45.658376 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-650f6f39-bf93-4f6d-85a3-73517fb789d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:45.718932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ff0a4-427d-4951-8605-b0ce29611b0d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:45.725578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9490629-7c9f-4f76-be9d-91e854fd6b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:45.728590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9490629-7c9f-4f76-be9d-91e854fd6b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:45.729155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9490629-7c9f-4f76-be9d-91e854fd6b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:45.729817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9490629-7c9f-4f76-be9d-91e854fd6b6b admin admin] PATH_INFO: `/v3/projects/85810a7081db493cbf747719183d0fde` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:45.731904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9490629-7c9f-4f76-be9d-91e854fd6b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=85810a7081db493cbf747719183d0fde)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:45.736736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9490629-7c9f-4f76-be9d-91e854fd6b6b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:45.791995 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f6f39-bf93-4f6d-85a3-73517fb789d9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:45.797329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343836b-9744-41a5-a573-e68f43dd7095 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:45.798107 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343836b-9744-41a5-a573-e68f43dd7095 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:45.799255 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343836b-9744-41a5-a573-e68f43dd7095 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:45.799544 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343836b-9744-41a5-a573-e68f43dd7095 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:45.809854 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343836b-9744-41a5-a573-e68f43dd7095 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:45.811212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343836b-9744-41a5-a573-e68f43dd7095 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:45.833105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c9490629-7c9f-4f76-be9d-91e854fd6b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85810a7081db493cbf747719183d0fde', 'request_id': 'req-c9490629-7c9f-4f76-be9d-91e854fd6b6b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:45.834114 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1091/2168] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:45.870746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c9490629-7c9f-4f76-be9d-91e854fd6b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85810a7081db493cbf747719183d0fde', 'request_id': 'req-c9490629-7c9f-4f76-be9d-91e854fd6b6b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:45.885149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c9490629-7c9f-4f76-be9d-91e854fd6b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85810a7081db493cbf747719183d0fde', 'request_id': 'req-c9490629-7c9f-4f76-be9d-91e854fd6b6b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:45.924303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c9490629-7c9f-4f76-be9d-91e854fd6b6b admin admin] The token cache is being invalidate because project 85810a7081db493cbf747719183d0fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:45.925026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c9490629-7c9f-4f76-be9d-91e854fd6b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:45.925611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c9490629-7c9f-4f76-be9d-91e854fd6b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:45.928119 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1078/2169] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:45 2022] DELETE /identity/v3/projects/85810a7081db493cbf747719183d0fde => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:45.934156 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9a057-706c-4a98-bc4b-7cb159762d42 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:45.934605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9a057-706c-4a98-bc4b-7cb159762d42 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:45.934864 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9a057-706c-4a98-bc4b-7cb159762d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:45.966672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6ce9a057-706c-4a98-bc4b-7cb159762d42 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:45.968062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6ce9a057-706c-4a98-bc4b-7cb159762d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:46.075272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:46.121173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1092/2170] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:46.133954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1678e-114c-43c6-b218-81696473777b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:46.134514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1678e-114c-43c6-b218-81696473777b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:46.134873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1678e-114c-43c6-b218-81696473777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:46.172712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b2b1678e-114c-43c6-b218-81696473777b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:46.175466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b2b1678e-114c-43c6-b218-81696473777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:46.193665 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9a057-706c-4a98-bc4b-7cb159762d42 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:46.194263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1079/2171] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:46.205025 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9a057-706c-4a98-bc4b-7cb159762d42 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:46.213637 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bce08-0c53-466c-8321-96265166a82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:46.214230 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bce08-0c53-466c-8321-96265166a82d admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:46.214647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bce08-0c53-466c-8321-96265166a82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:46.215003 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bce08-0c53-466c-8321-96265166a82d admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:46.215730 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bce08-0c53-466c-8321-96265166a82d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:46.216045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bce08-0c53-466c-8321-96265166a82d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:46.217855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bce08-0c53-466c-8321-96265166a82d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:46.232102 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1093/2172] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:46.236613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1678e-114c-43c6-b218-81696473777b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:46.252951 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1678e-114c-43c6-b218-81696473777b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:46.263743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6bb88-edfe-4a90-875b-b54b88dd9a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:46.264484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6bb88-edfe-4a90-875b-b54b88dd9a5f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:46.264769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6bb88-edfe-4a90-875b-b54b88dd9a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:46.266206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6bb88-edfe-4a90-875b-b54b88dd9a5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:46.267623 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6bb88-edfe-4a90-875b-b54b88dd9a5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:46.270928 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6bb88-edfe-4a90-875b-b54b88dd9a5f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:46.284313 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bce08-0c53-466c-8321-96265166a82d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:46.286747 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-173bce08-0c53-466c-8321-96265166a82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:46.312630 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bce08-0c53-466c-8321-96265166a82d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:46.330614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfc674-e8e0-4592-a726-5da7e8ce8581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:46.331776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfc674-e8e0-4592-a726-5da7e8ce8581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:46.337976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfc674-e8e0-4592-a726-5da7e8ce8581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:46.338704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfc674-e8e0-4592-a726-5da7e8ce8581 admin admin] PATH_INFO: `/v3/users/5f37cb91f4794328939f0302f1fd467d` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:46.348275 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1080/2173] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:46 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:46.348275 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6bb88-edfe-4a90-875b-b54b88dd9a5f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:46.354468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfc674-e8e0-4592-a726-5da7e8ce8581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f37cb91f4794328939f0302f1fd467d)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:46.396256 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfc674-e8e0-4592-a726-5da7e8ce8581 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:46.538232 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4bbfc674-e8e0-4592-a726-5da7e8ce8581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f37cb91f4794328939f0302f1fd467d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:46.549034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6bb88-edfe-4a90-875b-b54b88dd9a5f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:46.563286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f8b2d-b8c0-4c7b-a36e-4f02705b7af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:46.564918 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f8b2d-b8c0-4c7b-a36e-4f02705b7af2 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:46.565207 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f8b2d-b8c0-4c7b-a36e-4f02705b7af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:46.565834 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f8b2d-b8c0-4c7b-a36e-4f02705b7af2 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:46.566388 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f8b2d-b8c0-4c7b-a36e-4f02705b7af2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:46.568086 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4bbfc674-e8e0-4592-a726-5da7e8ce8581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f37cb91f4794328939f0302f1fd467d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:46.568386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f8b2d-b8c0-4c7b-a36e-4f02705b7af2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:46.571711 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4bbfc674-e8e0-4592-a726-5da7e8ce8581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f37cb91f4794328939f0302f1fd467d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:46.582928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4bbfc674-e8e0-4592-a726-5da7e8ce8581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f37cb91f4794328939f0302f1fd467d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:46.593699 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4bbfc674-e8e0-4592-a726-5da7e8ce8581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f37cb91f4794328939f0302f1fd467d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:46.619378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1081/2174] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:46 2022] POST /identity/v3/users => generated 291 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:46.622630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f8b2d-b8c0-4c7b-a36e-4f02705b7af2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:46.627463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-818f8b2d-b8c0-4c7b-a36e-4f02705b7af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:46.632407 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1094/2175] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:46 2022] DELETE /identity/v3/users/5f37cb91f4794328939f0302f1fd467d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:46.634017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac958d4-3866-4a8a-8872-db0a5dd24d4d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:46.634314 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac958d4-3866-4a8a-8872-db0a5dd24d4d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:46.634625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac958d4-3866-4a8a-8872-db0a5dd24d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:46.661703 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5ac958d4-3866-4a8a-8872-db0a5dd24d4d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:46.663297 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5ac958d4-3866-4a8a-8872-db0a5dd24d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:46.666926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f8b2d-b8c0-4c7b-a36e-4f02705b7af2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:46.693070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:46.734802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1095/2176] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:46.741297 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac958d4-3866-4a8a-8872-db0a5dd24d4d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:46.742922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5ac958d4-3866-4a8a-8872-db0a5dd24d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:46.767007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf96e2-52fb-4aa6-92d0-7e38b0225563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:46.768134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf96e2-52fb-4aa6-92d0-7e38b0225563 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:46.768439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf96e2-52fb-4aa6-92d0-7e38b0225563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:46.768722 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf96e2-52fb-4aa6-92d0-7e38b0225563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:46.769691 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf96e2-52fb-4aa6-92d0-7e38b0225563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:46.771859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf96e2-52fb-4aa6-92d0-7e38b0225563 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:46.796571 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1082/2177] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:46.802868 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf96e2-52fb-4aa6-92d0-7e38b0225563 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:46.817565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:46.827636 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf96e2-52fb-4aa6-92d0-7e38b0225563 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:46.838688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac958d4-3866-4a8a-8872-db0a5dd24d4d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:46.841723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be29a7-6809-4fbb-9531-7736caa72390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:46.842805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be29a7-6809-4fbb-9531-7736caa72390 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:46.843312 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be29a7-6809-4fbb-9531-7736caa72390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:46.844194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be29a7-6809-4fbb-9531-7736caa72390 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:46.845950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be29a7-6809-4fbb-9531-7736caa72390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:46.848538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be29a7-6809-4fbb-9531-7736caa72390 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:46.851922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a99003-54b7-4940-bd64-fbf47ae99b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:46.852674 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a99003-54b7-4940-bd64-fbf47ae99b75 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:46.853030 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a99003-54b7-4940-bd64-fbf47ae99b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:46.853392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a99003-54b7-4940-bd64-fbf47ae99b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:46.880104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1083/2178] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:46.884153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be29a7-6809-4fbb-9531-7736caa72390 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:46.885308 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a99003-54b7-4940-bd64-fbf47ae99b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:46.887137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a99003-54b7-4940-bd64-fbf47ae99b75 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:46.896613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be29a7-6809-4fbb-9531-7736caa72390 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:46.899557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1096/2179] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:46.904779 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fec320-48d1-4db4-871e-3760b7355e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:46.905875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fec320-48d1-4db4-871e-3760b7355e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:46.906162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fec320-48d1-4db4-871e-3760b7355e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:46.906476 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fec320-48d1-4db4-871e-3760b7355e47 admin admin] PATH_INFO: `/v3/projects/ecca4e9d55974258b7f1905cf2053c80/users/204ec9c9f0e4412d8e28e7b564233e69/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:46.928413 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fec320-48d1-4db4-871e-3760b7355e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecca4e9d55974258b7f1905cf2053c80, user_id=204ec9c9f0e4412d8e28e7b564233e69, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:46.931157 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fec320-48d1-4db4-871e-3760b7355e47 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:46.951563 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1084/2180] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:46 2022] PUT /identity/v3/projects/ecca4e9d55974258b7f1905cf2053c80/users/204ec9c9f0e4412d8e28e7b564233e69/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:46.964592 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde3804-5051-40c2-bce0-e9b91f79d806 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:46.965366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde3804-5051-40c2-bce0-e9b91f79d806 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:46.966045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde3804-5051-40c2-bce0-e9b91f79d806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:47.012000 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-bcde3804-5051-40c2-bce0-e9b91f79d806 None None] MFA Rules not processed for user `204ec9c9f0e4412d8e28e7b564233e69`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:47.013715 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-bcde3804-5051-40c2-bce0-e9b91f79d806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:47.228062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1097/2181] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:47.228250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fec320-48d1-4db4-871e-3760b7355e47 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:47.325792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fec320-48d1-4db4-871e-3760b7355e47 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:47.334688 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71463b0d-5023-4d1b-a0cd-bad7f101614d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:47.335494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71463b0d-5023-4d1b-a0cd-bad7f101614d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:47.335798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71463b0d-5023-4d1b-a0cd-bad7f101614d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:47.336087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71463b0d-5023-4d1b-a0cd-bad7f101614d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:47.336804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71463b0d-5023-4d1b-a0cd-bad7f101614d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:47.339644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71463b0d-5023-4d1b-a0cd-bad7f101614d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:47.393510 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1085/2182] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:47 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:17:47.409526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde3804-5051-40c2-bce0-e9b91f79d806 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:47.425347 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde3804-5051-40c2-bce0-e9b91f79d806 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:47.550968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa9a04-c479-4a02-9905-cfb2025ba947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:47.551718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa9a04-c479-4a02-9905-cfb2025ba947 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:47.551941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa9a04-c479-4a02-9905-cfb2025ba947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:47.552217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa9a04-c479-4a02-9905-cfb2025ba947 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:47.552800 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71463b0d-5023-4d1b-a0cd-bad7f101614d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:47.555781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-71463b0d-5023-4d1b-a0cd-bad7f101614d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:47.556318 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa9a04-c479-4a02-9905-cfb2025ba947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:47.558339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa9a04-c479-4a02-9905-cfb2025ba947 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:47.577907 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71463b0d-5023-4d1b-a0cd-bad7f101614d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:47.582403 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291a303-eb91-410a-9f3a-1e4a63dc84a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:47.583683 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291a303-eb91-410a-9f3a-1e4a63dc84a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:47.585108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291a303-eb91-410a-9f3a-1e4a63dc84a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:47.585567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291a303-eb91-410a-9f3a-1e4a63dc84a0 admin admin] PATH_INFO: `/v3/projects/127c97739ba84f19a4f98edc74623230` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:47.587528 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291a303-eb91-410a-9f3a-1e4a63dc84a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127c97739ba84f19a4f98edc74623230)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:47.589659 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291a303-eb91-410a-9f3a-1e4a63dc84a0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:47.629570 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1098/2183] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:47 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:47.637646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa9a04-c479-4a02-9905-cfb2025ba947 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:47.664803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa9a04-c479-4a02-9905-cfb2025ba947 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:47.695874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c291a303-eb91-410a-9f3a-1e4a63dc84a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127c97739ba84f19a4f98edc74623230', 'request_id': 'req-c291a303-eb91-410a-9f3a-1e4a63dc84a0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:47.701990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:47.707040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c291a303-eb91-410a-9f3a-1e4a63dc84a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127c97739ba84f19a4f98edc74623230', 'request_id': 'req-c291a303-eb91-410a-9f3a-1e4a63dc84a0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:47.720866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c291a303-eb91-410a-9f3a-1e4a63dc84a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127c97739ba84f19a4f98edc74623230', 'request_id': 'req-c291a303-eb91-410a-9f3a-1e4a63dc84a0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:47.750301 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c291a303-eb91-410a-9f3a-1e4a63dc84a0 admin admin] The token cache is being invalidate because project 127c97739ba84f19a4f98edc74623230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:47.750641 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c291a303-eb91-410a-9f3a-1e4a63dc84a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:47.751663 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c291a303-eb91-410a-9f3a-1e4a63dc84a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:47.761501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1086/2184] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:47 2022] DELETE /identity/v3/projects/127c97739ba84f19a4f98edc74623230 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:47.762981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291a303-eb91-410a-9f3a-1e4a63dc84a0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:47.765017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c291a303-eb91-410a-9f3a-1e4a63dc84a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:47.815475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e988d-d3ed-4237-9f96-06df21de8225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:47.818121 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e988d-d3ed-4237-9f96-06df21de8225 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:47.818663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e988d-d3ed-4237-9f96-06df21de8225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:47.819263 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e988d-d3ed-4237-9f96-06df21de8225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:47.820198 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e988d-d3ed-4237-9f96-06df21de8225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:47.837328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e988d-d3ed-4237-9f96-06df21de8225 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:47.857610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1099/2185] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:47.862340 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e988d-d3ed-4237-9f96-06df21de8225 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:47.864413 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c04e988d-d3ed-4237-9f96-06df21de8225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:47.864796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291a303-eb91-410a-9f3a-1e4a63dc84a0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:47.875116 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:47.879543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89a837-ca78-460a-acdc-88328a5a0f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:47.881090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89a837-ca78-460a-acdc-88328a5a0f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:47.881479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89a837-ca78-460a-acdc-88328a5a0f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:47.881837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89a837-ca78-460a-acdc-88328a5a0f0f admin admin] PATH_INFO: `/v3/users/5825025a16624cab80d5055d50e406bb` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:47.882924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e988d-d3ed-4237-9f96-06df21de8225 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:47.883273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89a837-ca78-460a-acdc-88328a5a0f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5825025a16624cab80d5055d50e406bb)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:47.885458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89a837-ca78-460a-acdc-88328a5a0f0f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:47.889584 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7a030-add0-4497-88c5-5d26e3093c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:47.890643 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a030-add0-4497-88c5-5d26e3093c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:47.891179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a030-add0-4497-88c5-5d26e3093c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:47.891551 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a030-add0-4497-88c5-5d26e3093c76 admin admin] PATH_INFO: `/v3/projects/e0443aad262a4cafb1425600c112ee80/users/70016b24b8884008b714b9829b629cd6/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:47.916834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7a030-add0-4497-88c5-5d26e3093c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0443aad262a4cafb1425600c112ee80, user_id=70016b24b8884008b714b9829b629cd6, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:47.921119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7a030-add0-4497-88c5-5d26e3093c76 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:47.955301 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1100/2186] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:47 2022] PUT /identity/v3/projects/e0443aad262a4cafb1425600c112ee80/users/70016b24b8884008b714b9829b629cd6/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:47.959729 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7a030-add0-4497-88c5-5d26e3093c76 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:47.962653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ca89a837-ca78-460a-acdc-88328a5a0f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5825025a16624cab80d5055d50e406bb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:47.963497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ca89a837-ca78-460a-acdc-88328a5a0f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5825025a16624cab80d5055d50e406bb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:47.980350 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ca89a837-ca78-460a-acdc-88328a5a0f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5825025a16624cab80d5055d50e406bb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:47.981217 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ca89a837-ca78-460a-acdc-88328a5a0f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5825025a16624cab80d5055d50e406bb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:47.999242 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ca89a837-ca78-460a-acdc-88328a5a0f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5825025a16624cab80d5055d50e406bb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:48.020951 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1087/2187] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:47 2022] DELETE /identity/v3/users/5825025a16624cab80d5055d50e406bb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:48.044557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7a030-add0-4497-88c5-5d26e3093c76 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:48.132920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61ff16-1b69-4edc-b476-fe2770f04df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:48.133726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61ff16-1b69-4edc-b476-fe2770f04df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:48.134228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61ff16-1b69-4edc-b476-fe2770f04df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:48.134618 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61ff16-1b69-4edc-b476-fe2770f04df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:48.135452 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61ff16-1b69-4edc-b476-fe2770f04df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:48.137295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61ff16-1b69-4edc-b476-fe2770f04df3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:48.154281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1101/2188] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:48.158845 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89a837-ca78-460a-acdc-88328a5a0f0f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:48.160085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ca89a837-ca78-460a-acdc-88328a5a0f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:48.178830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89a837-ca78-460a-acdc-88328a5a0f0f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:48.184417 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3ed3f-fd69-4655-bb38-75a4f56303cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:48.185501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3ed3f-fd69-4655-bb38-75a4f56303cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:48.185783 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3ed3f-fd69-4655-bb38-75a4f56303cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:48.186069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3ed3f-fd69-4655-bb38-75a4f56303cd admin admin] PATH_INFO: `/v3/projects/e0443aad262a4cafb1425600c112ee80/users/70016b24b8884008b714b9829b629cd6/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:48.188399 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3ed3f-fd69-4655-bb38-75a4f56303cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0443aad262a4cafb1425600c112ee80, user_id=70016b24b8884008b714b9829b629cd6, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:48.193136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3ed3f-fd69-4655-bb38-75a4f56303cd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:48.213891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1088/2189] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:48 2022] PUT /identity/v3/projects/e0443aad262a4cafb1425600c112ee80/users/70016b24b8884008b714b9829b629cd6/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:48.229595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9e4d2-192f-478e-ae23-4ead76621dde None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:48.229999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9e4d2-192f-478e-ae23-4ead76621dde None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:48.230288 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9e4d2-192f-478e-ae23-4ead76621dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:48.266723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2ac9e4d2-192f-478e-ae23-4ead76621dde None None] MFA Rules not processed for user `70016b24b8884008b714b9829b629cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:48.269159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2ac9e4d2-192f-478e-ae23-4ead76621dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:48.401888 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1102/2190] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:48.410404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3ed3f-fd69-4655-bb38-75a4f56303cd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:48.421811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d4a3ed3f-fd69-4655-bb38-75a4f56303cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:48.505589 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3ed3f-fd69-4655-bb38-75a4f56303cd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:48.511330 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d7700-983b-4cd3-ace7-b28bb4e965b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:48.512021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d7700-983b-4cd3-ace7-b28bb4e965b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:48.512357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d7700-983b-4cd3-ace7-b28bb4e965b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:48.512588 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d7700-983b-4cd3-ace7-b28bb4e965b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:48.522115 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:48.528893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d7700-983b-4cd3-ace7-b28bb4e965b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:48.530571 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d7700-983b-4cd3-ace7-b28bb4e965b5 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:48.549630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1089/2191] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:48.757427 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9e4d2-192f-478e-ae23-4ead76621dde None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:48.759216 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2ac9e4d2-192f-478e-ae23-4ead76621dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:48.778676 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:48.859586 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9e4d2-192f-478e-ae23-4ead76621dde None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:48.865120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e7fd0-6f42-480b-9358-4569d4e7f2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:48.866008 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e7fd0-6f42-480b-9358-4569d4e7f2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:48.866293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e7fd0-6f42-480b-9358-4569d4e7f2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:48.866625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e7fd0-6f42-480b-9358-4569d4e7f2ec admin admin] PATH_INFO: `/v3/projects/d322b74611d14401a43e616e551c453a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:48.867837 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e7fd0-6f42-480b-9358-4569d4e7f2ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d322b74611d14401a43e616e551c453a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:48.869791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e7fd0-6f42-480b-9358-4569d4e7f2ec admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:48.937440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-998e7fd0-6f42-480b-9358-4569d4e7f2ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd322b74611d14401a43e616e551c453a', 'request_id': 'req-998e7fd0-6f42-480b-9358-4569d4e7f2ec'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:48.947488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-998e7fd0-6f42-480b-9358-4569d4e7f2ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd322b74611d14401a43e616e551c453a', 'request_id': 'req-998e7fd0-6f42-480b-9358-4569d4e7f2ec'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:48.967101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-998e7fd0-6f42-480b-9358-4569d4e7f2ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd322b74611d14401a43e616e551c453a', 'request_id': 'req-998e7fd0-6f42-480b-9358-4569d4e7f2ec'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:48.986592 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-998e7fd0-6f42-480b-9358-4569d4e7f2ec admin admin] The token cache is being invalidate because project d322b74611d14401a43e616e551c453a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:48.987032 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-998e7fd0-6f42-480b-9358-4569d4e7f2ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:48.987583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-998e7fd0-6f42-480b-9358-4569d4e7f2ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:48.995487 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1103/2192] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:48 2022] DELETE /identity/v3/projects/d322b74611d14401a43e616e551c453a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:48.999724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf073800-5bb3-41c7-9946-34fa27ea8f9e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:48.999724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf073800-5bb3-41c7-9946-34fa27ea8f9e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:48.999724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf073800-5bb3-41c7-9946-34fa27ea8f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:49.023860 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e7fd0-6f42-480b-9358-4569d4e7f2ec admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:49.025406 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-998e7fd0-6f42-480b-9358-4569d4e7f2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:49.038540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-bf073800-5bb3-41c7-9946-34fa27ea8f9e None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:49.041177 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bf073800-5bb3-41c7-9946-34fa27ea8f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:49.122402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e7fd0-6f42-480b-9358-4569d4e7f2ec admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:49.128926 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0573cb-640b-42e7-9c65-52d202560529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:49.129980 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0573cb-640b-42e7-9c65-52d202560529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:49.130282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0573cb-640b-42e7-9c65-52d202560529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:49.130635 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0573cb-640b-42e7-9c65-52d202560529 admin admin] PATH_INFO: `/v3/users/e052821f9fd04272bf83ac2156b5f2c8` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:49.131984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0573cb-640b-42e7-9c65-52d202560529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e052821f9fd04272bf83ac2156b5f2c8)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:49.134160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0573cb-640b-42e7-9c65-52d202560529 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:49.135033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1090/2193] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:49.135783 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf073800-5bb3-41c7-9946-34fa27ea8f9e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:49.137205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bf073800-5bb3-41c7-9946-34fa27ea8f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:49.153783 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf073800-5bb3-41c7-9946-34fa27ea8f9e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:49.162742 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dd402-6603-42f0-af07-54b8c3676255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:49.163352 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dd402-6603-42f0-af07-54b8c3676255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:49.163640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dd402-6603-42f0-af07-54b8c3676255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:49.163901 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dd402-6603-42f0-af07-54b8c3676255 admin admin] PATH_INFO: `/v3/users/204ec9c9f0e4412d8e28e7b564233e69` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:49.165538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1dd402-6603-42f0-af07-54b8c3676255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=204ec9c9f0e4412d8e28e7b564233e69)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:49.167215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1dd402-6603-42f0-af07-54b8c3676255 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:49.199909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:49.209410 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2d0573cb-640b-42e7-9c65-52d202560529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e052821f9fd04272bf83ac2156b5f2c8'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:49.225803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2d0573cb-640b-42e7-9c65-52d202560529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e052821f9fd04272bf83ac2156b5f2c8'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:49.226732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2d0573cb-640b-42e7-9c65-52d202560529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e052821f9fd04272bf83ac2156b5f2c8'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:49.227454 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2d0573cb-640b-42e7-9c65-52d202560529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e052821f9fd04272bf83ac2156b5f2c8'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:49.229385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1e1dd402-6603-42f0-af07-54b8c3676255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204ec9c9f0e4412d8e28e7b564233e69'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:49.230052 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1e1dd402-6603-42f0-af07-54b8c3676255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204ec9c9f0e4412d8e28e7b564233e69'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:49.237646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2d0573cb-640b-42e7-9c65-52d202560529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e052821f9fd04272bf83ac2156b5f2c8'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:49.246039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1e1dd402-6603-42f0-af07-54b8c3676255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204ec9c9f0e4412d8e28e7b564233e69'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:49.247071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1e1dd402-6603-42f0-af07-54b8c3676255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204ec9c9f0e4412d8e28e7b564233e69'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:49.257638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1104/2194] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:49 2022] DELETE /identity/v3/users/e052821f9fd04272bf83ac2156b5f2c8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:49.259267 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f018f-7c8c-4ca1-a7aa-819f29927e67 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:49.259559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f018f-7c8c-4ca1-a7aa-819f29927e67 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:49.259843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f018f-7c8c-4ca1-a7aa-819f29927e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:49.263746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-1e1dd402-6603-42f0-af07-54b8c3676255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204ec9c9f0e4412d8e28e7b564233e69'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:49.279650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7d5f018f-7c8c-4ca1-a7aa-819f29927e67 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:49.280782 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7d5f018f-7c8c-4ca1-a7aa-819f29927e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:49.284457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1091/2195] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:49 2022] DELETE /identity/v3/users/204ec9c9f0e4412d8e28e7b564233e69 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:49.296783 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d427d-f999-43cb-ac39-3c14862ce9e3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:49.297180 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d427d-f999-43cb-ac39-3c14862ce9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:49.297526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d427d-f999-43cb-ac39-3c14862ce9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:49.325449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5d5d427d-f999-43cb-ac39-3c14862ce9e3 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:49.327224 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5d5d427d-f999-43cb-ac39-3c14862ce9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:49.429243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1092/2196] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:49.430968 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b37701-a00a-4a70-ad1d-273e8d82c78f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:49.431360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b37701-a00a-4a70-ad1d-273e8d82c78f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:49.431765 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b37701-a00a-4a70-ad1d-273e8d82c78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:49.445909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:49.455500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-51b37701-a00a-4a70-ad1d-273e8d82c78f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:49.462559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-51b37701-a00a-4a70-ad1d-273e8d82c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:49.468398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1105/2197] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:49.468892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f018f-7c8c-4ca1-a7aa-819f29927e67 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:49.477765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7d5f018f-7c8c-4ca1-a7aa-819f29927e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:49.489863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1093/2198] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:49.495807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b37701-a00a-4a70-ad1d-273e8d82c78f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:49.510516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b37701-a00a-4a70-ad1d-273e8d82c78f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:49.521239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4e60a-3e83-421f-8c48-263dfbbada36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:49.522380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4e60a-3e83-421f-8c48-263dfbbada36 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:49.522541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4e60a-3e83-421f-8c48-263dfbbada36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:49.522820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4e60a-3e83-421f-8c48-263dfbbada36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:49.523632 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4e60a-3e83-421f-8c48-263dfbbada36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:49.524377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4e60a-3e83-421f-8c48-263dfbbada36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:49.525959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4e60a-3e83-421f-8c48-263dfbbada36 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:49.540541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1094/2199] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:49.541362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4e60a-3e83-421f-8c48-263dfbbada36 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:49.543915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-62b4e60a-3e83-421f-8c48-263dfbbada36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:49.583040 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f018f-7c8c-4ca1-a7aa-819f29927e67 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:49.587138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4f710-ad0c-45a0-8521-7cbbf6ea78d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:49.589787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4f710-ad0c-45a0-8521-7cbbf6ea78d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:49.590781 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4f710-ad0c-45a0-8521-7cbbf6ea78d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:49.591280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4f710-ad0c-45a0-8521-7cbbf6ea78d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:49.608059 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4f710-ad0c-45a0-8521-7cbbf6ea78d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:49.609531 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4f710-ad0c-45a0-8521-7cbbf6ea78d1 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:49.621515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1106/2200] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:49.629733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4f710-ad0c-45a0-8521-7cbbf6ea78d1 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:49.630253 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4e60a-3e83-421f-8c48-263dfbbada36 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:49.636527 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69a8f3-b4a1-416f-ae49-076e833d4d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:49.637680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69a8f3-b4a1-416f-ae49-076e833d4d56 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:49.638163 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69a8f3-b4a1-416f-ae49-076e833d4d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:49.638836 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69a8f3-b4a1-416f-ae49-076e833d4d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:49.651644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69a8f3-b4a1-416f-ae49-076e833d4d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:49.653209 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69a8f3-b4a1-416f-ae49-076e833d4d56 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:49.655910 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4f710-ad0c-45a0-8521-7cbbf6ea78d1 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:49.666149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5966-3b9a-4f0f-9cb5-5794c34d4564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:49.666149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5966-3b9a-4f0f-9cb5-5794c34d4564 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:49.666149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5966-3b9a-4f0f-9cb5-5794c34d4564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:49.666579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5966-3b9a-4f0f-9cb5-5794c34d4564 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:49.667440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd5966-3b9a-4f0f-9cb5-5794c34d4564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:49.669562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd5966-3b9a-4f0f-9cb5-5794c34d4564 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:49.670110 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1095/2201] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:49.709450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1107/2202] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:49 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:49.710802 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69a8f3-b4a1-416f-ae49-076e833d4d56 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:49.725135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69a8f3-b4a1-416f-ae49-076e833d4d56 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:49.845273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66989693-2d3e-4c61-85e7-33ba5fb19991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:49.846587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66989693-2d3e-4c61-85e7-33ba5fb19991 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:49.847554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66989693-2d3e-4c61-85e7-33ba5fb19991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:49.847809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66989693-2d3e-4c61-85e7-33ba5fb19991 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:49.848522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66989693-2d3e-4c61-85e7-33ba5fb19991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:49.851951 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66989693-2d3e-4c61-85e7-33ba5fb19991 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:49.890622 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1096/2203] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:49 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:17:49.893372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5966-3b9a-4f0f-9cb5-5794c34d4564 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:49.904598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5966-3b9a-4f0f-9cb5-5794c34d4564 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:49.915547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c46ce-3d24-4eb1-935e-7ac7ea431be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:49.916990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c46ce-3d24-4eb1-935e-7ac7ea431be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:49.917265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c46ce-3d24-4eb1-935e-7ac7ea431be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:49.917551 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c46ce-3d24-4eb1-935e-7ac7ea431be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:49.918633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c46ce-3d24-4eb1-935e-7ac7ea431be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:49.919973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c46ce-3d24-4eb1-935e-7ac7ea431be0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:49.934868 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1108/2204] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:49.938214 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66989693-2d3e-4c61-85e7-33ba5fb19991 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:49.955065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66989693-2d3e-4c61-85e7-33ba5fb19991 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:49.960138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b62bc-dc6b-4f29-a9d1-f984d16cb610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:49.960832 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b62bc-dc6b-4f29-a9d1-f984d16cb610 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:49.961192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b62bc-dc6b-4f29-a9d1-f984d16cb610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:49.961404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b62bc-dc6b-4f29-a9d1-f984d16cb610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:49.962156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b62bc-dc6b-4f29-a9d1-f984d16cb610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:49.963806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b62bc-dc6b-4f29-a9d1-f984d16cb610 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:49.978524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1097/2205] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:49.981217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c46ce-3d24-4eb1-935e-7ac7ea431be0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:49.994702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c46ce-3d24-4eb1-935e-7ac7ea431be0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:50.000205 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f979b59-ccfa-455e-a80a-a14b532a1cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:50.001900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f979b59-ccfa-455e-a80a-a14b532a1cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:50.002251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f979b59-ccfa-455e-a80a-a14b532a1cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:50.002633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f979b59-ccfa-455e-a80a-a14b532a1cd4 admin admin] PATH_INFO: `/v3/projects/2742b029fc84493db9bf195aa108dbad/users/1d34da9fff504040a57f1f38ee326461/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:50.029099 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f979b59-ccfa-455e-a80a-a14b532a1cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2742b029fc84493db9bf195aa108dbad, user_id=1d34da9fff504040a57f1f38ee326461, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:50.031945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f979b59-ccfa-455e-a80a-a14b532a1cd4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:50.062914 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1109/2206] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:49 2022] PUT /identity/v3/projects/2742b029fc84493db9bf195aa108dbad/users/1d34da9fff504040a57f1f38ee326461/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:50.068097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85658e4e-ca96-426b-9f9a-34643850c905 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:50.068690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85658e4e-ca96-426b-9f9a-34643850c905 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:50.068861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85658e4e-ca96-426b-9f9a-34643850c905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:50.126563 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-85658e4e-ca96-426b-9f9a-34643850c905 None None] MFA Rules not processed for user `1d34da9fff504040a57f1f38ee326461`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:50.127892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-85658e4e-ca96-426b-9f9a-34643850c905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:50.132705 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f979b59-ccfa-455e-a80a-a14b532a1cd4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:50.134530 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0f979b59-ccfa-455e-a80a-a14b532a1cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:50.141116 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:50.226716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f979b59-ccfa-455e-a80a-a14b532a1cd4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:50.231774 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:50.232659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:50.232946 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:50.233257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2 admin admin] PATH_INFO: `/v3/projects/6e9f7b95e97e425fbaab72b46d774c09` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:50.234632 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9f7b95e97e425fbaab72b46d774c09)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:50.237314 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:50.256945 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:50.277598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1098/2207] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:50.292896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85658e4e-ca96-426b-9f9a-34643850c905 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:50.294936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-85658e4e-ca96-426b-9f9a-34643850c905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:50.315181 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9f7b95e97e425fbaab72b46d774c09', 'request_id': 'req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:50.324499 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9f7b95e97e425fbaab72b46d774c09', 'request_id': 'req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:50.337149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9f7b95e97e425fbaab72b46d774c09', 'request_id': 'req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:50.357047 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2 admin admin] The token cache is being invalidate because project 6e9f7b95e97e425fbaab72b46d774c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:50.357344 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:50.358260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:50.360083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1110/2208] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:50 2022] DELETE /identity/v3/projects/6e9f7b95e97e425fbaab72b46d774c09 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:50.361508 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:50.363224 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:50.429814 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85658e4e-ca96-426b-9f9a-34643850c905 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:50.476415 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594f3f3-fec3-44b4-a2ed-ed6ddcd078d2 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:50.482518 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2f628-bcc9-4907-98c8-75bc44dd5ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:50.483421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2f628-bcc9-4907-98c8-75bc44dd5ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:50.483711 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2f628-bcc9-4907-98c8-75bc44dd5ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:50.484015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2f628-bcc9-4907-98c8-75bc44dd5ba0 admin admin] PATH_INFO: `/v3/projects/ecca4e9d55974258b7f1905cf2053c80` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:50.487559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2f628-bcc9-4907-98c8-75bc44dd5ba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecca4e9d55974258b7f1905cf2053c80)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:50.489578 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2f628-bcc9-4907-98c8-75bc44dd5ba0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:50.517988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848468d-e54f-4ae2-ade9-389d506db4f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:50.517988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848468d-e54f-4ae2-ade9-389d506db4f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:50.517988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848468d-e54f-4ae2-ade9-389d506db4f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:50.518411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848468d-e54f-4ae2-ade9-389d506db4f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:50.520640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c848468d-e54f-4ae2-ade9-389d506db4f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:50.550394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:50.581488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d4c2f628-bcc9-4907-98c8-75bc44dd5ba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecca4e9d55974258b7f1905cf2053c80', 'request_id': 'req-d4c2f628-bcc9-4907-98c8-75bc44dd5ba0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:50.600085 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d4c2f628-bcc9-4907-98c8-75bc44dd5ba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecca4e9d55974258b7f1905cf2053c80', 'request_id': 'req-d4c2f628-bcc9-4907-98c8-75bc44dd5ba0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:50.611534 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d4c2f628-bcc9-4907-98c8-75bc44dd5ba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecca4e9d55974258b7f1905cf2053c80', 'request_id': 'req-d4c2f628-bcc9-4907-98c8-75bc44dd5ba0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:50.648614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d4c2f628-bcc9-4907-98c8-75bc44dd5ba0 admin admin] The token cache is being invalidate because project ecca4e9d55974258b7f1905cf2053c80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:50.651715 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d4c2f628-bcc9-4907-98c8-75bc44dd5ba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:50.651715 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d4c2f628-bcc9-4907-98c8-75bc44dd5ba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:50.653526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1111/2209] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:50 2022] DELETE /identity/v3/projects/ecca4e9d55974258b7f1905cf2053c80 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:50.655105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848468d-e54f-4ae2-ade9-389d506db4f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:50.657182 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848468d-e54f-4ae2-ade9-389d506db4f9 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:50.665414 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2d6a2-296f-4bab-9b9c-612a8949b760 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:50.665739 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2d6a2-296f-4bab-9b9c-612a8949b760 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:50.666014 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2d6a2-296f-4bab-9b9c-612a8949b760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:50.697208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1099/2210] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:50.698239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848468d-e54f-4ae2-ade9-389d506db4f9 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:50.722114 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848468d-e54f-4ae2-ade9-389d506db4f9 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:50.741222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-3dd2d6a2-296f-4bab-9b9c-612a8949b760 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:50.743438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3dd2d6a2-296f-4bab-9b9c-612a8949b760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:50.831002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70a9af-3b0a-4be2-856d-f7730a94b550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:50.834654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70a9af-3b0a-4be2-856d-f7730a94b550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:50.834654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70a9af-3b0a-4be2-856d-f7730a94b550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:50.834654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70a9af-3b0a-4be2-856d-f7730a94b550 admin admin] PATH_INFO: `/v3/users/70016b24b8884008b714b9829b629cd6` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:50.834654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70a9af-3b0a-4be2-856d-f7730a94b550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70016b24b8884008b714b9829b629cd6)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:50.836291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70a9af-3b0a-4be2-856d-f7730a94b550 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:50.852236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:50.861638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1112/2211] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:50.862713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2d6a2-296f-4bab-9b9c-612a8949b760 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:50.864162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3dd2d6a2-296f-4bab-9b9c-612a8949b760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:50.890001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2d6a2-296f-4bab-9b9c-612a8949b760 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:50.897012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc794044-7d78-47b1-8e9e-deb924766fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:50.898019 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc794044-7d78-47b1-8e9e-deb924766fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:50.898326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc794044-7d78-47b1-8e9e-deb924766fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:50.898646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc794044-7d78-47b1-8e9e-deb924766fdf admin admin] PATH_INFO: `/v3/users/1d34da9fff504040a57f1f38ee326461` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:50.899975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc794044-7d78-47b1-8e9e-deb924766fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d34da9fff504040a57f1f38ee326461)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:50.901974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc794044-7d78-47b1-8e9e-deb924766fdf admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:50.904343 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0e70a9af-3b0a-4be2-856d-f7730a94b550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70016b24b8884008b714b9829b629cd6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:50.905376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0e70a9af-3b0a-4be2-856d-f7730a94b550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70016b24b8884008b714b9829b629cd6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:50.924116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0e70a9af-3b0a-4be2-856d-f7730a94b550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70016b24b8884008b714b9829b629cd6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:50.925207 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0e70a9af-3b0a-4be2-856d-f7730a94b550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70016b24b8884008b714b9829b629cd6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:50.937651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0e70a9af-3b0a-4be2-856d-f7730a94b550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70016b24b8884008b714b9829b629cd6'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:50.955027 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1100/2212] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:50 2022] DELETE /identity/v3/users/70016b24b8884008b714b9829b629cd6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:50.956667 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130c549-167f-4b27-90fb-7379507ba198 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:50.956970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130c549-167f-4b27-90fb-7379507ba198 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:50.957482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130c549-167f-4b27-90fb-7379507ba198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:50.987870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-bc794044-7d78-47b1-8e9e-deb924766fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d34da9fff504040a57f1f38ee326461'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:51.004204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-bc794044-7d78-47b1-8e9e-deb924766fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d34da9fff504040a57f1f38ee326461'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:51.005326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-bc794044-7d78-47b1-8e9e-deb924766fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d34da9fff504040a57f1f38ee326461'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:51.006184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7130c549-167f-4b27-90fb-7379507ba198 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:51.006569 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-bc794044-7d78-47b1-8e9e-deb924766fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d34da9fff504040a57f1f38ee326461'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:51.007728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7130c549-167f-4b27-90fb-7379507ba198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:51.018823 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-bc794044-7d78-47b1-8e9e-deb924766fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d34da9fff504040a57f1f38ee326461'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:51.044176 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1113/2213] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:50 2022] DELETE /identity/v3/users/1d34da9fff504040a57f1f38ee326461 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:51.050704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4a742-7bef-4ce9-a9dd-a8440448c9a1 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:51.051411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4a742-7bef-4ce9-a9dd-a8440448c9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:51.051711 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4a742-7bef-4ce9-a9dd-a8440448c9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:51.088799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-8fa4a742-7bef-4ce9-a9dd-a8440448c9a1 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:51.090081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8fa4a742-7bef-4ce9-a9dd-a8440448c9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:51.122886 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1101/2214] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:51.127918 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130c549-167f-4b27-90fb-7379507ba198 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:51.139247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:51.139846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130c549-167f-4b27-90fb-7379507ba198 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:51.202222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1114/2215] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:51.236199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d10f8d-0efb-425c-a47a-26b46be2127c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:51.236935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d10f8d-0efb-425c-a47a-26b46be2127c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:51.237226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d10f8d-0efb-425c-a47a-26b46be2127c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:51.237501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d10f8d-0efb-425c-a47a-26b46be2127c admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:51.238307 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d10f8d-0efb-425c-a47a-26b46be2127c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:51.238644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d10f8d-0efb-425c-a47a-26b46be2127c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:51.240216 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4a742-7bef-4ce9-a9dd-a8440448c9a1 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:51.240335 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d10f8d-0efb-425c-a47a-26b46be2127c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:51.241736 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8fa4a742-7bef-4ce9-a9dd-a8440448c9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:51.264662 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1102/2216] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:51.269869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d10f8d-0efb-425c-a47a-26b46be2127c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:51.285089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d10f8d-0efb-425c-a47a-26b46be2127c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:51.304346 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a70a2-40bf-44aa-a62e-d5afeda90697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:51.305711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a70a2-40bf-44aa-a62e-d5afeda90697 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:51.306077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a70a2-40bf-44aa-a62e-d5afeda90697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:51.306665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a70a2-40bf-44aa-a62e-d5afeda90697 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:51.308205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a70a2-40bf-44aa-a62e-d5afeda90697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:51.310772 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a70a2-40bf-44aa-a62e-d5afeda90697 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:51.356019 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:51.357370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4a742-7bef-4ce9-a9dd-a8440448c9a1 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:51.371907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5f3dc-ff9e-464c-8823-100add920be6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:51.372786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5f3dc-ff9e-464c-8823-100add920be6 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:51.373080 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5f3dc-ff9e-464c-8823-100add920be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:51.373404 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5f3dc-ff9e-464c-8823-100add920be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:51.385249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1103/2217] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:51 2022] POST /identity/v3/projects => generated 397 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:17:51.386720 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a70a2-40bf-44aa-a62e-d5afeda90697 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:51.389121 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5f3dc-ff9e-464c-8823-100add920be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:51.390772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5f3dc-ff9e-464c-8823-100add920be6 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:51.416027 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1115/2218] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:51.454382 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5f3dc-ff9e-464c-8823-100add920be6 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:51.456071 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7ae5f3dc-ff9e-464c-8823-100add920be6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:51.470181 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5f3dc-ff9e-464c-8823-100add920be6 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:51.510662 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a70a2-40bf-44aa-a62e-d5afeda90697 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:51.518123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a77ed-5546-4f54-b180-01ae34542315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:51.519045 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a77ed-5546-4f54-b180-01ae34542315 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:51.519600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a77ed-5546-4f54-b180-01ae34542315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:51.519884 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a77ed-5546-4f54-b180-01ae34542315 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:51.520939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a77ed-5546-4f54-b180-01ae34542315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:51.523238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a77ed-5546-4f54-b180-01ae34542315 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:51.550581 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1104/2219] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:51 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:17:51.554525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a77ed-5546-4f54-b180-01ae34542315 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:51.564975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a77ed-5546-4f54-b180-01ae34542315 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:51.565151 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f255bb1-9459-4f59-ab6d-2619392814b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:51.566304 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f255bb1-9459-4f59-ab6d-2619392814b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:51.566800 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f255bb1-9459-4f59-ab6d-2619392814b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:51.567090 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f255bb1-9459-4f59-ab6d-2619392814b6 admin admin] PATH_INFO: `/v3/projects/e0443aad262a4cafb1425600c112ee80` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:51.568544 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f255bb1-9459-4f59-ab6d-2619392814b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0443aad262a4cafb1425600c112ee80)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:51.571136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f255bb1-9459-4f59-ab6d-2619392814b6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:51.571412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e1714-ab8b-4a12-a6cf-9b587f213b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:51.572263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e1714-ab8b-4a12-a6cf-9b587f213b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:51.572644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e1714-ab8b-4a12-a6cf-9b587f213b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:51.573058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e1714-ab8b-4a12-a6cf-9b587f213b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:51.574074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e1714-ab8b-4a12-a6cf-9b587f213b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:51.576169 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e1714-ab8b-4a12-a6cf-9b587f213b67 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:51.590523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1105/2220] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:17:51.591822 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e1714-ab8b-4a12-a6cf-9b587f213b67 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:51.607185 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e1714-ab8b-4a12-a6cf-9b587f213b67 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:51.612333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4c663-eb41-4713-b273-a7f3aa4c8a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:51.613217 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4c663-eb41-4713-b273-a7f3aa4c8a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:51.613642 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4c663-eb41-4713-b273-a7f3aa4c8a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:51.614040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4c663-eb41-4713-b273-a7f3aa4c8a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:51.615085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4c663-eb41-4713-b273-a7f3aa4c8a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:51.617606 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4c663-eb41-4713-b273-a7f3aa4c8a1d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:51.648647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0f255bb1-9459-4f59-ab6d-2619392814b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0443aad262a4cafb1425600c112ee80', 'request_id': 'req-0f255bb1-9459-4f59-ab6d-2619392814b6'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:51.653513 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1106/2221] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:17:51.654870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0f255bb1-9459-4f59-ab6d-2619392814b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0443aad262a4cafb1425600c112ee80', 'request_id': 'req-0f255bb1-9459-4f59-ab6d-2619392814b6'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:51.658734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4c663-eb41-4713-b273-a7f3aa4c8a1d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:51.665636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0f255bb1-9459-4f59-ab6d-2619392814b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0443aad262a4cafb1425600c112ee80', 'request_id': 'req-0f255bb1-9459-4f59-ab6d-2619392814b6'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:51.670954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4c663-eb41-4713-b273-a7f3aa4c8a1d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:51.683039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0f255bb1-9459-4f59-ab6d-2619392814b6 admin admin] The token cache is being invalidate because project e0443aad262a4cafb1425600c112ee80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:51.683342 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0f255bb1-9459-4f59-ab6d-2619392814b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:51.684323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-0f255bb1-9459-4f59-ab6d-2619392814b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:51.686697 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1116/2222] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:51 2022] DELETE /identity/v3/projects/e0443aad262a4cafb1425600c112ee80 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:51.692117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45681d82-6790-4247-bc01-866e85d28852 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:51.692411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45681d82-6790-4247-bc01-866e85d28852 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:51.692692 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45681d82-6790-4247-bc01-866e85d28852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:51.711617 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-45681d82-6790-4247-bc01-866e85d28852 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:51.712836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-45681d82-6790-4247-bc01-866e85d28852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:51.718565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:51.753058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8fa1b-fcb7-482f-a095-122802a65ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:51.754267 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8fa1b-fcb7-482f-a095-122802a65ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:51.754584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8fa1b-fcb7-482f-a095-122802a65ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:51.754861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8fa1b-fcb7-482f-a095-122802a65ac4 admin admin] PATH_INFO: `/v3/projects/611be60e4e394c7c9b170b47e6613ac7/users/f398d0ff956e4190a469ca0daf81583e/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:51.774922 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8fa1b-fcb7-482f-a095-122802a65ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=611be60e4e394c7c9b170b47e6613ac7, user_id=f398d0ff956e4190a469ca0daf81583e, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:51.777685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8fa1b-fcb7-482f-a095-122802a65ac4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:51.791990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1117/2223] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:51.806598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1107/2224] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:51 2022] PUT /identity/v3/projects/611be60e4e394c7c9b170b47e6613ac7/users/f398d0ff956e4190a469ca0daf81583e/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:51.806925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45681d82-6790-4247-bc01-866e85d28852 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:51.806925 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-45681d82-6790-4247-bc01-866e85d28852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:51.807068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf74238-66c2-41f3-8e51-9be1464c3d3c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:51.807068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf74238-66c2-41f3-8e51-9be1464c3d3c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:51.807068 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf74238-66c2-41f3-8e51-9be1464c3d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:51.819931 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45681d82-6790-4247-bc01-866e85d28852 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:51.833151 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cbf74238-66c2-41f3-8e51-9be1464c3d3c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:51.834698 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cbf74238-66c2-41f3-8e51-9be1464c3d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:51.904067 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:51.914859 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a28f6f-9365-40fe-b053-45f53a98a7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:51.915765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a28f6f-9365-40fe-b053-45f53a98a7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:51.916037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a28f6f-9365-40fe-b053-45f53a98a7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:51.916321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a28f6f-9365-40fe-b053-45f53a98a7e3 admin admin] PATH_INFO: `/v3/projects/2742b029fc84493db9bf195aa108dbad` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:51.917852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a28f6f-9365-40fe-b053-45f53a98a7e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2742b029fc84493db9bf195aa108dbad)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:51.920108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a28f6f-9365-40fe-b053-45f53a98a7e3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:51.927285 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1108/2225] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:51.928780 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0d40a-03c7-4e1a-8dc6-d2b4c5a901bf None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:51.929071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0d40a-03c7-4e1a-8dc6-d2b4c5a901bf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:51.929349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0d40a-03c7-4e1a-8dc6-d2b4c5a901bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:51.970674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b1a0d40a-03c7-4e1a-8dc6-d2b4c5a901bf None None] MFA Rules not processed for user `f398d0ff956e4190a469ca0daf81583e`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:51.971600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b1a0d40a-03c7-4e1a-8dc6-d2b4c5a901bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:51.980051 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-80a28f6f-9365-40fe-b053-45f53a98a7e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2742b029fc84493db9bf195aa108dbad', 'request_id': 'req-80a28f6f-9365-40fe-b053-45f53a98a7e3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:51.988847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-80a28f6f-9365-40fe-b053-45f53a98a7e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2742b029fc84493db9bf195aa108dbad', 'request_id': 'req-80a28f6f-9365-40fe-b053-45f53a98a7e3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:51.997559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-80a28f6f-9365-40fe-b053-45f53a98a7e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2742b029fc84493db9bf195aa108dbad', 'request_id': 'req-80a28f6f-9365-40fe-b053-45f53a98a7e3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:52.015370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-80a28f6f-9365-40fe-b053-45f53a98a7e3 admin admin] The token cache is being invalidate because project 2742b029fc84493db9bf195aa108dbad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:52.015658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-80a28f6f-9365-40fe-b053-45f53a98a7e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:52.016423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-80a28f6f-9365-40fe-b053-45f53a98a7e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:52.018291 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1118/2226] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:51 2022] DELETE /identity/v3/projects/2742b029fc84493db9bf195aa108dbad => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:52.019114 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a28f6f-9365-40fe-b053-45f53a98a7e3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:52.020475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-80a28f6f-9365-40fe-b053-45f53a98a7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:52.057020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1109/2227] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:52.058899 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7aaf99-93d0-49ee-81d4-e50bc24de041 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.059441 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7aaf99-93d0-49ee-81d4-e50bc24de041 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.059841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7aaf99-93d0-49ee-81d4-e50bc24de041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.082220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fe7aaf99-93d0-49ee-81d4-e50bc24de041 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:52.082633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:52.083482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fe7aaf99-93d0-49ee-81d4-e50bc24de041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:52.105967 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a28f6f-9365-40fe-b053-45f53a98a7e3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:52.112212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b973d83-dd2b-4739-97d4-16f178e54ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:52.113045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b973d83-dd2b-4739-97d4-16f178e54ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.113630 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b973d83-dd2b-4739-97d4-16f178e54ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.114044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b973d83-dd2b-4739-97d4-16f178e54ffb admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.114852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b973d83-dd2b-4739-97d4-16f178e54ffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:52.115200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b973d83-dd2b-4739-97d4-16f178e54ffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:52.116995 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b973d83-dd2b-4739-97d4-16f178e54ffb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:52.135221 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1119/2228] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:52.136206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b973d83-dd2b-4739-97d4-16f178e54ffb admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:52.137980 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8b973d83-dd2b-4739-97d4-16f178e54ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:52.152460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1110/2229] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:52.153352 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7aaf99-93d0-49ee-81d4-e50bc24de041 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:52.165353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7aaf99-93d0-49ee-81d4-e50bc24de041 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:52.170043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea45d93-468e-41ad-86c3-cf4028bd5ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:52.170742 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea45d93-468e-41ad-86c3-cf4028bd5ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.171028 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea45d93-468e-41ad-86c3-cf4028bd5ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.171305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea45d93-468e-41ad-86c3-cf4028bd5ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.171997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea45d93-468e-41ad-86c3-cf4028bd5ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:52.175101 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea45d93-468e-41ad-86c3-cf4028bd5ea5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:52.202469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1111/2230] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:52 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:52.203420 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0721a4f-f2c8-4397-939d-1395b95d1748 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.203704 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0721a4f-f2c8-4397-939d-1395b95d1748 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.204457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0721a4f-f2c8-4397-939d-1395b95d1748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.208755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b973d83-dd2b-4739-97d4-16f178e54ffb admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:52.224453 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a0721a4f-f2c8-4397-939d-1395b95d1748 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:52.225925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a0721a4f-f2c8-4397-939d-1395b95d1748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:52.261491 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffb392-4d33-46d6-b8c4-6b11c003de43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:52.262153 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffb392-4d33-46d6-b8c4-6b11c003de43 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.262453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffb392-4d33-46d6-b8c4-6b11c003de43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.262751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffb392-4d33-46d6-b8c4-6b11c003de43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.284140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:52.297609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1112/2231] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:52.299253 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0721a4f-f2c8-4397-939d-1395b95d1748 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:52.308889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0721a4f-f2c8-4397-939d-1395b95d1748 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:52.313799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce517b0-ffee-4d14-bbb7-7be969a68b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:52.314626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce517b0-ffee-4d14-bbb7-7be969a68b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.314962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce517b0-ffee-4d14-bbb7-7be969a68b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.315434 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce517b0-ffee-4d14-bbb7-7be969a68b21 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.316225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce517b0-ffee-4d14-bbb7-7be969a68b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:52.318236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce517b0-ffee-4d14-bbb7-7be969a68b21 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:52.338859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1113/2232] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:52 2022] POST /identity/v3/users => generated 288 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:52.339688 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce517b0-ffee-4d14-bbb7-7be969a68b21 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:52.342164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffb392-4d33-46d6-b8c4-6b11c003de43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:52.346775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffb392-4d33-46d6-b8c4-6b11c003de43 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:52.354379 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce517b0-ffee-4d14-bbb7-7be969a68b21 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:52.358711 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1120/2233] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:52.359174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffb392-4d33-46d6-b8c4-6b11c003de43 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:52.367545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b6e91-3ecc-4a9c-9af5-a201dcae0db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:52.368220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b6e91-3ecc-4a9c-9af5-a201dcae0db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.368649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b6e91-3ecc-4a9c-9af5-a201dcae0db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.368929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b6e91-3ecc-4a9c-9af5-a201dcae0db2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.369793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b6e91-3ecc-4a9c-9af5-a201dcae0db2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:52.370105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b6e91-3ecc-4a9c-9af5-a201dcae0db2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:52.371022 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffb392-4d33-46d6-b8c4-6b11c003de43 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:52.371764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b6e91-3ecc-4a9c-9af5-a201dcae0db2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:52.378462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7ded2-2a0e-4802-bfdb-90e8becc864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:52.379368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7ded2-2a0e-4802-bfdb-90e8becc864a admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.380266 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7ded2-2a0e-4802-bfdb-90e8becc864a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.381835 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7ded2-2a0e-4802-bfdb-90e8becc864a admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.382831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7ded2-2a0e-4802-bfdb-90e8becc864a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:52.385398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7ded2-2a0e-4802-bfdb-90e8becc864a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:52.392424 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1114/2234] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:52.397071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b6e91-3ecc-4a9c-9af5-a201dcae0db2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:52.406665 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1121/2235] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:52.408052 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b6e91-3ecc-4a9c-9af5-a201dcae0db2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:52.408519 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7ded2-2a0e-4802-bfdb-90e8becc864a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:52.413477 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d02f0d-ee40-4905-87ec-d3225d512ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:52.414249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d02f0d-ee40-4905-87ec-d3225d512ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.414577 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d02f0d-ee40-4905-87ec-d3225d512ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.414862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d02f0d-ee40-4905-87ec-d3225d512ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.415560 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d02f0d-ee40-4905-87ec-d3225d512ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:52.417482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d02f0d-ee40-4905-87ec-d3225d512ae4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:52.422658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7ded2-2a0e-4802-bfdb-90e8becc864a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:52.428929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ea356-1244-4a9a-a5b8-26236298ba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:52.429620 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ea356-1244-4a9a-a5b8-26236298ba7b admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.429909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ea356-1244-4a9a-a5b8-26236298ba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.430194 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ea356-1244-4a9a-a5b8-26236298ba7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.430961 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ea356-1244-4a9a-a5b8-26236298ba7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:52.432596 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ea356-1244-4a9a-a5b8-26236298ba7b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:52.448867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1122/2236] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:52.449962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ea356-1244-4a9a-a5b8-26236298ba7b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:52.453462 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1115/2237] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:52 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:17:52.458941 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d02f0d-ee40-4905-87ec-d3225d512ae4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:52.474236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ea356-1244-4a9a-a5b8-26236298ba7b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:52.511051 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:52.581129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7a45f-4318-47e6-a77c-df9cee088bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:52.582163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7a45f-4318-47e6-a77c-df9cee088bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.582587 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7a45f-4318-47e6-a77c-df9cee088bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.582968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7a45f-4318-47e6-a77c-df9cee088bd9 admin admin] PATH_INFO: `/v3/projects/de52e5c5c9ae41bfb6ee25a0ee7e11d8/users/86d9b1d9c0b44767b9e34679c3c5ec0d/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.592688 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d02f0d-ee40-4905-87ec-d3225d512ae4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:52.603514 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7a45f-4318-47e6-a77c-df9cee088bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de52e5c5c9ae41bfb6ee25a0ee7e11d8, user_id=86d9b1d9c0b44767b9e34679c3c5ec0d, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:52.606848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7a45f-4318-47e6-a77c-df9cee088bd9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:52.607376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc5df9-51f0-4121-8ca8-1e4e5634ce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:52.608293 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc5df9-51f0-4121-8ca8-1e4e5634ce48 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.608721 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc5df9-51f0-4121-8ca8-1e4e5634ce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.609204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc5df9-51f0-4121-8ca8-1e4e5634ce48 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.610921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc5df9-51f0-4121-8ca8-1e4e5634ce48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:52.613531 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc5df9-51f0-4121-8ca8-1e4e5634ce48 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:52.640939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1123/2238] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:52 2022] PUT /identity/v3/projects/de52e5c5c9ae41bfb6ee25a0ee7e11d8/users/86d9b1d9c0b44767b9e34679c3c5ec0d/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:52.663589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5788d16-bd6c-4424-aafd-d72811f59525 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.665194 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5788d16-bd6c-4424-aafd-d72811f59525 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.665641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5788d16-bd6c-4424-aafd-d72811f59525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.673371 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1116/2239] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:52 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:52.677961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc5df9-51f0-4121-8ca8-1e4e5634ce48 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:52.704707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc5df9-51f0-4121-8ca8-1e4e5634ce48 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:52.743694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a5788d16-bd6c-4424-aafd-d72811f59525 None None] MFA Rules not processed for user `86d9b1d9c0b44767b9e34679c3c5ec0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:52.744947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a5788d16-bd6c-4424-aafd-d72811f59525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:52.862874 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1124/2240] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:52.863076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2671c-2e07-4917-a4f1-05b945599ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:52.863076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2671c-2e07-4917-a4f1-05b945599ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.863076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2671c-2e07-4917-a4f1-05b945599ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.863076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2671c-2e07-4917-a4f1-05b945599ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.863772 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2671c-2e07-4917-a4f1-05b945599ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:52.865480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2671c-2e07-4917-a4f1-05b945599ef1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:52.871678 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5788d16-bd6c-4424-aafd-d72811f59525 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:52.894599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1117/2241] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:17:52.895572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2671c-2e07-4917-a4f1-05b945599ef1 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:52.915306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2671c-2e07-4917-a4f1-05b945599ef1 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:52.923929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc2f8e-cc8a-4f43-ab53-d2196b41d203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:52.925050 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc2f8e-cc8a-4f43-ab53-d2196b41d203 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.925388 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc2f8e-cc8a-4f43-ab53-d2196b41d203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.925685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc2f8e-cc8a-4f43-ab53-d2196b41d203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.926415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc2f8e-cc8a-4f43-ab53-d2196b41d203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:52.928442 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc2f8e-cc8a-4f43-ab53-d2196b41d203 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:52.941192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1118/2242] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:52.948093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc2f8e-cc8a-4f43-ab53-d2196b41d203 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:52.963472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5788d16-bd6c-4424-aafd-d72811f59525 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:52.983353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc2f8e-cc8a-4f43-ab53-d2196b41d203 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:52.983659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591370c-d939-401e-8cbd-480074ef0923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:52.984783 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591370c-d939-401e-8cbd-480074ef0923 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.985257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591370c-d939-401e-8cbd-480074ef0923 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.985716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591370c-d939-401e-8cbd-480074ef0923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:52.996136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591370c-d939-401e-8cbd-480074ef0923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:52.997053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6186ca4-912b-4170-bc8d-f3673660d26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:52.997605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591370c-d939-401e-8cbd-480074ef0923 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:52.997966 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186ca4-912b-4170-bc8d-f3673660d26c admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:52.998250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186ca4-912b-4170-bc8d-f3673660d26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:52.998577 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6186ca4-912b-4170-bc8d-f3673660d26c admin admin] PATH_INFO: `/v3/projects/82fdf4d41c094ec1a21d33ef1f782862/users/3104db56d1524068a195fc94cc21ab2a/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:53.008757 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1125/2243] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:53.038394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6186ca4-912b-4170-bc8d-f3673660d26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=82fdf4d41c094ec1a21d33ef1f782862, user_id=3104db56d1524068a195fc94cc21ab2a, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:53.042378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6186ca4-912b-4170-bc8d-f3673660d26c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:53.060535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:53.082935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1119/2244] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:52 2022] PUT /identity/v3/projects/82fdf4d41c094ec1a21d33ef1f782862/users/3104db56d1524068a195fc94cc21ab2a/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:53.083937 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ef6a8-ac81-4c0b-9d99-99afaf91861b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:53.084233 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ef6a8-ac81-4c0b-9d99-99afaf91861b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:53.084517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ef6a8-ac81-4c0b-9d99-99afaf91861b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:53.131035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-733ef6a8-ac81-4c0b-9d99-99afaf91861b None None] MFA Rules not processed for user `3104db56d1524068a195fc94cc21ab2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:53.132824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-733ef6a8-ac81-4c0b-9d99-99afaf91861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:53.171450 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:53.232059 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1126/2245] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:53.244175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6186ca4-912b-4170-bc8d-f3673660d26c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:53.245934 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d6186ca4-912b-4170-bc8d-f3673660d26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:53.311322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6186ca4-912b-4170-bc8d-f3673660d26c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:53.315759 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a8993-4e62-482a-b43e-cc5a07db6bc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:53.316359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a8993-4e62-482a-b43e-cc5a07db6bc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:53.316644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a8993-4e62-482a-b43e-cc5a07db6bc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:53.316925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a8993-4e62-482a-b43e-cc5a07db6bc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:53.327313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a8993-4e62-482a-b43e-cc5a07db6bc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:53.329635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a8993-4e62-482a-b43e-cc5a07db6bc3 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:53.341611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1120/2246] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:54.698708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ef9f-ed0d-4127-891e-adee04084715 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:54.699295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ef9f-ed0d-4127-891e-adee04084715 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:54.699295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ef9f-ed0d-4127-891e-adee04084715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:54.718033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1d92ef9f-ed0d-4127-891e-adee04084715 None None] MFA Rules not processed for user `3104db56d1524068a195fc94cc21ab2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:54.719298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1d92ef9f-ed0d-4127-891e-adee04084715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:54.726685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1127/2247] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:17:56.162496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a8993-4e62-482a-b43e-cc5a07db6bc3 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:56.233931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a8993-4e62-482a-b43e-cc5a07db6bc3 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:56.239202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c52644-952c-4f8e-a3ba-436555d11ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:56.240085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c52644-952c-4f8e-a3ba-436555d11ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:56.240370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c52644-952c-4f8e-a3ba-436555d11ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:56.240652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c52644-952c-4f8e-a3ba-436555d11ba1 admin admin] PATH_INFO: `/v3/users/86d9b1d9c0b44767b9e34679c3c5ec0d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:56.241846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c52644-952c-4f8e-a3ba-436555d11ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d9b1d9c0b44767b9e34679c3c5ec0d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:56.243929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c52644-952c-4f8e-a3ba-436555d11ba1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:56.302545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-86c52644-952c-4f8e-a3ba-436555d11ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d9b1d9c0b44767b9e34679c3c5ec0d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:56.303291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-86c52644-952c-4f8e-a3ba-436555d11ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d9b1d9c0b44767b9e34679c3c5ec0d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:56.320251 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-86c52644-952c-4f8e-a3ba-436555d11ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d9b1d9c0b44767b9e34679c3c5ec0d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:56.321270 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-86c52644-952c-4f8e-a3ba-436555d11ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d9b1d9c0b44767b9e34679c3c5ec0d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:56.330210 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-86c52644-952c-4f8e-a3ba-436555d11ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d9b1d9c0b44767b9e34679c3c5ec0d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:56.344549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1121/2248] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:56 2022] DELETE /identity/v3/users/86d9b1d9c0b44767b9e34679c3c5ec0d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:56.349066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a524a-861b-4567-8ed7-9c719b0854e9 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:56.349575 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a524a-861b-4567-8ed7-9c719b0854e9 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:56.350387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a524a-861b-4567-8ed7-9c719b0854e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:56.377077 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b52a524a-861b-4567-8ed7-9c719b0854e9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:56.378856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b52a524a-861b-4567-8ed7-9c719b0854e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:56.455632 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1128/2249] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:56.466551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c52644-952c-4f8e-a3ba-436555d11ba1 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:56.468001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-86c52644-952c-4f8e-a3ba-436555d11ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:56.495933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:56.561259 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c52644-952c-4f8e-a3ba-436555d11ba1 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:56.566104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31792462-3922-433e-a731-2d0e7f3108d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:56.567013 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31792462-3922-433e-a731-2d0e7f3108d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:56.567468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31792462-3922-433e-a731-2d0e7f3108d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:56.567908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31792462-3922-433e-a731-2d0e7f3108d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:56.582702 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31792462-3922-433e-a731-2d0e7f3108d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:56.584265 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31792462-3922-433e-a731-2d0e7f3108d3 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:56.596714 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1122/2250] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:56.965751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a524a-861b-4567-8ed7-9c719b0854e9 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:56.979193 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b52a524a-861b-4567-8ed7-9c719b0854e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:57.013637 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a524a-861b-4567-8ed7-9c719b0854e9 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:57.023236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c84d8-74b7-4af3-97cb-28219cb70a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:57.025595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c84d8-74b7-4af3-97cb-28219cb70a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:57.026166 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c84d8-74b7-4af3-97cb-28219cb70a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:57.027089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c84d8-74b7-4af3-97cb-28219cb70a41 admin admin] PATH_INFO: `/v3/projects/de52e5c5c9ae41bfb6ee25a0ee7e11d8` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:57.029007 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c84d8-74b7-4af3-97cb-28219cb70a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de52e5c5c9ae41bfb6ee25a0ee7e11d8)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:57.033436 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c84d8-74b7-4af3-97cb-28219cb70a41 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:57.099806 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e95c84d8-74b7-4af3-97cb-28219cb70a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de52e5c5c9ae41bfb6ee25a0ee7e11d8', 'request_id': 'req-e95c84d8-74b7-4af3-97cb-28219cb70a41'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:57.106050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e95c84d8-74b7-4af3-97cb-28219cb70a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de52e5c5c9ae41bfb6ee25a0ee7e11d8', 'request_id': 'req-e95c84d8-74b7-4af3-97cb-28219cb70a41'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:57.113836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e95c84d8-74b7-4af3-97cb-28219cb70a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de52e5c5c9ae41bfb6ee25a0ee7e11d8', 'request_id': 'req-e95c84d8-74b7-4af3-97cb-28219cb70a41'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:57.126045 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e95c84d8-74b7-4af3-97cb-28219cb70a41 admin admin] The token cache is being invalidate because project de52e5c5c9ae41bfb6ee25a0ee7e11d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:57.126735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e95c84d8-74b7-4af3-97cb-28219cb70a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:57.127389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e95c84d8-74b7-4af3-97cb-28219cb70a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:57.129116 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1129/2251] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:56 2022] DELETE /identity/v3/projects/de52e5c5c9ae41bfb6ee25a0ee7e11d8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:57.134239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e717e7-1a0c-4950-8905-4b60b54f531c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:57.134574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e717e7-1a0c-4950-8905-4b60b54f531c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:57.134856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e717e7-1a0c-4950-8905-4b60b54f531c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:57.154259 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c2e717e7-1a0c-4950-8905-4b60b54f531c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:57.155541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c2e717e7-1a0c-4950-8905-4b60b54f531c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:57.221065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1123/2252] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:57.228940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca7105-d0fd-4054-abdd-57c5134b54e3 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:57.229242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca7105-d0fd-4054-abdd-57c5134b54e3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:57.229550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca7105-d0fd-4054-abdd-57c5134b54e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:57.248066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a1ca7105-d0fd-4054-abdd-57c5134b54e3 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:57.249325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a1ca7105-d0fd-4054-abdd-57c5134b54e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:57.259342 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1130/2253] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:57.263646 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e717e7-1a0c-4950-8905-4b60b54f531c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:57.274771 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e717e7-1a0c-4950-8905-4b60b54f531c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:57.279452 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaae5d6-eb78-40ac-9681-ea0e0f4f9bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:57.280111 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaae5d6-eb78-40ac-9681-ea0e0f4f9bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:57.280396 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaae5d6-eb78-40ac-9681-ea0e0f4f9bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:57.280676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaae5d6-eb78-40ac-9681-ea0e0f4f9bb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:57.281408 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaae5d6-eb78-40ac-9681-ea0e0f4f9bb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:17:57.281722 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaae5d6-eb78-40ac-9681-ea0e0f4f9bb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:57.283975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaae5d6-eb78-40ac-9681-ea0e0f4f9bb1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:57.296747 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1124/2254] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:17:57.301652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca7105-d0fd-4054-abdd-57c5134b54e3 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:57.311439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca7105-d0fd-4054-abdd-57c5134b54e3 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:57.316778 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25752ec5-34a0-4f3e-bc1c-edaada7121e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:57.317442 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25752ec5-34a0-4f3e-bc1c-edaada7121e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:57.317729 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25752ec5-34a0-4f3e-bc1c-edaada7121e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:57.318013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25752ec5-34a0-4f3e-bc1c-edaada7121e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:57.318740 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25752ec5-34a0-4f3e-bc1c-edaada7121e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:57.320911 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25752ec5-34a0-4f3e-bc1c-edaada7121e3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:57.360430 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1131/2255] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:17:57 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:57.361153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaae5d6-eb78-40ac-9681-ea0e0f4f9bb1 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:57.372773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaae5d6-eb78-40ac-9681-ea0e0f4f9bb1 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:57.451930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33042b75-437f-4ea9-8231-bfa92626d3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:57.455423 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33042b75-437f-4ea9-8231-bfa92626d3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:57.455423 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33042b75-437f-4ea9-8231-bfa92626d3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:57.455423 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33042b75-437f-4ea9-8231-bfa92626d3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:57.456448 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33042b75-437f-4ea9-8231-bfa92626d3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:57.459428 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33042b75-437f-4ea9-8231-bfa92626d3b0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:57.486497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1125/2256] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:17:57 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:17:57.490576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25752ec5-34a0-4f3e-bc1c-edaada7121e3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:57.506276 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25752ec5-34a0-4f3e-bc1c-edaada7121e3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:57.510976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563867f-70f4-4f81-9c3a-23f4db873da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:57.511657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563867f-70f4-4f81-9c3a-23f4db873da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:57.511944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563867f-70f4-4f81-9c3a-23f4db873da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:57.512226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563867f-70f4-4f81-9c3a-23f4db873da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:57.512953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563867f-70f4-4f81-9c3a-23f4db873da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:57.514601 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563867f-70f4-4f81-9c3a-23f4db873da3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:57.527031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1132/2257] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:57.531469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33042b75-437f-4ea9-8231-bfa92626d3b0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:57.541980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33042b75-437f-4ea9-8231-bfa92626d3b0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:57.547005 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54503c83-46c1-449b-8e45-fabc958fd16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:57.548101 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54503c83-46c1-449b-8e45-fabc958fd16f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:57.548342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54503c83-46c1-449b-8e45-fabc958fd16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:57.548614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54503c83-46c1-449b-8e45-fabc958fd16f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:57.549346 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54503c83-46c1-449b-8e45-fabc958fd16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:57.551054 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54503c83-46c1-449b-8e45-fabc958fd16f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:57.562395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1126/2258] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:17:57.566979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563867f-70f4-4f81-9c3a-23f4db873da3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:57.573419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:57.577613 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563867f-70f4-4f81-9c3a-23f4db873da3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:57.584849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b04c08-d554-49a8-be56-44133749b938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:57.586238 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b04c08-d554-49a8-be56-44133749b938 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:57.586884 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b04c08-d554-49a8-be56-44133749b938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:57.587439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b04c08-d554-49a8-be56-44133749b938 admin admin] PATH_INFO: `/v3/projects/aebdb5dde4ea475a8bd74bdc6db79392/users/abac759980bd4a679dbd702a3fee5eeb/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:57.604141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b04c08-d554-49a8-be56-44133749b938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aebdb5dde4ea475a8bd74bdc6db79392, user_id=abac759980bd4a679dbd702a3fee5eeb, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:57.606984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b04c08-d554-49a8-be56-44133749b938 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:57.621550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1133/2259] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:17:57 2022] PUT /identity/v3/projects/aebdb5dde4ea475a8bd74bdc6db79392/users/abac759980bd4a679dbd702a3fee5eeb/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:17:57.627424 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7543bf-911a-4ecd-a59f-087a6a875d81 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:57.627730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7543bf-911a-4ecd-a59f-087a6a875d81 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:57.628112 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7543bf-911a-4ecd-a59f-087a6a875d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:57.646701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-dd7543bf-911a-4ecd-a59f-087a6a875d81 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:57.648031 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dd7543bf-911a-4ecd-a59f-087a6a875d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:57.679185 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:57.694924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b04c08-d554-49a8-be56-44133749b938 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:57.696898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-37b04c08-d554-49a8-be56-44133749b938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:57.724642 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1127/2260] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:57.734099 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7543bf-911a-4ecd-a59f-087a6a875d81 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:57.737263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dd7543bf-911a-4ecd-a59f-087a6a875d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:57.770082 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b04c08-d554-49a8-be56-44133749b938 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:57.774890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a531d-1e58-4dd5-954c-71a8e30da70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:57.775771 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a531d-1e58-4dd5-954c-71a8e30da70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:57.776059 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a531d-1e58-4dd5-954c-71a8e30da70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:57.776345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a531d-1e58-4dd5-954c-71a8e30da70a admin admin] PATH_INFO: `/v3/users/f398d0ff956e4190a469ca0daf81583e` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:57.777577 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a531d-1e58-4dd5-954c-71a8e30da70a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f398d0ff956e4190a469ca0daf81583e)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:57.779591 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a531d-1e58-4dd5-954c-71a8e30da70a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:57.798775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7543bf-911a-4ecd-a59f-087a6a875d81 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:57.803247 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610f6ca-b34b-45d6-9663-49260155ad59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:57.804004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610f6ca-b34b-45d6-9663-49260155ad59 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:57.804288 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610f6ca-b34b-45d6-9663-49260155ad59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:57.807343 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610f6ca-b34b-45d6-9663-49260155ad59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:57.829048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610f6ca-b34b-45d6-9663-49260155ad59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:57.830615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610f6ca-b34b-45d6-9663-49260155ad59 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:57.846224 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1128/2261] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:57.851682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8c1a531d-1e58-4dd5-954c-71a8e30da70a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f398d0ff956e4190a469ca0daf81583e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:57.872383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8c1a531d-1e58-4dd5-954c-71a8e30da70a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f398d0ff956e4190a469ca0daf81583e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:57.873542 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8c1a531d-1e58-4dd5-954c-71a8e30da70a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f398d0ff956e4190a469ca0daf81583e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:57.874694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8c1a531d-1e58-4dd5-954c-71a8e30da70a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f398d0ff956e4190a469ca0daf81583e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:57.889976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8c1a531d-1e58-4dd5-954c-71a8e30da70a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f398d0ff956e4190a469ca0daf81583e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:57.917086 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1134/2262] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:17:57 2022] DELETE /identity/v3/users/f398d0ff956e4190a469ca0daf81583e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:17:57.921590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf08eff-f954-401a-8dfc-cc4665144b6a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:57.923428 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf08eff-f954-401a-8dfc-cc4665144b6a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:57.924096 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf08eff-f954-401a-8dfc-cc4665144b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:57.947179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-baf08eff-f954-401a-8dfc-cc4665144b6a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:57.948503 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-baf08eff-f954-401a-8dfc-cc4665144b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:58.037167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1129/2263] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:58.050066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a531d-1e58-4dd5-954c-71a8e30da70a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:58.054225 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8c1a531d-1e58-4dd5-954c-71a8e30da70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:58.225793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a531d-1e58-4dd5-954c-71a8e30da70a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:58.230877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a680f5d-66e7-40ec-8678-9ce156dd8fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:58.231623 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a680f5d-66e7-40ec-8678-9ce156dd8fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:58.231915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a680f5d-66e7-40ec-8678-9ce156dd8fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:58.232197 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a680f5d-66e7-40ec-8678-9ce156dd8fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:58.248633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a680f5d-66e7-40ec-8678-9ce156dd8fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:58.250302 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a680f5d-66e7-40ec-8678-9ce156dd8fc0 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:58.265498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1135/2264] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:17:58.867069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7a179-221c-4fc8-94fc-3b5aea8e1eaa None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:58.867640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7a179-221c-4fc8-94fc-3b5aea8e1eaa None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:58.867640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7a179-221c-4fc8-94fc-3b5aea8e1eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:58.898144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-60e7a179-221c-4fc8-94fc-3b5aea8e1eaa None None] MFA Rules not processed for user `abac759980bd4a679dbd702a3fee5eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:17:58.899569 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-60e7a179-221c-4fc8-94fc-3b5aea8e1eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:58.977419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1130/2265] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:17:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:17:58.989649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a680f5d-66e7-40ec-8678-9ce156dd8fc0 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:58.991258 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7a680f5d-66e7-40ec-8678-9ce156dd8fc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:58.997697 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:59.077557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a680f5d-66e7-40ec-8678-9ce156dd8fc0 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:59.087114 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2909f6d-7c94-4ddc-8237-4785e5c6d004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:59.089099 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2909f6d-7c94-4ddc-8237-4785e5c6d004 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:59.089622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2909f6d-7c94-4ddc-8237-4785e5c6d004 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:59.090111 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2909f6d-7c94-4ddc-8237-4785e5c6d004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:59.106560 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2909f6d-7c94-4ddc-8237-4785e5c6d004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:59.108141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2909f6d-7c94-4ddc-8237-4785e5c6d004 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:59.123191 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1136/2266] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:17:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:17:59.384279 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7a179-221c-4fc8-94fc-3b5aea8e1eaa None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:17:59.385189 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-60e7a179-221c-4fc8-94fc-3b5aea8e1eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:17:59.398295 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:17:59.409835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7a179-221c-4fc8-94fc-3b5aea8e1eaa None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:17:59.415908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82952413-e59f-4cb8-810c-5598e2f82501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:17:59.416928 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82952413-e59f-4cb8-810c-5598e2f82501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:17:59.417290 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82952413-e59f-4cb8-810c-5598e2f82501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:17:59.417840 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82952413-e59f-4cb8-810c-5598e2f82501 admin admin] PATH_INFO: `/v3/projects/611be60e4e394c7c9b170b47e6613ac7` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:17:59.419188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82952413-e59f-4cb8-810c-5598e2f82501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=611be60e4e394c7c9b170b47e6613ac7)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:17:59.421523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82952413-e59f-4cb8-810c-5598e2f82501 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:17:59.572655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-82952413-e59f-4cb8-810c-5598e2f82501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '611be60e4e394c7c9b170b47e6613ac7', 'request_id': 'req-82952413-e59f-4cb8-810c-5598e2f82501'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:59.590299 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-82952413-e59f-4cb8-810c-5598e2f82501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '611be60e4e394c7c9b170b47e6613ac7', 'request_id': 'req-82952413-e59f-4cb8-810c-5598e2f82501'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:59.605775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-82952413-e59f-4cb8-810c-5598e2f82501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '611be60e4e394c7c9b170b47e6613ac7', 'request_id': 'req-82952413-e59f-4cb8-810c-5598e2f82501'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:59.627614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-82952413-e59f-4cb8-810c-5598e2f82501 admin admin] The token cache is being invalidate because project 611be60e4e394c7c9b170b47e6613ac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:17:59.628524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-82952413-e59f-4cb8-810c-5598e2f82501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:59.631004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-82952413-e59f-4cb8-810c-5598e2f82501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:17:59.633033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1131/2267] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:17:59 2022] DELETE /identity/v3/projects/611be60e4e394c7c9b170b47e6613ac7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:18:00.716032 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeb65a-6393-4031-a776-af9502b82bac None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:00.716957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeb65a-6393-4031-a776-af9502b82bac None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:00.717530 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeb65a-6393-4031-a776-af9502b82bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:00.744941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ecaeb65a-6393-4031-a776-af9502b82bac None None] MFA Rules not processed for user `abac759980bd4a679dbd702a3fee5eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:00.746553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ecaeb65a-6393-4031-a776-af9502b82bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:00.816433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1137/2268] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:01.758299 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda60a7-fe0f-4f00-9b1f-512ebfdb374c None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:01.758887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda60a7-fe0f-4f00-9b1f-512ebfdb374c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:01.758887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda60a7-fe0f-4f00-9b1f-512ebfdb374c None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:01.760348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1132/2269] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 16 16:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:18:01.765667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591ea3c-e04f-411e-a001-8747b24ac2a6 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:01.766180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591ea3c-e04f-411e-a001-8747b24ac2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:01.766845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591ea3c-e04f-411e-a001-8747b24ac2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:01.796669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d591ea3c-e04f-411e-a001-8747b24ac2a6 None None] MFA Rules not processed for user `795c029cb14b42b5b0f3987e218d4239`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:01.798225 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d591ea3c-e04f-411e-a001-8747b24ac2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:01.899757 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1138/2270] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 16 16:18:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:02.009769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda60a7-fe0f-4f00-9b1f-512ebfdb374c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:02.012910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4bda60a7-fe0f-4f00-9b1f-512ebfdb374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:02.049060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda60a7-fe0f-4f00-9b1f-512ebfdb374c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:02.059936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840d9f1-4b7f-488a-9129-74191e2084e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:02.061434 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840d9f1-4b7f-488a-9129-74191e2084e0 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:02.062107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840d9f1-4b7f-488a-9129-74191e2084e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:02.062828 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840d9f1-4b7f-488a-9129-74191e2084e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:02.075784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840d9f1-4b7f-488a-9129-74191e2084e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:02.077493 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840d9f1-4b7f-488a-9129-74191e2084e0 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:02.089597 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1133/2271] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:18:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:18:04.817655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591ea3c-e04f-411e-a001-8747b24ac2a6 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:04.819108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d591ea3c-e04f-411e-a001-8747b24ac2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:04.876555 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:04.897539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591ea3c-e04f-411e-a001-8747b24ac2a6 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:04.902826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b3a1a-411b-4e17-97c3-d56ba7869717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:04.903712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b3a1a-411b-4e17-97c3-d56ba7869717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:04.903999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b3a1a-411b-4e17-97c3-d56ba7869717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:04.904281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b3a1a-411b-4e17-97c3-d56ba7869717 admin admin] PATH_INFO: `/v3/users/9db2833cf5e34a33a359b7f3640dc8f5` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:04.905687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b3a1a-411b-4e17-97c3-d56ba7869717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db2833cf5e34a33a359b7f3640dc8f5)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:04.908377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b3a1a-411b-4e17-97c3-d56ba7869717 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:04.957770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4a2b3a1a-411b-4e17-97c3-d56ba7869717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db2833cf5e34a33a359b7f3640dc8f5'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:04.971947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4a2b3a1a-411b-4e17-97c3-d56ba7869717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db2833cf5e34a33a359b7f3640dc8f5'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:04.972665 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4a2b3a1a-411b-4e17-97c3-d56ba7869717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db2833cf5e34a33a359b7f3640dc8f5'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:04.973282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4a2b3a1a-411b-4e17-97c3-d56ba7869717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db2833cf5e34a33a359b7f3640dc8f5'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:04.981596 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4a2b3a1a-411b-4e17-97c3-d56ba7869717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db2833cf5e34a33a359b7f3640dc8f5'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:04.995864 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1139/2272] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:18:04 2022] DELETE /identity/v3/users/9db2833cf5e34a33a359b7f3640dc8f5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:18:05.000218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48769eb7-05c0-49ca-80b9-3fc3a000c013 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:05.001402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48769eb7-05c0-49ca-80b9-3fc3a000c013 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:05.001402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48769eb7-05c0-49ca-80b9-3fc3a000c013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:05.018825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-48769eb7-05c0-49ca-80b9-3fc3a000c013 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:05.020045 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-48769eb7-05c0-49ca-80b9-3fc3a000c013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:05.081361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1134/2273] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:05.090847 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b3a1a-411b-4e17-97c3-d56ba7869717 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:05.092263 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4a2b3a1a-411b-4e17-97c3-d56ba7869717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:05.156278 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b3a1a-411b-4e17-97c3-d56ba7869717 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:05.162093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc559b-8490-47b5-b442-5d78ccd79196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:05.162987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc559b-8490-47b5-b442-5d78ccd79196 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:05.163578 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc559b-8490-47b5-b442-5d78ccd79196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:05.163733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc559b-8490-47b5-b442-5d78ccd79196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:05.175791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc559b-8490-47b5-b442-5d78ccd79196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:05.177250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc559b-8490-47b5-b442-5d78ccd79196 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:05.189743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1140/2274] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:18:05.616051 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48769eb7-05c0-49ca-80b9-3fc3a000c013 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:05.617765 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-48769eb7-05c0-49ca-80b9-3fc3a000c013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:05.630411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48769eb7-05c0-49ca-80b9-3fc3a000c013 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:05.635288 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0738a20-6d94-4fca-8e40-af1bf26460f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:05.636167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0738a20-6d94-4fca-8e40-af1bf26460f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:05.636570 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0738a20-6d94-4fca-8e40-af1bf26460f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:05.636872 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0738a20-6d94-4fca-8e40-af1bf26460f0 admin admin] PATH_INFO: `/v3/projects/0dfd692bbc154d7f9c18a3efe8cec0cd` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:05.638246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0738a20-6d94-4fca-8e40-af1bf26460f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dfd692bbc154d7f9c18a3efe8cec0cd)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:05.640175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0738a20-6d94-4fca-8e40-af1bf26460f0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:05.691820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0738a20-6d94-4fca-8e40-af1bf26460f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dfd692bbc154d7f9c18a3efe8cec0cd', 'request_id': 'req-a0738a20-6d94-4fca-8e40-af1bf26460f0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:05.697936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0738a20-6d94-4fca-8e40-af1bf26460f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dfd692bbc154d7f9c18a3efe8cec0cd', 'request_id': 'req-a0738a20-6d94-4fca-8e40-af1bf26460f0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:05.712748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0738a20-6d94-4fca-8e40-af1bf26460f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dfd692bbc154d7f9c18a3efe8cec0cd', 'request_id': 'req-a0738a20-6d94-4fca-8e40-af1bf26460f0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:05.715557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:05.733750 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0738a20-6d94-4fca-8e40-af1bf26460f0 admin admin] The token cache is being invalidate because project 0dfd692bbc154d7f9c18a3efe8cec0cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:18:05.735521 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0738a20-6d94-4fca-8e40-af1bf26460f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:05.736693 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a0738a20-6d94-4fca-8e40-af1bf26460f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:05.738367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1135/2275] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:18:05 2022] DELETE /identity/v3/projects/0dfd692bbc154d7f9c18a3efe8cec0cd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:18:05.743187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca5c81-217f-493a-b843-79f1d4a3b0a0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:05.743502 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca5c81-217f-493a-b843-79f1d4a3b0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:05.743779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca5c81-217f-493a-b843-79f1d4a3b0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:05.761394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-75ca5c81-217f-493a-b843-79f1d4a3b0a0 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:05.763170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-75ca5c81-217f-493a-b843-79f1d4a3b0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:05.831334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1141/2276] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:05.840498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05177dda-fab7-49b8-aa05-28ca601f2ef4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:05.840788 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05177dda-fab7-49b8-aa05-28ca601f2ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:05.841067 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05177dda-fab7-49b8-aa05-28ca601f2ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:05.859982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-05177dda-fab7-49b8-aa05-28ca601f2ef4 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:05.861193 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-05177dda-fab7-49b8-aa05-28ca601f2ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:05.869218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1136/2277] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:05.873521 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca5c81-217f-493a-b843-79f1d4a3b0a0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:05.880100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:05.884213 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca5c81-217f-493a-b843-79f1d4a3b0a0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:05.890670 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77edf1f-fe4a-4e6f-8adb-4dc36b488bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:05.892102 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77edf1f-fe4a-4e6f-8adb-4dc36b488bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:05.892559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77edf1f-fe4a-4e6f-8adb-4dc36b488bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:05.892978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77edf1f-fe4a-4e6f-8adb-4dc36b488bb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:05.893892 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77edf1f-fe4a-4e6f-8adb-4dc36b488bb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:18:05.894221 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77edf1f-fe4a-4e6f-8adb-4dc36b488bb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:05.896069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77edf1f-fe4a-4e6f-8adb-4dc36b488bb0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:05.909036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1142/2278] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:18:05.914043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05177dda-fab7-49b8-aa05-28ca601f2ef4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:05.926252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05177dda-fab7-49b8-aa05-28ca601f2ef4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:05.931869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e3cbe-8a14-41e7-aa12-c0555812a6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:05.932767 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e3cbe-8a14-41e7-aa12-c0555812a6ff admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:05.933366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e3cbe-8a14-41e7-aa12-c0555812a6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:05.933987 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e3cbe-8a14-41e7-aa12-c0555812a6ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:05.934857 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e3cbe-8a14-41e7-aa12-c0555812a6ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:05.936794 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e3cbe-8a14-41e7-aa12-c0555812a6ff admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:05.970123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1137/2279] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:18:05 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:18:05.971280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77edf1f-fe4a-4e6f-8adb-4dc36b488bb0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:05.991798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77edf1f-fe4a-4e6f-8adb-4dc36b488bb0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:06.049044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b2356-294a-43b7-b615-6c5bc4fd5422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:06.049636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b2356-294a-43b7-b615-6c5bc4fd5422 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:06.049922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b2356-294a-43b7-b615-6c5bc4fd5422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:06.050203 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b2356-294a-43b7-b615-6c5bc4fd5422 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:06.050939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b2356-294a-43b7-b615-6c5bc4fd5422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:06.052856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b2356-294a-43b7-b615-6c5bc4fd5422 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:06.072428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1143/2280] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:18:05 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:18:06.076710 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e3cbe-8a14-41e7-aa12-c0555812a6ff admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:06.087648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e3cbe-8a14-41e7-aa12-c0555812a6ff admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:06.092215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d383bd6-8afb-4655-ad33-ff33d73c94eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:06.092877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d383bd6-8afb-4655-ad33-ff33d73c94eb admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:06.093164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d383bd6-8afb-4655-ad33-ff33d73c94eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:06.093444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d383bd6-8afb-4655-ad33-ff33d73c94eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:06.094236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d383bd6-8afb-4655-ad33-ff33d73c94eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:06.096018 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d383bd6-8afb-4655-ad33-ff33d73c94eb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:06.106625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1138/2281] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:18:06.110984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b2356-294a-43b7-b615-6c5bc4fd5422 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:06.123227 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b2356-294a-43b7-b615-6c5bc4fd5422 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:06.129169 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c9adc-0237-435f-9ec0-761b248dfe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:06.129868 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c9adc-0237-435f-9ec0-761b248dfe52 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:06.130153 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c9adc-0237-435f-9ec0-761b248dfe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:06.130460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c9adc-0237-435f-9ec0-761b248dfe52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:06.131201 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c9adc-0237-435f-9ec0-761b248dfe52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:06.132776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c9adc-0237-435f-9ec0-761b248dfe52 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:06.143355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1144/2282] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:18:06.147463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d383bd6-8afb-4655-ad33-ff33d73c94eb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:06.157684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d383bd6-8afb-4655-ad33-ff33d73c94eb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:06.162404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1db267-daa4-4c3a-8dcd-25e21142e01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:06.163322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1db267-daa4-4c3a-8dcd-25e21142e01a admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:06.163608 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1db267-daa4-4c3a-8dcd-25e21142e01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:06.163887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1db267-daa4-4c3a-8dcd-25e21142e01a admin admin] PATH_INFO: `/v3/projects/91fd01e301e848d1a603dcd1a3d843d9/users/17162ca525194443805517a28996dbb2/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:06.179501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1db267-daa4-4c3a-8dcd-25e21142e01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=91fd01e301e848d1a603dcd1a3d843d9, user_id=17162ca525194443805517a28996dbb2, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:06.182153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1db267-daa4-4c3a-8dcd-25e21142e01a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:06.195421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1139/2283] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:18:06 2022] PUT /identity/v3/projects/91fd01e301e848d1a603dcd1a3d843d9/users/17162ca525194443805517a28996dbb2/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:18:06.205711 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155b339-d2aa-4e6e-aa85-7d26ca5e9aa4 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:06.206026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155b339-d2aa-4e6e-aa85-7d26ca5e9aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:06.206334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155b339-d2aa-4e6e-aa85-7d26ca5e9aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:06.233553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1155b339-d2aa-4e6e-aa85-7d26ca5e9aa4 None None] MFA Rules not processed for user `17162ca525194443805517a28996dbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:06.235306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1155b339-d2aa-4e6e-aa85-7d26ca5e9aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:06.299527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1145/2284] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:06.304102 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1db267-daa4-4c3a-8dcd-25e21142e01a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:06.365914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1db267-daa4-4c3a-8dcd-25e21142e01a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:06.380595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d865ea-75bf-41bf-bf06-98036e5a3aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:06.381394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d865ea-75bf-41bf-bf06-98036e5a3aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:06.381767 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d865ea-75bf-41bf-bf06-98036e5a3aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:06.382216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d865ea-75bf-41bf-bf06-98036e5a3aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:06.383212 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d865ea-75bf-41bf-bf06-98036e5a3aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:06.386174 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d865ea-75bf-41bf-bf06-98036e5a3aa0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:06.417565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1140/2285] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:18:06 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:18:06.421846 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155b339-d2aa-4e6e-aa85-7d26ca5e9aa4 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:06.439445 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155b339-d2aa-4e6e-aa85-7d26ca5e9aa4 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:06.514551 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7432f8-459a-4649-be58-1a8f8db2965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:06.515339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7432f8-459a-4649-be58-1a8f8db2965d admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:06.515700 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7432f8-459a-4649-be58-1a8f8db2965d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:06.516735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7432f8-459a-4649-be58-1a8f8db2965d admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:06.517907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7432f8-459a-4649-be58-1a8f8db2965d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:06.520331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7432f8-459a-4649-be58-1a8f8db2965d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:06.529459 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:06.554953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1146/2286] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:18:06 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:18:06.555988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d865ea-75bf-41bf-bf06-98036e5a3aa0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:06.569292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d865ea-75bf-41bf-bf06-98036e5a3aa0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:06.575562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2bf06-3e4d-4dff-b155-434edbdd5fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:06.576322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2bf06-3e4d-4dff-b155-434edbdd5fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:06.576677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2bf06-3e4d-4dff-b155-434edbdd5fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:06.577022 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2bf06-3e4d-4dff-b155-434edbdd5fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:06.577944 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2bf06-3e4d-4dff-b155-434edbdd5fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:06.580655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2bf06-3e4d-4dff-b155-434edbdd5fc7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:06.593436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1141/2287] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:18:06.597848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7432f8-459a-4649-be58-1a8f8db2965d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:06.610703 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7432f8-459a-4649-be58-1a8f8db2965d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:06.616056 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c3a26-aa03-437f-9178-eacf3757a65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:06.616932 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c3a26-aa03-437f-9178-eacf3757a65e admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:06.617224 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c3a26-aa03-437f-9178-eacf3757a65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:06.617509 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c3a26-aa03-437f-9178-eacf3757a65e admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:06.618277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c3a26-aa03-437f-9178-eacf3757a65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:06.620092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c3a26-aa03-437f-9178-eacf3757a65e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:06.635230 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1147/2288] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:18:06.639358 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2bf06-3e4d-4dff-b155-434edbdd5fc7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:06.650890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2bf06-3e4d-4dff-b155-434edbdd5fc7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:06.657906 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec3fdb-a56c-4651-9643-4813a71ea4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:06.658611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec3fdb-a56c-4651-9643-4813a71ea4db admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:06.658899 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec3fdb-a56c-4651-9643-4813a71ea4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:06.659179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec3fdb-a56c-4651-9643-4813a71ea4db admin admin] PATH_INFO: `/v3/projects/931503fed40d44b8b4ff8991f9dd057c/users/20fb94eab0014e7d8181ff5ce6d611cc/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:06.693406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec3fdb-a56c-4651-9643-4813a71ea4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=931503fed40d44b8b4ff8991f9dd057c, user_id=20fb94eab0014e7d8181ff5ce6d611cc, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:06.696977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec3fdb-a56c-4651-9643-4813a71ea4db admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:06.714270 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1142/2289] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:18:06 2022] PUT /identity/v3/projects/931503fed40d44b8b4ff8991f9dd057c/users/20fb94eab0014e7d8181ff5ce6d611cc/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:18:06.725881 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bc93e-2106-445b-85cc-0df41f7e81f4 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:06.726200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bc93e-2106-445b-85cc-0df41f7e81f4 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:06.726527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bc93e-2106-445b-85cc-0df41f7e81f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:06.756903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1b2bc93e-2106-445b-85cc-0df41f7e81f4 None None] MFA Rules not processed for user `20fb94eab0014e7d8181ff5ce6d611cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:06.758255 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1b2bc93e-2106-445b-85cc-0df41f7e81f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:06.827441 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1148/2290] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:06.832359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec3fdb-a56c-4651-9643-4813a71ea4db admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:06.888919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:06.908370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec3fdb-a56c-4651-9643-4813a71ea4db admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:06.913014 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70fd9c-ef6a-442e-b353-9f67dd45bcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:06.913675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70fd9c-ef6a-442e-b353-9f67dd45bcdd admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:06.913961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70fd9c-ef6a-442e-b353-9f67dd45bcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:06.914239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70fd9c-ef6a-442e-b353-9f67dd45bcdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:06.914980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70fd9c-ef6a-442e-b353-9f67dd45bcdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:06.916886 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd70fd9c-ef6a-442e-b353-9f67dd45bcdd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:06.946882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1143/2291] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:18:06 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:18:06.948024 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bc93e-2106-445b-85cc-0df41f7e81f4 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:06.959634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bc93e-2106-445b-85cc-0df41f7e81f4 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:07.016738 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bdbcc-6f7c-47c0-95f5-3733b21d39d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:07.017411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bdbcc-6f7c-47c0-95f5-3733b21d39d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:07.017698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bdbcc-6f7c-47c0-95f5-3733b21d39d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:07.017980 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bdbcc-6f7c-47c0-95f5-3733b21d39d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:07.018718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bdbcc-6f7c-47c0-95f5-3733b21d39d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:07.020659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bdbcc-6f7c-47c0-95f5-3733b21d39d3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:07.044992 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1149/2292] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:18:06 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:18:07.046088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70fd9c-ef6a-442e-b353-9f67dd45bcdd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:07.057257 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70fd9c-ef6a-442e-b353-9f67dd45bcdd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:07.061930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315dede-0b17-46d2-8ab3-0bad85156d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:07.062676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315dede-0b17-46d2-8ab3-0bad85156d15 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:07.063145 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315dede-0b17-46d2-8ab3-0bad85156d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:07.063433 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315dede-0b17-46d2-8ab3-0bad85156d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:07.064181 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315dede-0b17-46d2-8ab3-0bad85156d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:07.065815 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315dede-0b17-46d2-8ab3-0bad85156d15 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:07.077754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1144/2293] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:18:07.082709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bdbcc-6f7c-47c0-95f5-3733b21d39d3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:07.093407 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bdbcc-6f7c-47c0-95f5-3733b21d39d3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:07.099753 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ca1ec-7336-44a7-8cb8-bc09d0af68bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:07.100673 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ca1ec-7336-44a7-8cb8-bc09d0af68bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:07.100962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ca1ec-7336-44a7-8cb8-bc09d0af68bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:07.101247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ca1ec-7336-44a7-8cb8-bc09d0af68bb admin admin] PATH_INFO: `/v3/projects/b5ed0ccc4eeb4e2b83ba0fbd01f5c751/users/d7c9c90c6e2a456390bbde8ba008335b/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:07.121058 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ca1ec-7336-44a7-8cb8-bc09d0af68bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ed0ccc4eeb4e2b83ba0fbd01f5c751, user_id=d7c9c90c6e2a456390bbde8ba008335b, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:07.123913 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ca1ec-7336-44a7-8cb8-bc09d0af68bb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:07.139163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1150/2294] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:18:07 2022] PUT /identity/v3/projects/b5ed0ccc4eeb4e2b83ba0fbd01f5c751/users/d7c9c90c6e2a456390bbde8ba008335b/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:18:07.143707 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315dede-0b17-46d2-8ab3-0bad85156d15 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:07.154092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315dede-0b17-46d2-8ab3-0bad85156d15 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:07.218752 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ee5ee-7cd6-4f57-8e22-714cc2e54218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:07.220701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ee5ee-7cd6-4f57-8e22-714cc2e54218 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:07.220989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ee5ee-7cd6-4f57-8e22-714cc2e54218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:07.221357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ee5ee-7cd6-4f57-8e22-714cc2e54218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:07.222108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ee5ee-7cd6-4f57-8e22-714cc2e54218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:07.223793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ee5ee-7cd6-4f57-8e22-714cc2e54218 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:07.234725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1145/2295] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:18:07.238939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ca1ec-7336-44a7-8cb8-bc09d0af68bb admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:07.249841 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ca1ec-7336-44a7-8cb8-bc09d0af68bb admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:07.255292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f707e3-1e93-44a3-8dda-fcc9a8260eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:07.256197 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f707e3-1e93-44a3-8dda-fcc9a8260eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:07.256488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f707e3-1e93-44a3-8dda-fcc9a8260eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:07.256771 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f707e3-1e93-44a3-8dda-fcc9a8260eb6 admin admin] PATH_INFO: `/v3/projects/b5ed0ccc4eeb4e2b83ba0fbd01f5c751/users/d7c9c90c6e2a456390bbde8ba008335b/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:07.258845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f707e3-1e93-44a3-8dda-fcc9a8260eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ed0ccc4eeb4e2b83ba0fbd01f5c751, user_id=d7c9c90c6e2a456390bbde8ba008335b, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:07.261506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f707e3-1e93-44a3-8dda-fcc9a8260eb6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:07.274876 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1151/2296] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:18:07 2022] PUT /identity/v3/projects/b5ed0ccc4eeb4e2b83ba0fbd01f5c751/users/d7c9c90c6e2a456390bbde8ba008335b/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:18:07.287603 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a03c14-2210-4ea1-8662-4d2e799efe7b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:07.287990 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a03c14-2210-4ea1-8662-4d2e799efe7b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:07.288343 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a03c14-2210-4ea1-8662-4d2e799efe7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:07.315906 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a8a03c14-2210-4ea1-8662-4d2e799efe7b None None] MFA Rules not processed for user `d7c9c90c6e2a456390bbde8ba008335b`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:07.317145 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a8a03c14-2210-4ea1-8662-4d2e799efe7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:07.388461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1146/2297] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:07.404020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f707e3-1e93-44a3-8dda-fcc9a8260eb6 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:07.405732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-22f707e3-1e93-44a3-8dda-fcc9a8260eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:07.430850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:07.471432 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f707e3-1e93-44a3-8dda-fcc9a8260eb6 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:07.475242 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d53dc-2ee7-4faf-9710-58d0621ac83e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:07.475900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d53dc-2ee7-4faf-9710-58d0621ac83e service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:07.476193 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d53dc-2ee7-4faf-9710-58d0621ac83e service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:07.476479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d53dc-2ee7-4faf-9710-58d0621ac83e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:07.538114 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d53dc-2ee7-4faf-9710-58d0621ac83e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:07.539657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d53dc-2ee7-4faf-9710-58d0621ac83e service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:07.549564 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1152/2298] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:18:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:18:09.115228 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a03c14-2210-4ea1-8662-4d2e799efe7b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:09.129541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a03c14-2210-4ea1-8662-4d2e799efe7b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:09.133848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d360c5-5f45-4aed-b585-c8dbe98553ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:09.134678 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d360c5-5f45-4aed-b585-c8dbe98553ff service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:09.135001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d360c5-5f45-4aed-b585-c8dbe98553ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:09.135375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d360c5-5f45-4aed-b585-c8dbe98553ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:09.181706 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:09.214381 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d360c5-5f45-4aed-b585-c8dbe98553ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:09.216012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d360c5-5f45-4aed-b585-c8dbe98553ff service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:09.226852 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1147/2299] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:18:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:18:09.786294 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d53dc-2ee7-4faf-9710-58d0621ac83e service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:09.794834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d53dc-2ee7-4faf-9710-58d0621ac83e service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:09.799730 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbd307-3253-4f51-8e4c-18afb14f3fce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:09.800409 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbd307-3253-4f51-8e4c-18afb14f3fce service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:09.800699 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbd307-3253-4f51-8e4c-18afb14f3fce service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:09.800988 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbd307-3253-4f51-8e4c-18afb14f3fce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:09.811998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbd307-3253-4f51-8e4c-18afb14f3fce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:09.814659 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbd307-3253-4f51-8e4c-18afb14f3fce service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:09.824754 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1153/2300] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:18:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:18:13.746336 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d360c5-5f45-4aed-b585-c8dbe98553ff service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:13.813232 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d360c5-5f45-4aed-b585-c8dbe98553ff service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:13.817882 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fe228-8490-47e9-90ee-20dd3192043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:13.818792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fe228-8490-47e9-90ee-20dd3192043b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:13.819081 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fe228-8490-47e9-90ee-20dd3192043b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:13.819350 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fe228-8490-47e9-90ee-20dd3192043b admin admin] PATH_INFO: `/v3/users/17162ca525194443805517a28996dbb2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:13.820542 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fe228-8490-47e9-90ee-20dd3192043b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17162ca525194443805517a28996dbb2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:13.822470 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fe228-8490-47e9-90ee-20dd3192043b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:13.872353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b0fe228-8490-47e9-90ee-20dd3192043b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17162ca525194443805517a28996dbb2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:13.872997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b0fe228-8490-47e9-90ee-20dd3192043b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17162ca525194443805517a28996dbb2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:13.885937 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b0fe228-8490-47e9-90ee-20dd3192043b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17162ca525194443805517a28996dbb2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:13.886628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b0fe228-8490-47e9-90ee-20dd3192043b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17162ca525194443805517a28996dbb2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:13.893842 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0b0fe228-8490-47e9-90ee-20dd3192043b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17162ca525194443805517a28996dbb2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:13.907233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1148/2301] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:18:13 2022] DELETE /identity/v3/users/17162ca525194443805517a28996dbb2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:18:13.911853 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622610a-7463-4588-ab87-8644df4caff4 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:13.912330 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622610a-7463-4588-ab87-8644df4caff4 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:13.912448 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622610a-7463-4588-ab87-8644df4caff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:13.931028 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f622610a-7463-4588-ab87-8644df4caff4 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:13.932255 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f622610a-7463-4588-ab87-8644df4caff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:13.992745 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1154/2302] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:14.003340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fe228-8490-47e9-90ee-20dd3192043b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:14.004786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0b0fe228-8490-47e9-90ee-20dd3192043b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:14.062631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fe228-8490-47e9-90ee-20dd3192043b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:14.066292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d8013-54f8-4fb3-bd41-de236c553c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:14.066978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d8013-54f8-4fb3-bd41-de236c553c25 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:14.067265 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d8013-54f8-4fb3-bd41-de236c553c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:14.067541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d8013-54f8-4fb3-bd41-de236c553c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:14.076725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d8013-54f8-4fb3-bd41-de236c553c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:14.078200 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d8013-54f8-4fb3-bd41-de236c553c25 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:14.082215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:14.089489 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1149/2303] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:18:14.322897 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceafeec-1514-4b46-96c9-efea8898afbe None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:14.323274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceafeec-1514-4b46-96c9-efea8898afbe None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:14.323631 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceafeec-1514-4b46-96c9-efea8898afbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:14.347614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-cceafeec-1514-4b46-96c9-efea8898afbe None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:14.349604 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cceafeec-1514-4b46-96c9-efea8898afbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:14.421620 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1155/2304] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 16 16:18:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:14.476496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d8013-54f8-4fb3-bd41-de236c553c25 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:14.477955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b07d8013-54f8-4fb3-bd41-de236c553c25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:14.522448 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceafeec-1514-4b46-96c9-efea8898afbe None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:14.524027 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cceafeec-1514-4b46-96c9-efea8898afbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:14.542469 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceafeec-1514-4b46-96c9-efea8898afbe None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:14.549372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ba0d3-d1f7-4dea-ac49-0c51090e7191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:14.550544 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ba0d3-d1f7-4dea-ac49-0c51090e7191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:14.550838 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ba0d3-d1f7-4dea-ac49-0c51090e7191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:14.551136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ba0d3-d1f7-4dea-ac49-0c51090e7191 admin admin] PATH_INFO: `/v3/projects/91fd01e301e848d1a603dcd1a3d843d9` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:14.552597 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ba0d3-d1f7-4dea-ac49-0c51090e7191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91fd01e301e848d1a603dcd1a3d843d9)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:14.555946 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ba0d3-d1f7-4dea-ac49-0c51090e7191 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:14.557761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:14.568660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d8013-54f8-4fb3-bd41-de236c553c25 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:14.575257 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fb6f8-67bf-4e68-9811-1f710d205f67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:14.575984 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fb6f8-67bf-4e68-9811-1f710d205f67 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:14.576341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fb6f8-67bf-4e68-9811-1f710d205f67 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:14.576693 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fb6f8-67bf-4e68-9811-1f710d205f67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:14.586250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fb6f8-67bf-4e68-9811-1f710d205f67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:14.588148 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fb6f8-67bf-4e68-9811-1f710d205f67 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:14.597359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1150/2305] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:18:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 16:18:14.608506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-483ba0d3-d1f7-4dea-ac49-0c51090e7191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91fd01e301e848d1a603dcd1a3d843d9', 'request_id': 'req-483ba0d3-d1f7-4dea-ac49-0c51090e7191'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:14.616539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-483ba0d3-d1f7-4dea-ac49-0c51090e7191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91fd01e301e848d1a603dcd1a3d843d9', 'request_id': 'req-483ba0d3-d1f7-4dea-ac49-0c51090e7191'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:14.627616 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-483ba0d3-d1f7-4dea-ac49-0c51090e7191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91fd01e301e848d1a603dcd1a3d843d9', 'request_id': 'req-483ba0d3-d1f7-4dea-ac49-0c51090e7191'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:14.642235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-483ba0d3-d1f7-4dea-ac49-0c51090e7191 admin admin] The token cache is being invalidate because project 91fd01e301e848d1a603dcd1a3d843d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:18:14.642857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-483ba0d3-d1f7-4dea-ac49-0c51090e7191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:14.643709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-483ba0d3-d1f7-4dea-ac49-0c51090e7191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:14.645987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1156/2306] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:18:14 2022] DELETE /identity/v3/projects/91fd01e301e848d1a603dcd1a3d843d9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:18:14.650009 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fb6f8-67bf-4e68-9811-1f710d205f67 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:14.661997 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fb6f8-67bf-4e68-9811-1f710d205f67 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:14.722264 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302207d-1f8d-4162-84d8-5a2b2f61445e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:14.723245 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302207d-1f8d-4162-84d8-5a2b2f61445e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:14.723639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302207d-1f8d-4162-84d8-5a2b2f61445e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:14.724092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302207d-1f8d-4162-84d8-5a2b2f61445e admin admin] PATH_INFO: `/v3/users/20fb94eab0014e7d8181ff5ce6d611cc` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:14.725710 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302207d-1f8d-4162-84d8-5a2b2f61445e admin admin] RBAC: Authorizing `identity:delete_user(user_id=20fb94eab0014e7d8181ff5ce6d611cc)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:14.728220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302207d-1f8d-4162-84d8-5a2b2f61445e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:14.780634 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d302207d-1f8d-4162-84d8-5a2b2f61445e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20fb94eab0014e7d8181ff5ce6d611cc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:14.782408 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d302207d-1f8d-4162-84d8-5a2b2f61445e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20fb94eab0014e7d8181ff5ce6d611cc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:14.795155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d302207d-1f8d-4162-84d8-5a2b2f61445e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20fb94eab0014e7d8181ff5ce6d611cc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:14.795902 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d302207d-1f8d-4162-84d8-5a2b2f61445e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20fb94eab0014e7d8181ff5ce6d611cc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:14.803620 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d302207d-1f8d-4162-84d8-5a2b2f61445e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20fb94eab0014e7d8181ff5ce6d611cc'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:14.819365 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1151/2307] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:18:14 2022] DELETE /identity/v3/users/20fb94eab0014e7d8181ff5ce6d611cc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:18:15.176398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ba0d3-d1f7-4dea-ac49-0c51090e7191 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:15.177967 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-483ba0d3-d1f7-4dea-ac49-0c51090e7191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:15.193378 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ba0d3-d1f7-4dea-ac49-0c51090e7191 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:15.214203 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9db9a-1d32-425f-8e04-dd84caf752bc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:15.214528 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9db9a-1d32-425f-8e04-dd84caf752bc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:15.214815 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9db9a-1d32-425f-8e04-dd84caf752bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:15.226876 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:15.235588 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b8b9db9a-1d32-425f-8e04-dd84caf752bc None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:15.237542 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b8b9db9a-1d32-425f-8e04-dd84caf752bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:15.263196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1a167-4993-4f59-b9bb-2c5b9b545b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:15.264174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1a167-4993-4f59-b9bb-2c5b9b545b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:15.264465 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1a167-4993-4f59-b9bb-2c5b9b545b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:15.264743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1a167-4993-4f59-b9bb-2c5b9b545b23 admin admin] PATH_INFO: `/v3/projects/931503fed40d44b8b4ff8991f9dd057c` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:15.266004 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1a167-4993-4f59-b9bb-2c5b9b545b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=931503fed40d44b8b4ff8991f9dd057c)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:15.267933 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1a167-4993-4f59-b9bb-2c5b9b545b23 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:15.300850 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1152/2308] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jun 16 16:18:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:18:15.315141 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9db9a-1d32-425f-8e04-dd84caf752bc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:15.316604 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b8b9db9a-1d32-425f-8e04-dd84caf752bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:15.321500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-79a1a167-4993-4f59-b9bb-2c5b9b545b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '931503fed40d44b8b4ff8991f9dd057c', 'request_id': 'req-79a1a167-4993-4f59-b9bb-2c5b9b545b23'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:15.328918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-79a1a167-4993-4f59-b9bb-2c5b9b545b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '931503fed40d44b8b4ff8991f9dd057c', 'request_id': 'req-79a1a167-4993-4f59-b9bb-2c5b9b545b23'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:15.337866 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-79a1a167-4993-4f59-b9bb-2c5b9b545b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '931503fed40d44b8b4ff8991f9dd057c', 'request_id': 'req-79a1a167-4993-4f59-b9bb-2c5b9b545b23'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:15.350861 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-79a1a167-4993-4f59-b9bb-2c5b9b545b23 admin admin] The token cache is being invalidate because project 931503fed40d44b8b4ff8991f9dd057c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:18:15.351146 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-79a1a167-4993-4f59-b9bb-2c5b9b545b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:15.351805 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-79a1a167-4993-4f59-b9bb-2c5b9b545b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:15.353351 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1157/2309] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:18:15 2022] DELETE /identity/v3/projects/931503fed40d44b8b4ff8991f9dd057c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:18:15.358532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1a167-4993-4f59-b9bb-2c5b9b545b23 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:15.360795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-79a1a167-4993-4f59-b9bb-2c5b9b545b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:15.389997 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:15.408095 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9db9a-1d32-425f-8e04-dd84caf752bc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:15.444869 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1a167-4993-4f59-b9bb-2c5b9b545b23 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:15.450021 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e881f8f-c47a-46ec-ba7f-c1b4b58b4fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:15.451225 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e881f8f-c47a-46ec-ba7f-c1b4b58b4fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:15.451615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e881f8f-c47a-46ec-ba7f-c1b4b58b4fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:15.451997 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e881f8f-c47a-46ec-ba7f-c1b4b58b4fe2 admin admin] PATH_INFO: `/v3/users/d7c9c90c6e2a456390bbde8ba008335b` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:15.454099 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e881f8f-c47a-46ec-ba7f-c1b4b58b4fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c9c90c6e2a456390bbde8ba008335b)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:15.456127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e881f8f-c47a-46ec-ba7f-c1b4b58b4fe2 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:15.484125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7d59a-4a04-4209-b6ec-c8b4e5ab216e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:15.485247 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7d59a-4a04-4209-b6ec-c8b4e5ab216e service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:15.485630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7d59a-4a04-4209-b6ec-c8b4e5ab216e service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:15.486005 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7d59a-4a04-4209-b6ec-c8b4e5ab216e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:15.488051 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4cc7d59a-4a04-4209-b6ec-c8b4e5ab216e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:15.541402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8e881f8f-c47a-46ec-ba7f-c1b4b58b4fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c9c90c6e2a456390bbde8ba008335b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:15.564750 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8e881f8f-c47a-46ec-ba7f-c1b4b58b4fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c9c90c6e2a456390bbde8ba008335b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:15.566666 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8e881f8f-c47a-46ec-ba7f-c1b4b58b4fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c9c90c6e2a456390bbde8ba008335b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:15.567952 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8e881f8f-c47a-46ec-ba7f-c1b4b58b4fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c9c90c6e2a456390bbde8ba008335b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:15.576943 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-8e881f8f-c47a-46ec-ba7f-c1b4b58b4fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c9c90c6e2a456390bbde8ba008335b'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:15.589938 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:15.592711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7d59a-4a04-4209-b6ec-c8b4e5ab216e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:15.594609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7d59a-4a04-4209-b6ec-c8b4e5ab216e service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:15.601742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1158/2310] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:18:15 2022] DELETE /identity/v3/users/d7c9c90c6e2a456390bbde8ba008335b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:18:15.607495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1153/2311] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:18:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 16:18:15.864223 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf2bb2-5143-4b93-9b14-ca8e389a29cf None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:15.864934 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf2bb2-5143-4b93-9b14-ca8e389a29cf None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:15.866129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf2bb2-5143-4b93-9b14-ca8e389a29cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:15.888665 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f4cf2bb2-5143-4b93-9b14-ca8e389a29cf None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:15.889879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f4cf2bb2-5143-4b93-9b14-ca8e389a29cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:15.950558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1159/2312] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 16 16:18:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:15.963625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7d59a-4a04-4209-b6ec-c8b4e5ab216e service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:15.966801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4cc7d59a-4a04-4209-b6ec-c8b4e5ab216e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:15.996374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7d59a-4a04-4209-b6ec-c8b4e5ab216e service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:16.072175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32c2de-a998-4c4b-a754-4227d3e0dfe0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:16.072844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32c2de-a998-4c4b-a754-4227d3e0dfe0 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:16.073129 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32c2de-a998-4c4b-a754-4227d3e0dfe0 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:16.073408 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32c2de-a998-4c4b-a754-4227d3e0dfe0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:16.083505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32c2de-a998-4c4b-a754-4227d3e0dfe0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:16.085116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32c2de-a998-4c4b-a754-4227d3e0dfe0 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:16.096946 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1154/2313] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:18:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 16:18:16.145002 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf2bb2-5143-4b93-9b14-ca8e389a29cf None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:16.146844 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f4cf2bb2-5143-4b93-9b14-ca8e389a29cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:16.235658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:16.267651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf2bb2-5143-4b93-9b14-ca8e389a29cf None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:16.274250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7466b9-f8a2-4451-8704-827cf99f80ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:16.275162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7466b9-f8a2-4451-8704-827cf99f80ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:16.275445 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7466b9-f8a2-4451-8704-827cf99f80ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:16.275722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7466b9-f8a2-4451-8704-827cf99f80ec admin admin] PATH_INFO: `/v3/projects/b5ed0ccc4eeb4e2b83ba0fbd01f5c751` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:16.276911 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7466b9-f8a2-4451-8704-827cf99f80ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ed0ccc4eeb4e2b83ba0fbd01f5c751)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:16.278875 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7466b9-f8a2-4451-8704-827cf99f80ec admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:16.338464 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-af7466b9-f8a2-4451-8704-827cf99f80ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ed0ccc4eeb4e2b83ba0fbd01f5c751', 'request_id': 'req-af7466b9-f8a2-4451-8704-827cf99f80ec'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:16.345134 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-af7466b9-f8a2-4451-8704-827cf99f80ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ed0ccc4eeb4e2b83ba0fbd01f5c751', 'request_id': 'req-af7466b9-f8a2-4451-8704-827cf99f80ec'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:16.357904 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-af7466b9-f8a2-4451-8704-827cf99f80ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ed0ccc4eeb4e2b83ba0fbd01f5c751', 'request_id': 'req-af7466b9-f8a2-4451-8704-827cf99f80ec'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:16.370458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-af7466b9-f8a2-4451-8704-827cf99f80ec admin admin] The token cache is being invalidate because project b5ed0ccc4eeb4e2b83ba0fbd01f5c751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:18:16.370744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-af7466b9-f8a2-4451-8704-827cf99f80ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:16.371374 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-af7466b9-f8a2-4451-8704-827cf99f80ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:16.373147 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1160/2314] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:18:16 2022] DELETE /identity/v3/projects/b5ed0ccc4eeb4e2b83ba0fbd01f5c751 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:18:16.514711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07897e57-a2cd-4278-9123-b3a4331ec8db None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:16.515081 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07897e57-a2cd-4278-9123-b3a4331ec8db None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:16.515454 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07897e57-a2cd-4278-9123-b3a4331ec8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:16.536183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-07897e57-a2cd-4278-9123-b3a4331ec8db None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:16.537556 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-07897e57-a2cd-4278-9123-b3a4331ec8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:16.602756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1155/2315] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jun 16 16:18:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:16.616687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7466b9-f8a2-4451-8704-827cf99f80ec admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:16.618101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-af7466b9-f8a2-4451-8704-827cf99f80ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:16.692545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7466b9-f8a2-4451-8704-827cf99f80ec admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:16.697704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a4320-551c-4216-b800-4cd7876ec5ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:16.698364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a4320-551c-4216-b800-4cd7876ec5ca service swift] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:16.698689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a4320-551c-4216-b800-4cd7876ec5ca service swift] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:16.698971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a4320-551c-4216-b800-4cd7876ec5ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:16.708630 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a4320-551c-4216-b800-4cd7876ec5ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:16.710223 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a4320-551c-4216-b800-4cd7876ec5ca service swift] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:16.718508 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1161/2316] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:18:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 16:18:18.444674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b7656-3533-4316-b04e-a8cd7413c57b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:18.445222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b7656-3533-4316-b04e-a8cd7413c57b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:18.445222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b7656-3533-4316-b04e-a8cd7413c57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:18.464389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f45b7656-3533-4316-b04e-a8cd7413c57b None None] MFA Rules not processed for user `abac759980bd4a679dbd702a3fee5eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:18.465693 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f45b7656-3533-4316-b04e-a8cd7413c57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:18.521185 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1156/2317] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:18.913899 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a4320-551c-4216-b800-4cd7876ec5ca service swift] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:18.915962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-872a4320-551c-4216-b800-4cd7876ec5ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:19.016374 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a4320-551c-4216-b800-4cd7876ec5ca service swift] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:19.022908 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cb40d-1374-4b3a-90fb-bca4dbe8f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:19.023920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cb40d-1374-4b3a-90fb-bca4dbe8f93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:19.024292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cb40d-1374-4b3a-90fb-bca4dbe8f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:19.024664 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cb40d-1374-4b3a-90fb-bca4dbe8f93b admin admin] PATH_INFO: `/v3/users/3104db56d1524068a195fc94cc21ab2a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:19.025953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cb40d-1374-4b3a-90fb-bca4dbe8f93b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3104db56d1524068a195fc94cc21ab2a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:19.028012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cb40d-1374-4b3a-90fb-bca4dbe8f93b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:19.036065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:19.111560 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-df3cb40d-1374-4b3a-90fb-bca4dbe8f93b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3104db56d1524068a195fc94cc21ab2a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:19.128679 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-df3cb40d-1374-4b3a-90fb-bca4dbe8f93b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3104db56d1524068a195fc94cc21ab2a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:19.129416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-df3cb40d-1374-4b3a-90fb-bca4dbe8f93b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3104db56d1524068a195fc94cc21ab2a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:19.130012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-df3cb40d-1374-4b3a-90fb-bca4dbe8f93b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3104db56d1524068a195fc94cc21ab2a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:19.138923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-df3cb40d-1374-4b3a-90fb-bca4dbe8f93b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3104db56d1524068a195fc94cc21ab2a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:19.167881 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1162/2318] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:18:18 2022] DELETE /identity/v3/users/3104db56d1524068a195fc94cc21ab2a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:18:19.173511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a999e10-03a5-4c9b-868d-6976417658e7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:19.173798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a999e10-03a5-4c9b-868d-6976417658e7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:19.174109 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a999e10-03a5-4c9b-868d-6976417658e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:19.193328 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8a999e10-03a5-4c9b-868d-6976417658e7 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:19.194739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8a999e10-03a5-4c9b-868d-6976417658e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:19.255610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:19.295932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1157/2319] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:18:19.308363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cb40d-1374-4b3a-90fb-bca4dbe8f93b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:19.309845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-df3cb40d-1374-4b3a-90fb-bca4dbe8f93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:19.394731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cb40d-1374-4b3a-90fb-bca4dbe8f93b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:19.399515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee264c1-f829-4b3a-b17f-dcfeb6a5955f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:19.400193 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee264c1-f829-4b3a-b17f-dcfeb6a5955f service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:19.400477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee264c1-f829-4b3a-b17f-dcfeb6a5955f service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:19.400753 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee264c1-f829-4b3a-b17f-dcfeb6a5955f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:19.413674 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee264c1-f829-4b3a-b17f-dcfeb6a5955f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:19.415164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee264c1-f829-4b3a-b17f-dcfeb6a5955f service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:19.433946 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1163/2320] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:18:19.913874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a999e10-03a5-4c9b-868d-6976417658e7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:19.915461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8a999e10-03a5-4c9b-868d-6976417658e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:19.928801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a999e10-03a5-4c9b-868d-6976417658e7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:19.933502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8cbba-b443-4f87-b286-bf39e8345ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:19.934640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8cbba-b443-4f87-b286-bf39e8345ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:19.935097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8cbba-b443-4f87-b286-bf39e8345ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:19.935567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8cbba-b443-4f87-b286-bf39e8345ebe admin admin] PATH_INFO: `/v3/projects/82fdf4d41c094ec1a21d33ef1f782862` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:19.938257 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8cbba-b443-4f87-b286-bf39e8345ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=82fdf4d41c094ec1a21d33ef1f782862)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:19.941052 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8cbba-b443-4f87-b286-bf39e8345ebe admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:19.998099 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f0e8cbba-b443-4f87-b286-bf39e8345ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82fdf4d41c094ec1a21d33ef1f782862', 'request_id': 'req-f0e8cbba-b443-4f87-b286-bf39e8345ebe'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:20.004964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f0e8cbba-b443-4f87-b286-bf39e8345ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82fdf4d41c094ec1a21d33ef1f782862', 'request_id': 'req-f0e8cbba-b443-4f87-b286-bf39e8345ebe'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:20.013436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f0e8cbba-b443-4f87-b286-bf39e8345ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82fdf4d41c094ec1a21d33ef1f782862', 'request_id': 'req-f0e8cbba-b443-4f87-b286-bf39e8345ebe'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:20.026509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f0e8cbba-b443-4f87-b286-bf39e8345ebe admin admin] The token cache is being invalidate because project 82fdf4d41c094ec1a21d33ef1f782862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:18:20.026877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f0e8cbba-b443-4f87-b286-bf39e8345ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:20.027564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-f0e8cbba-b443-4f87-b286-bf39e8345ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:18:20.029120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1158/2321] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:18:19 2022] DELETE /identity/v3/projects/82fdf4d41c094ec1a21d33ef1f782862 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:18:20.036088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627f02e-7224-4240-9f01-09eacc6543f6 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:20.036579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627f02e-7224-4240-9f01-09eacc6543f6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:20.036886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627f02e-7224-4240-9f01-09eacc6543f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:20.057063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f627f02e-7224-4240-9f01-09eacc6543f6 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:20.058267 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f627f02e-7224-4240-9f01-09eacc6543f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:20.119373 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1164/2322] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:20.127827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a25ab-2da7-4081-8908-e20e2faac8e9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:20.128127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a25ab-2da7-4081-8908-e20e2faac8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:20.128408 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a25ab-2da7-4081-8908-e20e2faac8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:20.148164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a23a25ab-2da7-4081-8908-e20e2faac8e9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:20.149557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a23a25ab-2da7-4081-8908-e20e2faac8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:20.159078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1159/2323] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:20.163462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627f02e-7224-4240-9f01-09eacc6543f6 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:20.173601 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627f02e-7224-4240-9f01-09eacc6543f6 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:20.178250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f0cfe-6edf-49f7-89d1-c00055108f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:20.178953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f0cfe-6edf-49f7-89d1-c00055108f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:20.179239 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f0cfe-6edf-49f7-89d1-c00055108f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:20.179517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f0cfe-6edf-49f7-89d1-c00055108f9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:20.180887 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f0cfe-6edf-49f7-89d1-c00055108f9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:18:20.181206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f0cfe-6edf-49f7-89d1-c00055108f9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:20.182839 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f0cfe-6edf-49f7-89d1-c00055108f9b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:20.195741 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1165/2324] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:18:20.200056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a25ab-2da7-4081-8908-e20e2faac8e9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:20.210864 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a25ab-2da7-4081-8908-e20e2faac8e9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:20.215700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca4222-9c4a-48cb-998f-98091584a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:20.216394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca4222-9c4a-48cb-998f-98091584a4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:20.216630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca4222-9c4a-48cb-998f-98091584a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:20.216961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca4222-9c4a-48cb-998f-98091584a4a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:20.217663 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca4222-9c4a-48cb-998f-98091584a4a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:20.219823 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca4222-9c4a-48cb-998f-98091584a4a6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:20.246614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1160/2325] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:18:20 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:18:20.252152 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f0cfe-6edf-49f7-89d1-c00055108f9b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:20.269182 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f0cfe-6edf-49f7-89d1-c00055108f9b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:20.280167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:20.334383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df1099-9098-46c2-a1b7-1f6da227be88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:20.335357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df1099-9098-46c2-a1b7-1f6da227be88 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:20.335645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df1099-9098-46c2-a1b7-1f6da227be88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:20.336055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df1099-9098-46c2-a1b7-1f6da227be88 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:20.336759 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df1099-9098-46c2-a1b7-1f6da227be88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:20.338768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df1099-9098-46c2-a1b7-1f6da227be88 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:20.368879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1166/2326] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:18:20 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:18:20.370321 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca4222-9c4a-48cb-998f-98091584a4a6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:20.386959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca4222-9c4a-48cb-998f-98091584a4a6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:20.394979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d2a5a-f3aa-4ddf-b4e6-2a5a6d5f2037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:20.395851 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d2a5a-f3aa-4ddf-b4e6-2a5a6d5f2037 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:20.396239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d2a5a-f3aa-4ddf-b4e6-2a5a6d5f2037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:20.396611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d2a5a-f3aa-4ddf-b4e6-2a5a6d5f2037 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:20.397448 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d2a5a-f3aa-4ddf-b4e6-2a5a6d5f2037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:20.399223 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d2a5a-f3aa-4ddf-b4e6-2a5a6d5f2037 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:20.410613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1161/2327] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:18:20.415024 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df1099-9098-46c2-a1b7-1f6da227be88 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:20.428236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df1099-9098-46c2-a1b7-1f6da227be88 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:20.435167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e22349-34d9-47a6-acef-c991b4d42b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:20.435947 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22349-34d9-47a6-acef-c991b4d42b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:20.436309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22349-34d9-47a6-acef-c991b4d42b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:20.436660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22349-34d9-47a6-acef-c991b4d42b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:20.438293 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e22349-34d9-47a6-acef-c991b4d42b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:20.440061 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e22349-34d9-47a6-acef-c991b4d42b6c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:20.453265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1167/2328] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:18:20.458079 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d2a5a-f3aa-4ddf-b4e6-2a5a6d5f2037 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:20.469323 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d2a5a-f3aa-4ddf-b4e6-2a5a6d5f2037 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:20.474199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dbb2d-b002-4389-9e34-d551677c8952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:20.475300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dbb2d-b002-4389-9e34-d551677c8952 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:20.475699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dbb2d-b002-4389-9e34-d551677c8952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:20.476080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dbb2d-b002-4389-9e34-d551677c8952 admin admin] PATH_INFO: `/v3/projects/8f0235c7503a418e9de6de4b6c8c1b4e/users/ee17f83f16214a2db17b37e2a3a37934/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:20.492567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dbb2d-b002-4389-9e34-d551677c8952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0235c7503a418e9de6de4b6c8c1b4e, user_id=ee17f83f16214a2db17b37e2a3a37934, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:20.495385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dbb2d-b002-4389-9e34-d551677c8952 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:20.514199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1162/2329] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:18:20 2022] PUT /identity/v3/projects/8f0235c7503a418e9de6de4b6c8c1b4e/users/ee17f83f16214a2db17b37e2a3a37934/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:18:20.519526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b023bc-a169-48c1-a88d-6e93031db7f5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:20.519895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b023bc-a169-48c1-a88d-6e93031db7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:20.520246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b023bc-a169-48c1-a88d-6e93031db7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:20.541035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-01b023bc-a169-48c1-a88d-6e93031db7f5 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:20.542518 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-01b023bc-a169-48c1-a88d-6e93031db7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:20.618517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1168/2330] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:20.631756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dbb2d-b002-4389-9e34-d551677c8952 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:20.633640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ef2dbb2d-b002-4389-9e34-d551677c8952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:20.698739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dbb2d-b002-4389-9e34-d551677c8952 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:20.704156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbe8a0-ca93-4856-bf14-4d24120e98b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:20.704820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbe8a0-ca93-4856-bf14-4d24120e98b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:20.705504 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbe8a0-ca93-4856-bf14-4d24120e98b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:20.705789 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbe8a0-ca93-4856-bf14-4d24120e98b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:20.715685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbe8a0-ca93-4856-bf14-4d24120e98b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:20.717131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbe8a0-ca93-4856-bf14-4d24120e98b1 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:20.722121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:20.731603 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1163/2331] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:18:21.593767 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7914a2-bf18-4100-a91f-083522c8b626 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:21.594921 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7914a2-bf18-4100-a91f-083522c8b626 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:21.595222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7914a2-bf18-4100-a91f-083522c8b626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:21.625967 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ff7914a2-bf18-4100-a91f-083522c8b626 None None] MFA Rules not processed for user `ee17f83f16214a2db17b37e2a3a37934`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:21.627752 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ff7914a2-bf18-4100-a91f-083522c8b626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:21.705292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1169/2332] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:21.717444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbe8a0-ca93-4856-bf14-4d24120e98b1 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:21.719573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b1cbe8a0-ca93-4856-bf14-4d24120e98b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:21.783017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbe8a0-ca93-4856-bf14-4d24120e98b1 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:21.786639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cc4c0-be30-4b44-82b1-a0da01d84a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:21.787291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cc4c0-be30-4b44-82b1-a0da01d84a50 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:21.787579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cc4c0-be30-4b44-82b1-a0da01d84a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:21.787858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cc4c0-be30-4b44-82b1-a0da01d84a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:21.798402 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cc4c0-be30-4b44-82b1-a0da01d84a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:21.799763 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cc4c0-be30-4b44-82b1-a0da01d84a50 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:21.808749 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1164/2333] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:18:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:18:23.160745 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5b5ff-6f6c-490c-ad2f-a3be71775316 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:23.161288 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5b5ff-6f6c-490c-ad2f-a3be71775316 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:23.161288 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5b5ff-6f6c-490c-ad2f-a3be71775316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:23.179294 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-cfe5b5ff-6f6c-490c-ad2f-a3be71775316 None None] MFA Rules not processed for user `ee17f83f16214a2db17b37e2a3a37934`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:23.180516 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cfe5b5ff-6f6c-490c-ad2f-a3be71775316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:23.188656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1170/2334] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:26.708863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94326f9b-9447-4b8f-ae9e-30d64230bd5f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:26.709454 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94326f9b-9447-4b8f-ae9e-30d64230bd5f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:26.709454 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94326f9b-9447-4b8f-ae9e-30d64230bd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:26.728640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-94326f9b-9447-4b8f-ae9e-30d64230bd5f None None] MFA Rules not processed for user `c5d0829ddcfe4116a0d180ff6d89bd20`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:26.729793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-94326f9b-9447-4b8f-ae9e-30d64230bd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:26.793782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1165/2335] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:18:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:33.173952 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:35.863628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77985f-0274-4cdf-866f-9bb9f275db1a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:35.864265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77985f-0274-4cdf-866f-9bb9f275db1a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:35.864265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77985f-0274-4cdf-866f-9bb9f275db1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:35.891566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1b77985f-0274-4cdf-866f-9bb9f275db1a None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:35.892824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1b77985f-0274-4cdf-866f-9bb9f275db1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:35.962948 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1171/2336] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 16 16:18:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:35.985887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94326f9b-9447-4b8f-ae9e-30d64230bd5f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:35.987911 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-94326f9b-9447-4b8f-ae9e-30d64230bd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:36.127588 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94326f9b-9447-4b8f-ae9e-30d64230bd5f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:36.132706 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17472586-62b4-4c17-8805-fb97d2eb7022 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:36.133480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17472586-62b4-4c17-8805-fb97d2eb7022 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:36.134559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17472586-62b4-4c17-8805-fb97d2eb7022 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:36.134559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17472586-62b4-4c17-8805-fb97d2eb7022 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:36.144287 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17472586-62b4-4c17-8805-fb97d2eb7022 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:36.148309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17472586-62b4-4c17-8805-fb97d2eb7022 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:36.160085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1166/2337] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:18:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 16:18:41.793121 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09689c74-f44f-49af-b45d-69cf3ab43312 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:41.793762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09689c74-f44f-49af-b45d-69cf3ab43312 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:41.793762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09689c74-f44f-49af-b45d-69cf3ab43312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:41.828538 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-09689c74-f44f-49af-b45d-69cf3ab43312 None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:41.830106 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-09689c74-f44f-49af-b45d-69cf3ab43312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:41.849862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1172/2338] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 16 16:18:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:18:41.866472 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17472586-62b4-4c17-8805-fb97d2eb7022 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:18:41.884807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17472586-62b4-4c17-8805-fb97d2eb7022 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:18:41.892639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497616dd-acc9-4416-bfd6-05305d4ddcae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:18:41.893315 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497616dd-acc9-4416-bfd6-05305d4ddcae service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:41.893595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497616dd-acc9-4416-bfd6-05305d4ddcae service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:41.893871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497616dd-acc9-4416-bfd6-05305d4ddcae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:41.903193 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497616dd-acc9-4416-bfd6-05305d4ddcae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:18:41.904876 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497616dd-acc9-4416-bfd6-05305d4ddcae service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:18:41.916778 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1167/2339] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:18:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 16:18:51.818416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=28 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:51.911511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:18:52.012371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745b394-81c9-4afa-82f4-436a9be380fd None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:52.012665 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745b394-81c9-4afa-82f4-436a9be380fd None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:52.013296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745b394-81c9-4afa-82f4-436a9be380fd None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:52.016590 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1173/2340] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 16 16:18:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:18:52.022739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9669e38-e27e-457b-824b-c0eb6bfd7372 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:18:52.023285 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9669e38-e27e-457b-824b-c0eb6bfd7372 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:18:52.023756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9669e38-e27e-457b-824b-c0eb6bfd7372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:18:52.065656 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b9669e38-e27e-457b-824b-c0eb6bfd7372 None None] MFA Rules not processed for user `795c029cb14b42b5b0f3987e218d4239`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:18:52.067092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b9669e38-e27e-457b-824b-c0eb6bfd7372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:18:52.239974 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1168/2341] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 16 16:18:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:19:02.236124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=53 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:03.875965 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745b394-81c9-4afa-82f4-436a9be380fd None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:19:03.877977 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8745b394-81c9-4afa-82f4-436a9be380fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:03.950019 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745b394-81c9-4afa-82f4-436a9be380fd None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:19:03.954044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac72e5c-9581-4349-950d-6d02a734a11f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59174974208c469b8bb44d94d0e55427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:19:03.954737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72e5c-9581-4349-950d-6d02a734a11f service glance] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:03.955163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72e5c-9581-4349-950d-6d02a734a11f service glance] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:03.955443 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72e5c-9581-4349-950d-6d02a734a11f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:03.967179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac72e5c-9581-4349-950d-6d02a734a11f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:19:03.968789 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac72e5c-9581-4349-950d-6d02a734a11f service glance] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:19:03.981073 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1174/2342] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:19:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:19:04.058533 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233d168-e99e-4bad-b7b4-36af127ec1df None None] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:04.059307 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233d168-e99e-4bad-b7b4-36af127ec1df None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:04.059307 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233d168-e99e-4bad-b7b4-36af127ec1df None None] PATH_INFO: `/` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:04.060549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1169/2343] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 16 16:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 16:19:04.067851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192c223-d298-4dbd-a45f-a7c167b3844c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:04.068295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192c223-d298-4dbd-a45f-a7c167b3844c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:04.068629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192c223-d298-4dbd-a45f-a7c167b3844c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:04.101664 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e192c223-d298-4dbd-a45f-a7c167b3844c None None] MFA Rules not processed for user `087adcbf737843db97dabfa9708484c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:19:04.102909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e192c223-d298-4dbd-a45f-a7c167b3844c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:04.126209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1175/2344] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 16 16:19:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:19:04.141026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233d168-e99e-4bad-b7b4-36af127ec1df None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:19:04.143685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1233d168-e99e-4bad-b7b4-36af127ec1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:04.176027 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233d168-e99e-4bad-b7b4-36af127ec1df None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:19:04.181806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593976a-590a-4eb8-90bd-523037ce4be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:19:04.183551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593976a-590a-4eb8-90bd-523037ce4be8 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:04.184545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593976a-590a-4eb8-90bd-523037ce4be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:04.185690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593976a-590a-4eb8-90bd-523037ce4be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:04.197649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593976a-590a-4eb8-90bd-523037ce4be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:19:04.199294 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593976a-590a-4eb8-90bd-523037ce4be8 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:19:04.214140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1170/2345] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:19:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:19:04.331152 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062eca8-59de-49e1-bb54-388a562e94bc None None] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:04.331459 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062eca8-59de-49e1-bb54-388a562e94bc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:04.331754 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062eca8-59de-49e1-bb54-388a562e94bc None None] PATH_INFO: `/` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:04.334420 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1176/2346] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 16 16:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 16:19:04.344572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2097e3-815c-48ec-baae-469359ff6d71 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:04.347048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2097e3-815c-48ec-baae-469359ff6d71 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:04.347048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2097e3-815c-48ec-baae-469359ff6d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:04.404475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2c2097e3-815c-48ec-baae-469359ff6d71 None None] MFA Rules not processed for user `795c029cb14b42b5b0f3987e218d4239`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:19:04.406625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2c2097e3-815c-48ec-baae-469359ff6d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:04.416669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1171/2347] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 16 16:19:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:19:04.428543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062eca8-59de-49e1-bb54-388a562e94bc None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:19:04.440306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062eca8-59de-49e1-bb54-388a562e94bc None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:19:04.444985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c485fc-2b07-49c5-a0cc-8964555eaf30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:19:04.446196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c485fc-2b07-49c5-a0cc-8964555eaf30 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:04.446196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c485fc-2b07-49c5-a0cc-8964555eaf30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:04.446613 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c485fc-2b07-49c5-a0cc-8964555eaf30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:04.458981 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c485fc-2b07-49c5-a0cc-8964555eaf30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:19:04.460607 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c485fc-2b07-49c5-a0cc-8964555eaf30 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:19:04.479994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1177/2348] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:19:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:19:07.044320 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d840f6-f91e-45dc-934e-20a2900d1834 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:07.045046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d840f6-f91e-45dc-934e-20a2900d1834 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:07.045046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d840f6-f91e-45dc-934e-20a2900d1834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:07.062582 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e7d840f6-f91e-45dc-934e-20a2900d1834 None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:19:07.063766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e7d840f6-f91e-45dc-934e-20a2900d1834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:07.070897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1172/2349] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jun 16 16:19:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:19:07.083543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c485fc-2b07-49c5-a0cc-8964555eaf30 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:19:07.095816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c485fc-2b07-49c5-a0cc-8964555eaf30 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:19:07.100877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885d53c-f8fc-48f6-9c69-6e30915b75cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:19:07.101536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885d53c-f8fc-48f6-9c69-6e30915b75cc service swift] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:07.101818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885d53c-f8fc-48f6-9c69-6e30915b75cc service swift] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:07.102098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885d53c-f8fc-48f6-9c69-6e30915b75cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:07.112205 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885d53c-f8fc-48f6-9c69-6e30915b75cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:19:07.113797 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885d53c-f8fc-48f6-9c69-6e30915b75cc service swift] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:19:07.123339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1178/2350] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:19:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 16:19:07.169483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a849-7f61-491e-814a-6d81cab7c86a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:07.170705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a849-7f61-491e-814a-6d81cab7c86a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:07.170976 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a849-7f61-491e-814a-6d81cab7c86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:07.190013 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e981a849-7f61-491e-814a-6d81cab7c86a None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:19:07.191264 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e981a849-7f61-491e-814a-6d81cab7c86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:07.198693 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1173/2351] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 16 16:19:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:19:07.215154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885d53c-f8fc-48f6-9c69-6e30915b75cc service swift] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:19:07.226215 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885d53c-f8fc-48f6-9c69-6e30915b75cc service swift] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:19:07.233447 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd9d67-844a-48d6-9f80-0ed5078d9d7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:19:07.234299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd9d67-844a-48d6-9f80-0ed5078d9d7a service swift] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:07.234615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd9d67-844a-48d6-9f80-0ed5078d9d7a service swift] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:07.234891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd9d67-844a-48d6-9f80-0ed5078d9d7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:07.244522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd9d67-844a-48d6-9f80-0ed5078d9d7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:19:07.246177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd9d67-844a-48d6-9f80-0ed5078d9d7a service swift] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:19:07.256690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1179/2352] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:19:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 16:19:09.693933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981a849-7f61-491e-814a-6d81cab7c86a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:19:09.695943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e981a849-7f61-491e-814a-6d81cab7c86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:09.764444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981a849-7f61-491e-814a-6d81cab7c86a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:19:09.773617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed805022-b5c6-4dc8-9003-c21b70a124cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:19:09.775338 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805022-b5c6-4dc8-9003-c21b70a124cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:09.775701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805022-b5c6-4dc8-9003-c21b70a124cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:09.776059 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805022-b5c6-4dc8-9003-c21b70a124cd admin admin] PATH_INFO: `/v3/users/abac759980bd4a679dbd702a3fee5eeb` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:09.777442 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805022-b5c6-4dc8-9003-c21b70a124cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=abac759980bd4a679dbd702a3fee5eeb)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:19:09.780689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805022-b5c6-4dc8-9003-c21b70a124cd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:19:09.832098 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ed805022-b5c6-4dc8-9003-c21b70a124cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abac759980bd4a679dbd702a3fee5eeb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:19:09.832774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ed805022-b5c6-4dc8-9003-c21b70a124cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abac759980bd4a679dbd702a3fee5eeb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:19:09.848688 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ed805022-b5c6-4dc8-9003-c21b70a124cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abac759980bd4a679dbd702a3fee5eeb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:19:09.849436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ed805022-b5c6-4dc8-9003-c21b70a124cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abac759980bd4a679dbd702a3fee5eeb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:19:09.862399 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ed805022-b5c6-4dc8-9003-c21b70a124cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abac759980bd4a679dbd702a3fee5eeb'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:19:09.879065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1174/2353] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:19:09 2022] DELETE /identity/v3/users/abac759980bd4a679dbd702a3fee5eeb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:19:10.065831 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd9d67-844a-48d6-9f80-0ed5078d9d7a service swift] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:19:10.103924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd9d67-844a-48d6-9f80-0ed5078d9d7a service swift] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:19:10.297084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:19:10.297982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:10.298291 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:10.298595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28 admin admin] PATH_INFO: `/v3/projects/aebdb5dde4ea475a8bd74bdc6db79392` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:10.299843 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aebdb5dde4ea475a8bd74bdc6db79392)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:19:10.301965 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:19:10.385314 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:10.401184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aebdb5dde4ea475a8bd74bdc6db79392', 'request_id': 'req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:19:10.410943 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aebdb5dde4ea475a8bd74bdc6db79392', 'request_id': 'req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:19:10.426012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aebdb5dde4ea475a8bd74bdc6db79392', 'request_id': 'req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:19:10.447608 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28 admin admin] The token cache is being invalidate because project aebdb5dde4ea475a8bd74bdc6db79392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:19:10.447845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:19:10.448533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:19:10.450387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1180/2354] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:19:10 2022] DELETE /identity/v3/projects/aebdb5dde4ea475a8bd74bdc6db79392 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:19:19.875144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=65,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:20.444130 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:20.893941 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab67236-efee-407d-a17f-4d71b6700e50 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:20.894418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab67236-efee-407d-a17f-4d71b6700e50 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:20.894546 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab67236-efee-407d-a17f-4d71b6700e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:20.945102 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0ab67236-efee-407d-a17f-4d71b6700e50 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:19:20.946578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0ab67236-efee-407d-a17f-4d71b6700e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:21.014821 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1175/2355] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Jun 16 16:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:19:21.052510 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:19:21.053933 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:21.171346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff9872-e0d4-4f56-9a03-bc2ab9696c28 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:19:21.177161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fad19f-c4c4-4b90-8421-548cbdd5757b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:19:21.177814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fad19f-c4c4-4b90-8421-548cbdd5757b service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:21.178102 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fad19f-c4c4-4b90-8421-548cbdd5757b service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:21.178382 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fad19f-c4c4-4b90-8421-548cbdd5757b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:21.187366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fad19f-c4c4-4b90-8421-548cbdd5757b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:19:21.188955 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fad19f-c4c4-4b90-8421-548cbdd5757b service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:19:21.198924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1181/2356] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:19:24.951043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616f26c-6d2c-4639-9f5e-fb3a1a03b54d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:24.951530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616f26c-6d2c-4639-9f5e-fb3a1a03b54d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:24.951625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616f26c-6d2c-4639-9f5e-fb3a1a03b54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:24.973520 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a616f26c-6d2c-4639-9f5e-fb3a1a03b54d None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:19:24.974761 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a616f26c-6d2c-4639-9f5e-fb3a1a03b54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:24.987179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10056a8-948c-4ce7-b20a-4b2e69fbd7be None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:24.987676 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10056a8-948c-4ce7-b20a-4b2e69fbd7be None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:24.987767 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10056a8-948c-4ce7-b20a-4b2e69fbd7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:25.005553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e10056a8-948c-4ce7-b20a-4b2e69fbd7be None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:19:25.006796 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e10056a8-948c-4ce7-b20a-4b2e69fbd7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:25.015168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1182/2357] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Jun 16 16:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:19:25.033272 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1176/2358] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jun 16 16:19:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:19:25.036065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10056a8-948c-4ce7-b20a-4b2e69fbd7be None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:19:25.051567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10056a8-948c-4ce7-b20a-4b2e69fbd7be None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:19:25.058235 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616f26c-6d2c-4639-9f5e-fb3a1a03b54d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:19:25.058926 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbdb94-3abf-4eb4-b59f-cc5aa0954c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:19:25.059605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbdb94-3abf-4eb4-b59f-cc5aa0954c4a service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:25.059910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a616f26c-6d2c-4639-9f5e-fb3a1a03b54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:25.060031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbdb94-3abf-4eb4-b59f-cc5aa0954c4a service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:25.060915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbdb94-3abf-4eb4-b59f-cc5aa0954c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:25.070070 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbdb94-3abf-4eb4-b59f-cc5aa0954c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:19:25.071790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbdb94-3abf-4eb4-b59f-cc5aa0954c4a service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:19:25.083512 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1183/2359] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:19:25.132522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616f26c-6d2c-4639-9f5e-fb3a1a03b54d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:19:25.137798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1655f-936a-409e-8991-1425c740b1ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:19:25.138506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1655f-936a-409e-8991-1425c740b1ab service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:25.138795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1655f-936a-409e-8991-1425c740b1ab service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:25.139077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1655f-936a-409e-8991-1425c740b1ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:25.147361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1655f-936a-409e-8991-1425c740b1ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:19:25.148956 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1655f-936a-409e-8991-1425c740b1ab service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:19:25.158077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1177/2360] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:19:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 16:19:28.230246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef6bfc-6662-43fc-81f5-50e3a8713f8e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:28.230867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef6bfc-6662-43fc-81f5-50e3a8713f8e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:28.230867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef6bfc-6662-43fc-81f5-50e3a8713f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:28.249953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ddef6bfc-6662-43fc-81f5-50e3a8713f8e None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:19:28.251191 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ddef6bfc-6662-43fc-81f5-50e3a8713f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:28.259292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1184/2361] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Jun 16 16:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:19:28.281347 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1655f-936a-409e-8991-1425c740b1ab service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:19:28.282772 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8df1655f-936a-409e-8991-1425c740b1ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:28.298554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1655f-936a-409e-8991-1425c740b1ab service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:19:28.304008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c066f-5a27-41cf-9739-7281f9f0a268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:19:28.304647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c066f-5a27-41cf-9739-7281f9f0a268 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:28.304930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c066f-5a27-41cf-9739-7281f9f0a268 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:28.305206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c066f-5a27-41cf-9739-7281f9f0a268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:28.313635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c066f-5a27-41cf-9739-7281f9f0a268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:19:28.315255 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c066f-5a27-41cf-9739-7281f9f0a268 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:19:28.320186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:28.325397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1178/2362] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:19:31.287133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3dc56-8294-493a-9961-fa914acd44c5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:31.287667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3dc56-8294-493a-9961-fa914acd44c5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:31.287787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3dc56-8294-493a-9961-fa914acd44c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:31.307019 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-40d3dc56-8294-493a-9961-fa914acd44c5 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:19:31.308448 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-40d3dc56-8294-493a-9961-fa914acd44c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:31.317178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1185/2363] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Jun 16 16:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:19:31.338399 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c066f-5a27-41cf-9739-7281f9f0a268 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:19:31.351096 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c066f-5a27-41cf-9739-7281f9f0a268 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:19:31.356630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca11bfa-67df-4556-9a1e-5e09ac1be691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:19:31.357309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca11bfa-67df-4556-9a1e-5e09ac1be691 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:31.357596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca11bfa-67df-4556-9a1e-5e09ac1be691 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:31.357913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca11bfa-67df-4556-9a1e-5e09ac1be691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:31.368924 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca11bfa-67df-4556-9a1e-5e09ac1be691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:19:31.370743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca11bfa-67df-4556-9a1e-5e09ac1be691 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:19:31.381885 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1179/2364] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:19:35.481003 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffb1ef-ffd3-44a6-8791-2d87acd29e15 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:35.481528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffb1ef-ffd3-44a6-8791-2d87acd29e15 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:35.481626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffb1ef-ffd3-44a6-8791-2d87acd29e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:35.504499 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-92ffb1ef-ffd3-44a6-8791-2d87acd29e15 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:19:35.505728 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-92ffb1ef-ffd3-44a6-8791-2d87acd29e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:35.516963 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1186/2365] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Jun 16 16:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:19:35.539160 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca11bfa-67df-4556-9a1e-5e09ac1be691 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:19:35.551064 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca11bfa-67df-4556-9a1e-5e09ac1be691 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:19:35.556547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158755bd-eab4-481b-aba0-b3ee2d56031d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:19:35.557171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158755bd-eab4-481b-aba0-b3ee2d56031d service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:35.557455 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158755bd-eab4-481b-aba0-b3ee2d56031d service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:35.557732 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158755bd-eab4-481b-aba0-b3ee2d56031d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:35.566596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158755bd-eab4-481b-aba0-b3ee2d56031d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:19:35.568174 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158755bd-eab4-481b-aba0-b3ee2d56031d service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:19:35.577581 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1180/2366] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:19:39.679212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ed8f0-22fb-46d1-902b-edb9b3859174 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:39.679743 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ed8f0-22fb-46d1-902b-edb9b3859174 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:39.679839 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ed8f0-22fb-46d1-902b-edb9b3859174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:39.699008 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-1b3ed8f0-22fb-46d1-902b-edb9b3859174 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:19:39.700215 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1b3ed8f0-22fb-46d1-902b-edb9b3859174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:39.708742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1187/2367] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Jun 16 16:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:19:39.734397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158755bd-eab4-481b-aba0-b3ee2d56031d service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:19:39.745624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158755bd-eab4-481b-aba0-b3ee2d56031d service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:19:39.752036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bdfbb-c2e2-40eb-bd64-fdf2b268a9b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:19:39.752675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bdfbb-c2e2-40eb-bd64-fdf2b268a9b3 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:39.752956 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bdfbb-c2e2-40eb-bd64-fdf2b268a9b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:39.753231 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bdfbb-c2e2-40eb-bd64-fdf2b268a9b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:39.761495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bdfbb-c2e2-40eb-bd64-fdf2b268a9b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:19:39.763124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bdfbb-c2e2-40eb-bd64-fdf2b268a9b3 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:19:39.772780 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1181/2368] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:19:49.692949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=67 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:49.768532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=18 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:19:50.589651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ed8f0-22fb-46d1-902b-edb9b3859174 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:19:50.591076 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1b3ed8f0-22fb-46d1-902b-edb9b3859174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:50.681781 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ed8f0-22fb-46d1-902b-edb9b3859174 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:19:50.687399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe6fcb-569b-4e7c-86cf-63ea12c70206 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e8222d303aa487ca2b5c5bed6124f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:19:50.687961 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe6fcb-569b-4e7c-86cf-63ea12c70206 service placement] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:50.688246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe6fcb-569b-4e7c-86cf-63ea12c70206 service placement] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:50.688520 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe6fcb-569b-4e7c-86cf-63ea12c70206 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:50.690310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b6fe6fcb-569b-4e7c-86cf-63ea12c70206 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:50.701480 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe6fcb-569b-4e7c-86cf-63ea12c70206 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:19:50.703833 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe6fcb-569b-4e7c-86cf-63ea12c70206 service placement] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:19:50.713472 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1188/2369] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:19:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:19:56.021962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16b458-a54d-48f5-8824-d26f7563cf17 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:56.022453 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16b458-a54d-48f5-8824-d26f7563cf17 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:56.022551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16b458-a54d-48f5-8824-d26f7563cf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:56.039929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2f16b458-a54d-48f5-8824-d26f7563cf17 None None] MFA Rules not processed for user `ee17f83f16214a2db17b37e2a3a37934`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:19:56.041134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2f16b458-a54d-48f5-8824-d26f7563cf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:56.096004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1182/2370] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:19:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:19:58.292857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3e996-ae3f-41a0-90d0-e16e472180c0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:19:58.293426 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3e996-ae3f-41a0-90d0-e16e472180c0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:19:58.293872 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3e996-ae3f-41a0-90d0-e16e472180c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:19:58.312893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-18d3e996-ae3f-41a0-90d0-e16e472180c0 None None] MFA Rules not processed for user `c5d0829ddcfe4116a0d180ff6d89bd20`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:19:58.314094 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-18d3e996-ae3f-41a0-90d0-e16e472180c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:19:58.372548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1189/2371] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:19:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:20:06.089341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=25 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:08.368447 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=66 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:13.819737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5f84d-6cb5-42c7-8231-98196c47805d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:13.820328 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5f84d-6cb5-42c7-8231-98196c47805d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:13.820482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5f84d-6cb5-42c7-8231-98196c47805d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:13.842730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f4d5f84d-6cb5-42c7-8231-98196c47805d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:20:13.844170 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f4d5f84d-6cb5-42c7-8231-98196c47805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:20:13.859199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1183/2372] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Jun 16 16:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:20:13.875408 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3e996-ae3f-41a0-90d0-e16e472180c0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:20:13.888433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3e996-ae3f-41a0-90d0-e16e472180c0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:20:13.894763 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6654e3-2fd4-4633-a44f-6e1b2a31205a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:20:13.895709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6654e3-2fd4-4633-a44f-6e1b2a31205a service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:13.896068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6654e3-2fd4-4633-a44f-6e1b2a31205a service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:13.896424 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6654e3-2fd4-4633-a44f-6e1b2a31205a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:13.906266 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6654e3-2fd4-4633-a44f-6e1b2a31205a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:20:13.907986 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6654e3-2fd4-4633-a44f-6e1b2a31205a service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:20:13.917924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1190/2373] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:20:17.165164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691a4de-e15f-4cb8-aa4d-9da05f1233de None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:17.165700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691a4de-e15f-4cb8-aa4d-9da05f1233de None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:17.165783 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691a4de-e15f-4cb8-aa4d-9da05f1233de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:17.187453 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5691a4de-e15f-4cb8-aa4d-9da05f1233de None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:20:17.188838 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5691a4de-e15f-4cb8-aa4d-9da05f1233de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:20:17.197024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1184/2374] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Jun 16 16:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:20:17.217626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6654e3-2fd4-4633-a44f-6e1b2a31205a service nova] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:20:17.233117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6654e3-2fd4-4633-a44f-6e1b2a31205a service nova] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:20:17.254597 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2e4cb-d425-4091-a937-e00ab238f3ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:20:17.255584 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2e4cb-d425-4091-a937-e00ab238f3ae service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:17.256143 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2e4cb-d425-4091-a937-e00ab238f3ae service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:17.256525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2e4cb-d425-4091-a937-e00ab238f3ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:17.267926 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2e4cb-d425-4091-a937-e00ab238f3ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:20:17.269635 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2e4cb-d425-4091-a937-e00ab238f3ae service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:20:17.281989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1191/2375] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:20:18.759122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c542f-b3c6-4f6f-a39e-dc812d5bad65 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:18.759742 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c542f-b3c6-4f6f-a39e-dc812d5bad65 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:18.759742 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c542f-b3c6-4f6f-a39e-dc812d5bad65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:18.780103 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-130c542f-b3c6-4f6f-a39e-dc812d5bad65 None None] MFA Rules not processed for user `9b1d8005a49f4760ab587ca00edd2ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:20:18.781364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-130c542f-b3c6-4f6f-a39e-dc812d5bad65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:20:18.846603 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1185/2376] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:20:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:20:20.255734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c321593-8a45-4892-a803-1cc6cbf1d024 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:20.256281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c321593-8a45-4892-a803-1cc6cbf1d024 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:20.256379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c321593-8a45-4892-a803-1cc6cbf1d024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:20.275144 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-8c321593-8a45-4892-a803-1cc6cbf1d024 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:20:20.276374 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8c321593-8a45-4892-a803-1cc6cbf1d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:20:20.284689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1192/2377] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Jun 16 16:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:20:20.306666 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c542f-b3c6-4f6f-a39e-dc812d5bad65 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:20:20.319959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c542f-b3c6-4f6f-a39e-dc812d5bad65 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:20:20.325326 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793850d4-6598-4889-aba8-abd1ea0165dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:20:20.326031 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793850d4-6598-4889-aba8-abd1ea0165dc service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:20.326314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793850d4-6598-4889-aba8-abd1ea0165dc service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:20.326621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793850d4-6598-4889-aba8-abd1ea0165dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:20.335266 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793850d4-6598-4889-aba8-abd1ea0165dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:20:20.336826 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793850d4-6598-4889-aba8-abd1ea0165dc service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:20:20.347444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1186/2378] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:20:23.461066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1b693-13a1-4332-874a-4009631cfd09 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:23.462605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1b693-13a1-4332-874a-4009631cfd09 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:23.463141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1b693-13a1-4332-874a-4009631cfd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:23.494806 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7ad1b693-13a1-4332-874a-4009631cfd09 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:20:23.496952 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7ad1b693-13a1-4332-874a-4009631cfd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:20:23.510603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1193/2379] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Jun 16 16:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:20:23.534940 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793850d4-6598-4889-aba8-abd1ea0165dc service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:20:23.547204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793850d4-6598-4889-aba8-abd1ea0165dc service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:20:23.552646 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49e120-b6d5-41df-8fc2-05286e32cd6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:20:23.553295 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e120-b6d5-41df-8fc2-05286e32cd6a service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:23.553576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e120-b6d5-41df-8fc2-05286e32cd6a service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:23.553850 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e120-b6d5-41df-8fc2-05286e32cd6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:23.562931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49e120-b6d5-41df-8fc2-05286e32cd6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:20:23.564517 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49e120-b6d5-41df-8fc2-05286e32cd6a service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:20:23.574034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1187/2380] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:20:26.661797 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca196e9-f202-4f7a-9214-00022ccea783 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:26.662624 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca196e9-f202-4f7a-9214-00022ccea783 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:26.662624 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca196e9-f202-4f7a-9214-00022ccea783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:26.681039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6ca196e9-f202-4f7a-9214-00022ccea783 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:20:26.682243 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6ca196e9-f202-4f7a-9214-00022ccea783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:20:26.690958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1194/2381] 10.222.0.67 () {58 vars in 1016 bytes} [Thu Jun 16 16:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:20:26.713041 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49e120-b6d5-41df-8fc2-05286e32cd6a service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:20:26.724367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49e120-b6d5-41df-8fc2-05286e32cd6a service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:20:26.729712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be43fe-8f06-495d-8afa-013ef9145df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:20:26.730393 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be43fe-8f06-495d-8afa-013ef9145df2 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:26.730711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be43fe-8f06-495d-8afa-013ef9145df2 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:26.730983 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be43fe-8f06-495d-8afa-013ef9145df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:26.739829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be43fe-8f06-495d-8afa-013ef9145df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:20:26.741393 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be43fe-8f06-495d-8afa-013ef9145df2 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:20:26.751812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1188/2382] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:20:36.675770 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=21 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:36.746556 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=49 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:59.179757 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca196e9-f202-4f7a-9214-00022ccea783 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:20:59.181402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6ca196e9-f202-4f7a-9214-00022ccea783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:20:59.194910 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca196e9-f202-4f7a-9214-00022ccea783 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:20:59.199988 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd894c2b-f748-4ff3-8a1e-cce5221c55b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:20:59.200900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd894c2b-f748-4ff3-8a1e-cce5221c55b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:59.201187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd894c2b-f748-4ff3-8a1e-cce5221c55b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:59.201466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd894c2b-f748-4ff3-8a1e-cce5221c55b4 admin admin] PATH_INFO: `/v3/users/ee17f83f16214a2db17b37e2a3a37934` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:59.202702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd894c2b-f748-4ff3-8a1e-cce5221c55b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee17f83f16214a2db17b37e2a3a37934)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:20:59.204637 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd894c2b-f748-4ff3-8a1e-cce5221c55b4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:20:59.249738 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-bd894c2b-f748-4ff3-8a1e-cce5221c55b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee17f83f16214a2db17b37e2a3a37934'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:20:59.262493 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-bd894c2b-f748-4ff3-8a1e-cce5221c55b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee17f83f16214a2db17b37e2a3a37934'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:20:59.263340 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-bd894c2b-f748-4ff3-8a1e-cce5221c55b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee17f83f16214a2db17b37e2a3a37934'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:20:59.263955 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-bd894c2b-f748-4ff3-8a1e-cce5221c55b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee17f83f16214a2db17b37e2a3a37934'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:20:59.271022 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-bd894c2b-f748-4ff3-8a1e-cce5221c55b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee17f83f16214a2db17b37e2a3a37934'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:20:59.284237 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1195/2383] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:20:59 2022] DELETE /identity/v3/users/ee17f83f16214a2db17b37e2a3a37934 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:20:59.466655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be43fe-8f06-495d-8afa-013ef9145df2 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:20:59.488352 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be43fe-8f06-495d-8afa-013ef9145df2 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:20:59.556388 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49863c-229a-427c-acad-66788134543a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:20:59.557257 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49863c-229a-427c-acad-66788134543a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:59.557543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49863c-229a-427c-acad-66788134543a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:59.557826 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49863c-229a-427c-acad-66788134543a admin admin] PATH_INFO: `/v3/projects/8f0235c7503a418e9de6de4b6c8c1b4e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:59.559922 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49863c-229a-427c-acad-66788134543a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f0235c7503a418e9de6de4b6c8c1b4e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:20:59.561863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49863c-229a-427c-acad-66788134543a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:20:59.613452 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3c49863c-229a-427c-acad-66788134543a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0235c7503a418e9de6de4b6c8c1b4e', 'request_id': 'req-3c49863c-229a-427c-acad-66788134543a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:20:59.623908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3c49863c-229a-427c-acad-66788134543a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0235c7503a418e9de6de4b6c8c1b4e', 'request_id': 'req-3c49863c-229a-427c-acad-66788134543a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:20:59.631881 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3c49863c-229a-427c-acad-66788134543a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0235c7503a418e9de6de4b6c8c1b4e', 'request_id': 'req-3c49863c-229a-427c-acad-66788134543a'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:20:59.644233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3c49863c-229a-427c-acad-66788134543a admin admin] The token cache is being invalidate because project 8f0235c7503a418e9de6de4b6c8c1b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:20:59.644457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3c49863c-229a-427c-acad-66788134543a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:20:59.645112 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-3c49863c-229a-427c-acad-66788134543a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:20:59.646698 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1189/2384] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:20:59 2022] DELETE /identity/v3/projects/8f0235c7503a418e9de6de4b6c8c1b4e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:20:59.651828 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb02d1f-ad4d-464f-bbe4-11d9626a3be0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:59.652141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb02d1f-ad4d-464f-bbe4-11d9626a3be0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:59.652985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb02d1f-ad4d-464f-bbe4-11d9626a3be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:59.675203 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-cbb02d1f-ad4d-464f-bbe4-11d9626a3be0 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:20:59.676453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cbb02d1f-ad4d-464f-bbe4-11d9626a3be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:20:59.741065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1196/2385] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:20:59.751814 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0793e-c9b9-4db6-8ae5-4dff9b095b6c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:59.752108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0793e-c9b9-4db6-8ae5-4dff9b095b6c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:59.752391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0793e-c9b9-4db6-8ae5-4dff9b095b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:59.771416 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-53e0793e-c9b9-4db6-8ae5-4dff9b095b6c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:20:59.772644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-53e0793e-c9b9-4db6-8ae5-4dff9b095b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:20:59.781192 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1190/2386] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:20:59.786217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb02d1f-ad4d-464f-bbe4-11d9626a3be0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:20:59.796936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb02d1f-ad4d-464f-bbe4-11d9626a3be0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:20:59.801554 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962c9da-a254-4328-b505-3c81db67dd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:20:59.802211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962c9da-a254-4328-b505-3c81db67dd1f admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:59.802536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962c9da-a254-4328-b505-3c81db67dd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:59.802821 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962c9da-a254-4328-b505-3c81db67dd1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:59.803602 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962c9da-a254-4328-b505-3c81db67dd1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:20:59.803916 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962c9da-a254-4328-b505-3c81db67dd1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:20:59.805526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962c9da-a254-4328-b505-3c81db67dd1f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:20:59.817867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1197/2387] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:20:59.822097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0793e-c9b9-4db6-8ae5-4dff9b095b6c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:20:59.831886 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0793e-c9b9-4db6-8ae5-4dff9b095b6c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:20:59.836571 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389948b-2f2e-4456-98d4-3428abbe0a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:20:59.837226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389948b-2f2e-4456-98d4-3428abbe0a28 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:59.837509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389948b-2f2e-4456-98d4-3428abbe0a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:59.837785 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389948b-2f2e-4456-98d4-3428abbe0a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:59.838516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389948b-2f2e-4456-98d4-3428abbe0a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:20:59.840946 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389948b-2f2e-4456-98d4-3428abbe0a28 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:20:59.868246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1191/2388] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:20:59 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:20:59.873137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962c9da-a254-4328-b505-3c81db67dd1f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:20:59.883489 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962c9da-a254-4328-b505-3c81db67dd1f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:20:59.941998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5c468-0bda-42b4-b452-376fd6f807bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:20:59.942713 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c468-0bda-42b4-b452-376fd6f807bf admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:59.943003 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c468-0bda-42b4-b452-376fd6f807bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:59.943285 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c468-0bda-42b4-b452-376fd6f807bf admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:59.943964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5c468-0bda-42b4-b452-376fd6f807bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:20:59.945966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5c468-0bda-42b4-b452-376fd6f807bf admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:20:59.952532 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:20:59.967775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1198/2389] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:20:59 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:20:59.971813 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389948b-2f2e-4456-98d4-3428abbe0a28 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:20:59.982700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389948b-2f2e-4456-98d4-3428abbe0a28 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:20:59.987173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba87ed1-c4b9-43f6-9390-43f1408431e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:20:59.987823 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba87ed1-c4b9-43f6-9390-43f1408431e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:20:59.988104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba87ed1-c4b9-43f6-9390-43f1408431e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:20:59.988382 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba87ed1-c4b9-43f6-9390-43f1408431e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:20:59.989126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba87ed1-c4b9-43f6-9390-43f1408431e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:20:59.990752 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba87ed1-c4b9-43f6-9390-43f1408431e4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:00.002548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1192/2390] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:00.007027 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5c468-0bda-42b4-b452-376fd6f807bf admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:00.018066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5c468-0bda-42b4-b452-376fd6f807bf admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:00.022784 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdad569-0e41-4e66-b198-c2de006c12a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:00.023446 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdad569-0e41-4e66-b198-c2de006c12a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:00.023732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdad569-0e41-4e66-b198-c2de006c12a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:00.024012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdad569-0e41-4e66-b198-c2de006c12a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:00.024735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdad569-0e41-4e66-b198-c2de006c12a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:00.026341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdad569-0e41-4e66-b198-c2de006c12a6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:00.037901 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1199/2391] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:00.042340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba87ed1-c4b9-43f6-9390-43f1408431e4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:00.052972 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba87ed1-c4b9-43f6-9390-43f1408431e4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:00.057684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c8518-edd4-43a7-84d5-527e4b3c0afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:00.059372 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c8518-edd4-43a7-84d5-527e4b3c0afa admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:00.059863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c8518-edd4-43a7-84d5-527e4b3c0afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:00.060348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c8518-edd4-43a7-84d5-527e4b3c0afa admin admin] PATH_INFO: `/v3/projects/ba7435427acc49fb9b6fa2fe233b183d/users/3ea287d757294275aaae0632a115a6bd/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:00.080873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c8518-edd4-43a7-84d5-527e4b3c0afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7435427acc49fb9b6fa2fe233b183d, user_id=3ea287d757294275aaae0632a115a6bd, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:00.083626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c8518-edd4-43a7-84d5-527e4b3c0afa admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:00.096364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1193/2392] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:21:00 2022] PUT /identity/v3/projects/ba7435427acc49fb9b6fa2fe233b183d/users/3ea287d757294275aaae0632a115a6bd/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:00.101528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c5dba-d31c-43e2-ad9c-9aaffcb2b00f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:00.101806 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c5dba-d31c-43e2-ad9c-9aaffcb2b00f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:00.102085 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c5dba-d31c-43e2-ad9c-9aaffcb2b00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:00.119033 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7d8c5dba-d31c-43e2-ad9c-9aaffcb2b00f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:00.120227 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7d8c5dba-d31c-43e2-ad9c-9aaffcb2b00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:00.182236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1200/2393] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:00.192410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c8518-edd4-43a7-84d5-527e4b3c0afa admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:00.194010 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-703c8518-edd4-43a7-84d5-527e4b3c0afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:00.225170 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:00.254247 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c8518-edd4-43a7-84d5-527e4b3c0afa admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:00.258032 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5dba86-fc4b-4297-b443-c4a49eabe1c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:00.258718 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5dba86-fc4b-4297-b443-c4a49eabe1c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:00.259008 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5dba86-fc4b-4297-b443-c4a49eabe1c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:00.259305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5dba86-fc4b-4297-b443-c4a49eabe1c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:00.269483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5dba86-fc4b-4297-b443-c4a49eabe1c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:00.270956 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5dba86-fc4b-4297-b443-c4a49eabe1c5 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:00.280870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1194/2394] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:21:04.835998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61393959-725e-4a96-8f34-1d68835a30d8 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:04.836377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61393959-725e-4a96-8f34-1d68835a30d8 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:04.836567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61393959-725e-4a96-8f34-1d68835a30d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:04.869586 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-61393959-725e-4a96-8f34-1d68835a30d8 None None] MFA Rules not processed for user `3ea287d757294275aaae0632a115a6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:04.871851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-61393959-725e-4a96-8f34-1d68835a30d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:04.944139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1201/2395] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:04.948733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5dba86-fc4b-4297-b443-c4a49eabe1c5 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:04.960708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5dba86-fc4b-4297-b443-c4a49eabe1c5 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:04.966775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d9857-9495-4434-bce2-71dc854966d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:04.967471 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d9857-9495-4434-bce2-71dc854966d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:04.967825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d9857-9495-4434-bce2-71dc854966d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:04.968173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d9857-9495-4434-bce2-71dc854966d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:04.968949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d9857-9495-4434-bce2-71dc854966d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:04.971003 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d9857-9495-4434-bce2-71dc854966d6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:05.002462 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1195/2396] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:21:04 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:21:05.004186 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61393959-725e-4a96-8f34-1d68835a30d8 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:05.016812 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61393959-725e-4a96-8f34-1d68835a30d8 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:05.079702 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c374c6-e623-4556-bb6d-1372c05f043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:05.080398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c374c6-e623-4556-bb6d-1372c05f043d admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:05.080689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c374c6-e623-4556-bb6d-1372c05f043d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:05.080972 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c374c6-e623-4556-bb6d-1372c05f043d admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:05.081684 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c374c6-e623-4556-bb6d-1372c05f043d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:05.083674 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c374c6-e623-4556-bb6d-1372c05f043d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:05.099930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:05.107734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1202/2397] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:21:05 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:21:05.111121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d9857-9495-4434-bce2-71dc854966d6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:05.122739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d9857-9495-4434-bce2-71dc854966d6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:05.127465 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687fa27-e26e-421d-acab-6e0a34d1e0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:05.128172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687fa27-e26e-421d-acab-6e0a34d1e0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:05.128489 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687fa27-e26e-421d-acab-6e0a34d1e0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:05.128771 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687fa27-e26e-421d-acab-6e0a34d1e0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:05.129500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687fa27-e26e-421d-acab-6e0a34d1e0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:05.131188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687fa27-e26e-421d-acab-6e0a34d1e0a1 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:05.143963 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1196/2398] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:05.147994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c374c6-e623-4556-bb6d-1372c05f043d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:05.159523 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c374c6-e623-4556-bb6d-1372c05f043d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:05.164744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4c43d-9fe3-4e09-8c4d-b6d81f600e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:05.165667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4c43d-9fe3-4e09-8c4d-b6d81f600e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:05.165960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4c43d-9fe3-4e09-8c4d-b6d81f600e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:05.166551 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4c43d-9fe3-4e09-8c4d-b6d81f600e15 admin admin] PATH_INFO: `/v3/projects/474ae3dc586d401797f0d84130e599d9/users/f25733c56344454d9df7f7b726083102/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:05.184312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4c43d-9fe3-4e09-8c4d-b6d81f600e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474ae3dc586d401797f0d84130e599d9, user_id=f25733c56344454d9df7f7b726083102, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:05.187070 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4c43d-9fe3-4e09-8c4d-b6d81f600e15 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:05.202123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1203/2399] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:21:05 2022] PUT /identity/v3/projects/474ae3dc586d401797f0d84130e599d9/users/f25733c56344454d9df7f7b726083102/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:05.206005 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687fa27-e26e-421d-acab-6e0a34d1e0a1 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:05.216933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687fa27-e26e-421d-acab-6e0a34d1e0a1 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:05.274314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f089521-36cb-4707-a4f1-ce23f97ccb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:05.275013 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f089521-36cb-4707-a4f1-ce23f97ccb12 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:05.275300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f089521-36cb-4707-a4f1-ce23f97ccb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:05.275579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f089521-36cb-4707-a4f1-ce23f97ccb12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:05.276314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f089521-36cb-4707-a4f1-ce23f97ccb12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:05.279128 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f089521-36cb-4707-a4f1-ce23f97ccb12 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:05.289044 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1197/2400] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:05.294011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4c43d-9fe3-4e09-8c4d-b6d81f600e15 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:05.304364 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4c43d-9fe3-4e09-8c4d-b6d81f600e15 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:05.310178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fbbe3-6d3b-4014-982c-8d4c00b29bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:05.311170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fbbe3-6d3b-4014-982c-8d4c00b29bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:05.311455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fbbe3-6d3b-4014-982c-8d4c00b29bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:05.311739 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fbbe3-6d3b-4014-982c-8d4c00b29bb7 admin admin] PATH_INFO: `/v3/projects/474ae3dc586d401797f0d84130e599d9/users/f25733c56344454d9df7f7b726083102/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:05.313732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fbbe3-6d3b-4014-982c-8d4c00b29bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474ae3dc586d401797f0d84130e599d9, user_id=f25733c56344454d9df7f7b726083102, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:05.316422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fbbe3-6d3b-4014-982c-8d4c00b29bb7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:05.327876 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1204/2401] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:21:05 2022] PUT /identity/v3/projects/474ae3dc586d401797f0d84130e599d9/users/f25733c56344454d9df7f7b726083102/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:12.453751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1d006-eccb-4398-a1d5-c254163c8a2c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:12.454264 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1d006-eccb-4398-a1d5-c254163c8a2c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:12.454360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1d006-eccb-4398-a1d5-c254163c8a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:12.474201 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-c4b1d006-eccb-4398-a1d5-c254163c8a2c None None] MFA Rules not processed for user `10638aa389dd4bb9bb82da7bf11c4b60`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:12.475509 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c4b1d006-eccb-4398-a1d5-c254163c8a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:12.549120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1198/2402] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:14.112973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa541324-abfa-4e77-8d3a-5435741433b2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:14.113819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa541324-abfa-4e77-8d3a-5435741433b2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:14.114260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa541324-abfa-4e77-8d3a-5435741433b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:14.163032 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-aa541324-abfa-4e77-8d3a-5435741433b2 None None] MFA Rules not processed for user `f25733c56344454d9df7f7b726083102`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:14.175812 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-aa541324-abfa-4e77-8d3a-5435741433b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:14.288996 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1205/2403] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:14.304097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1d006-eccb-4398-a1d5-c254163c8a2c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:14.305518 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-c4b1d006-eccb-4398-a1d5-c254163c8a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:14.389638 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:14.440151 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1d006-eccb-4398-a1d5-c254163c8a2c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:14.446201 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725df3-6e9c-477a-8334-39533bca71c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:14.447382 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725df3-6e9c-477a-8334-39533bca71c1 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:14.447873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725df3-6e9c-477a-8334-39533bca71c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:14.448086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725df3-6e9c-477a-8334-39533bca71c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:14.538163 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb725df3-6e9c-477a-8334-39533bca71c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:14.540398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb725df3-6e9c-477a-8334-39533bca71c1 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:14.557412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1199/2404] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:21:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:21:14.680746 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa541324-abfa-4e77-8d3a-5435741433b2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:14.682357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-aa541324-abfa-4e77-8d3a-5435741433b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:14.816379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa541324-abfa-4e77-8d3a-5435741433b2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:14.822291 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e73b37-22c6-4de9-9823-465ed6884549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:14.823299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e73b37-22c6-4de9-9823-465ed6884549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:14.824163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e73b37-22c6-4de9-9823-465ed6884549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:14.824660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e73b37-22c6-4de9-9823-465ed6884549 admin admin] PATH_INFO: `/v3/users/c5d0829ddcfe4116a0d180ff6d89bd20` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:14.826596 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e73b37-22c6-4de9-9823-465ed6884549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d0829ddcfe4116a0d180ff6d89bd20)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:14.828969 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e73b37-22c6-4de9-9823-465ed6884549 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:14.912985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-72e73b37-22c6-4de9-9823-465ed6884549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d0829ddcfe4116a0d180ff6d89bd20'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:14.918117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:14.940092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-72e73b37-22c6-4de9-9823-465ed6884549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d0829ddcfe4116a0d180ff6d89bd20'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:14.940851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-72e73b37-22c6-4de9-9823-465ed6884549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d0829ddcfe4116a0d180ff6d89bd20'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:14.941473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-72e73b37-22c6-4de9-9823-465ed6884549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d0829ddcfe4116a0d180ff6d89bd20'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:14.954398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-72e73b37-22c6-4de9-9823-465ed6884549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d0829ddcfe4116a0d180ff6d89bd20'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:14.990533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1206/2405] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:21:14 2022] DELETE /identity/v3/users/c5d0829ddcfe4116a0d180ff6d89bd20 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:15.251895 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725df3-6e9c-477a-8334-39533bca71c1 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:15.264545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725df3-6e9c-477a-8334-39533bca71c1 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:15.444480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10d402-30f8-449a-a1b3-e4b1bc54d1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:15.445409 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10d402-30f8-449a-a1b3-e4b1bc54d1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:15.445689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10d402-30f8-449a-a1b3-e4b1bc54d1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:15.445969 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10d402-30f8-449a-a1b3-e4b1bc54d1b8 admin admin] PATH_INFO: `/v3/projects/595c1599f6f04ab0a1ac33fb61f107ff` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:15.447380 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10d402-30f8-449a-a1b3-e4b1bc54d1b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=595c1599f6f04ab0a1ac33fb61f107ff)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:15.449446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10d402-30f8-449a-a1b3-e4b1bc54d1b8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:15.552127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f10d402-30f8-449a-a1b3-e4b1bc54d1b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '595c1599f6f04ab0a1ac33fb61f107ff', 'request_id': 'req-4f10d402-30f8-449a-a1b3-e4b1bc54d1b8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:15.562277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f10d402-30f8-449a-a1b3-e4b1bc54d1b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '595c1599f6f04ab0a1ac33fb61f107ff', 'request_id': 'req-4f10d402-30f8-449a-a1b3-e4b1bc54d1b8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:15.574614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f10d402-30f8-449a-a1b3-e4b1bc54d1b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '595c1599f6f04ab0a1ac33fb61f107ff', 'request_id': 'req-4f10d402-30f8-449a-a1b3-e4b1bc54d1b8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:15.603435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f10d402-30f8-449a-a1b3-e4b1bc54d1b8 admin admin] The token cache is being invalidate because project 595c1599f6f04ab0a1ac33fb61f107ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:21:15.603743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f10d402-30f8-449a-a1b3-e4b1bc54d1b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:15.606083 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f10d402-30f8-449a-a1b3-e4b1bc54d1b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:15.610926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1200/2406] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:21:15 2022] DELETE /identity/v3/projects/595c1599f6f04ab0a1ac33fb61f107ff => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:15.615552 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1935594-d560-44ed-9f9a-c9454aa02310 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:15.616504 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1935594-d560-44ed-9f9a-c9454aa02310 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:15.617001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1935594-d560-44ed-9f9a-c9454aa02310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:15.655018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d1935594-d560-44ed-9f9a-c9454aa02310 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:15.667800 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d1935594-d560-44ed-9f9a-c9454aa02310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:15.847200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1207/2407] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:15.848673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528df5b6-2cfd-4457-b291-481e94b7a172 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:15.849324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528df5b6-2cfd-4457-b291-481e94b7a172 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:15.849614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528df5b6-2cfd-4457-b291-481e94b7a172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:15.862667 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:15.892437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-528df5b6-2cfd-4457-b291-481e94b7a172 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:15.893873 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-528df5b6-2cfd-4457-b291-481e94b7a172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:15.903722 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1201/2408] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:15.908253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1935594-d560-44ed-9f9a-c9454aa02310 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:15.921861 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1935594-d560-44ed-9f9a-c9454aa02310 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:15.933295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0dc73-4e58-4fa0-bdb9-e50117b8d4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:15.933985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0dc73-4e58-4fa0-bdb9-e50117b8d4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:15.934269 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0dc73-4e58-4fa0-bdb9-e50117b8d4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:15.934577 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0dc73-4e58-4fa0-bdb9-e50117b8d4f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:15.935310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0dc73-4e58-4fa0-bdb9-e50117b8d4f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:21:15.935818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0dc73-4e58-4fa0-bdb9-e50117b8d4f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:15.938038 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0dc73-4e58-4fa0-bdb9-e50117b8d4f4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:15.973793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1208/2409] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:21:15.978292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528df5b6-2cfd-4457-b291-481e94b7a172 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:15.996022 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528df5b6-2cfd-4457-b291-481e94b7a172 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:16.012347 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34358415-a704-493d-a85b-70f7165f9395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:16.013679 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34358415-a704-493d-a85b-70f7165f9395 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:16.014116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34358415-a704-493d-a85b-70f7165f9395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:16.015212 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34358415-a704-493d-a85b-70f7165f9395 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:16.016114 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34358415-a704-493d-a85b-70f7165f9395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:16.025021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34358415-a704-493d-a85b-70f7165f9395 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:16.070535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1202/2410] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:21:15 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:21:16.074475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0dc73-4e58-4fa0-bdb9-e50117b8d4f4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:16.095110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0dc73-4e58-4fa0-bdb9-e50117b8d4f4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:16.200228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de01cca-0675-4414-8a66-d5f7de4e19e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:16.201571 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de01cca-0675-4414-8a66-d5f7de4e19e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:16.201856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de01cca-0675-4414-8a66-d5f7de4e19e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:16.202138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de01cca-0675-4414-8a66-d5f7de4e19e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:16.202891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de01cca-0675-4414-8a66-d5f7de4e19e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:16.206510 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de01cca-0675-4414-8a66-d5f7de4e19e9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:16.232214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1209/2411] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:21:16 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:21:16.242143 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34358415-a704-493d-a85b-70f7165f9395 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:16.258525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34358415-a704-493d-a85b-70f7165f9395 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:16.268215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9a317-1a5d-4570-a4f4-79383d712a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:16.268902 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9a317-1a5d-4570-a4f4-79383d712a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:16.269186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9a317-1a5d-4570-a4f4-79383d712a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:16.269462 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9a317-1a5d-4570-a4f4-79383d712a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:16.270212 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9a317-1a5d-4570-a4f4-79383d712a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:16.271993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9a317-1a5d-4570-a4f4-79383d712a03 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:16.285822 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1203/2412] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:16.290088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de01cca-0675-4414-8a66-d5f7de4e19e9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:16.303148 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de01cca-0675-4414-8a66-d5f7de4e19e9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:16.309585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f822d-e7b4-4d7d-a8ef-c2d364c068ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:16.310338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f822d-e7b4-4d7d-a8ef-c2d364c068ed admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:16.310686 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f822d-e7b4-4d7d-a8ef-c2d364c068ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:16.310969 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f822d-e7b4-4d7d-a8ef-c2d364c068ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:16.311708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f822d-e7b4-4d7d-a8ef-c2d364c068ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:16.313334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f822d-e7b4-4d7d-a8ef-c2d364c068ed admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:16.326477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1210/2413] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:16.331055 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9a317-1a5d-4570-a4f4-79383d712a03 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:16.342411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9a317-1a5d-4570-a4f4-79383d712a03 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:16.348647 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977635c-be75-42d3-b57d-c986b972a914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:16.349689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977635c-be75-42d3-b57d-c986b972a914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:16.350076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977635c-be75-42d3-b57d-c986b972a914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:16.350511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977635c-be75-42d3-b57d-c986b972a914 admin admin] PATH_INFO: `/v3/projects/65cab64db8c14b948aeec05f41fccabf/users/db39879b41d047e98baecf8c1cd6b11e/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:16.373507 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977635c-be75-42d3-b57d-c986b972a914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65cab64db8c14b948aeec05f41fccabf, user_id=db39879b41d047e98baecf8c1cd6b11e, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:16.377532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977635c-be75-42d3-b57d-c986b972a914 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:16.393497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1204/2414] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:21:16 2022] PUT /identity/v3/projects/65cab64db8c14b948aeec05f41fccabf/users/db39879b41d047e98baecf8c1cd6b11e/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:16.406093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8cb00-cf8c-45c1-86b4-dbc23ef20da0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:16.406639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8cb00-cf8c-45c1-86b4-dbc23ef20da0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:16.406973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8cb00-cf8c-45c1-86b4-dbc23ef20da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:16.440289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-16b8cb00-cf8c-45c1-86b4-dbc23ef20da0 None None] MFA Rules not processed for user `db39879b41d047e98baecf8c1cd6b11e`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:16.441630 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-16b8cb00-cf8c-45c1-86b4-dbc23ef20da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:16.463927 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:16.528668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01b65e-5c56-4cf6-99e9-008181d2c9dc None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:16.529891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01b65e-5c56-4cf6-99e9-008181d2c9dc None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:16.530271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01b65e-5c56-4cf6-99e9-008181d2c9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:16.549312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1211/2415] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:16.550524 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8cb00-cf8c-45c1-86b4-dbc23ef20da0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:16.557074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8f01b65e-5c56-4cf6-99e9-008181d2c9dc None None] MFA Rules not processed for user `3ea287d757294275aaae0632a115a6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:16.563510 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8f01b65e-5c56-4cf6-99e9-008181d2c9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:16.646376 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8cb00-cf8c-45c1-86b4-dbc23ef20da0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:16.663338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b2099-015b-424e-83de-d0a2fa43b94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:16.664034 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b2099-015b-424e-83de-d0a2fa43b94b admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:16.664322 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b2099-015b-424e-83de-d0a2fa43b94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:16.664602 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b2099-015b-424e-83de-d0a2fa43b94b admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:16.665302 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b2099-015b-424e-83de-d0a2fa43b94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:16.668056 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b2099-015b-424e-83de-d0a2fa43b94b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:16.688188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1205/2416] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:16.710484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1212/2417] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:21:16 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:21:16.714107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01b65e-5c56-4cf6-99e9-008181d2c9dc None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:16.729897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01b65e-5c56-4cf6-99e9-008181d2c9dc None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:16.826519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70264804-bac8-4c86-98cd-5076031a431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:16.827469 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70264804-bac8-4c86-98cd-5076031a431a admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:16.827753 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70264804-bac8-4c86-98cd-5076031a431a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:16.828037 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70264804-bac8-4c86-98cd-5076031a431a admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:16.829204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70264804-bac8-4c86-98cd-5076031a431a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:16.830969 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70264804-bac8-4c86-98cd-5076031a431a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:16.861655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1206/2418] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:21:16 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:21:16.863803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b2099-015b-424e-83de-d0a2fa43b94b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:16.880784 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b2099-015b-424e-83de-d0a2fa43b94b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:16.890748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f16f9c-1ae3-4f73-b09f-2e1b34cc505d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:16.891742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f16f9c-1ae3-4f73-b09f-2e1b34cc505d admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:16.892449 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f16f9c-1ae3-4f73-b09f-2e1b34cc505d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:16.892989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f16f9c-1ae3-4f73-b09f-2e1b34cc505d admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:16.893945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f16f9c-1ae3-4f73-b09f-2e1b34cc505d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:16.895765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f16f9c-1ae3-4f73-b09f-2e1b34cc505d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:16.918477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1213/2419] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:16.922178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70264804-bac8-4c86-98cd-5076031a431a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:16.940640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70264804-bac8-4c86-98cd-5076031a431a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:16.951526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96c6fc-3415-44b2-944c-bd8afc77a691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:16.953887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c6fc-3415-44b2-944c-bd8afc77a691 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:16.954320 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c6fc-3415-44b2-944c-bd8afc77a691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:16.954740 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c6fc-3415-44b2-944c-bd8afc77a691 admin admin] PATH_INFO: `/v3/projects/f04f0f2539b1478083370e056227afa3/users/1b69f2256a2c4a39aa1bc0def4548dc0/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:16.981630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96c6fc-3415-44b2-944c-bd8afc77a691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04f0f2539b1478083370e056227afa3, user_id=1b69f2256a2c4a39aa1bc0def4548dc0, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:16.985508 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96c6fc-3415-44b2-944c-bd8afc77a691 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:17.027193 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1207/2420] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:21:16 2022] PUT /identity/v3/projects/f04f0f2539b1478083370e056227afa3/users/1b69f2256a2c4a39aa1bc0def4548dc0/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:17.031186 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f16f9c-1ae3-4f73-b09f-2e1b34cc505d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:17.043645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f16f9c-1ae3-4f73-b09f-2e1b34cc505d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:17.138581 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f6612-72b3-44c3-8450-7d19f0e2a540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:17.139716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f6612-72b3-44c3-8450-7d19f0e2a540 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:17.139953 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f6612-72b3-44c3-8450-7d19f0e2a540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:17.140232 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f6612-72b3-44c3-8450-7d19f0e2a540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:17.141723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f6612-72b3-44c3-8450-7d19f0e2a540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:17.146889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f6612-72b3-44c3-8450-7d19f0e2a540 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:17.167492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1214/2421] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:17.172793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96c6fc-3415-44b2-944c-bd8afc77a691 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:17.191128 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96c6fc-3415-44b2-944c-bd8afc77a691 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:17.201697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c26072-0284-4795-9796-1dd918368556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:17.202870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c26072-0284-4795-9796-1dd918368556 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:17.203361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c26072-0284-4795-9796-1dd918368556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:17.203821 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c26072-0284-4795-9796-1dd918368556 admin admin] PATH_INFO: `/v3/projects/f04f0f2539b1478083370e056227afa3/users/1b69f2256a2c4a39aa1bc0def4548dc0/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:17.206991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c26072-0284-4795-9796-1dd918368556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04f0f2539b1478083370e056227afa3, user_id=1b69f2256a2c4a39aa1bc0def4548dc0, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:17.210784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c26072-0284-4795-9796-1dd918368556 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:17.220038 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:17.240530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1208/2422] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:21:17 2022] PUT /identity/v3/projects/f04f0f2539b1478083370e056227afa3/users/1b69f2256a2c4a39aa1bc0def4548dc0/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:17.242418 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892de4d9-ecd4-4eac-aa4d-c6e5e3d82958 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:17.242736 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892de4d9-ecd4-4eac-aa4d-c6e5e3d82958 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:17.243536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892de4d9-ecd4-4eac-aa4d-c6e5e3d82958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:17.279179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-892de4d9-ecd4-4eac-aa4d-c6e5e3d82958 None None] MFA Rules not processed for user `1b69f2256a2c4a39aa1bc0def4548dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:17.280433 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-892de4d9-ecd4-4eac-aa4d-c6e5e3d82958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:17.328348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:17.430666 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1215/2423] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:17.440745 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c26072-0284-4795-9796-1dd918368556 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:17.442487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e7c26072-0284-4795-9796-1dd918368556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:17.562183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c26072-0284-4795-9796-1dd918368556 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:17.571889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71198f-5cd3-4d57-a05f-3415c7ec0e98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:17.572569 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71198f-5cd3-4d57-a05f-3415c7ec0e98 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:17.572856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71198f-5cd3-4d57-a05f-3415c7ec0e98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:17.573132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71198f-5cd3-4d57-a05f-3415c7ec0e98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:17.584977 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71198f-5cd3-4d57-a05f-3415c7ec0e98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:17.586543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71198f-5cd3-4d57-a05f-3415c7ec0e98 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:17.599878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1209/2424] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:21:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:21:17.743984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892de4d9-ecd4-4eac-aa4d-c6e5e3d82958 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:17.760769 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892de4d9-ecd4-4eac-aa4d-c6e5e3d82958 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:17.768010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab179221-dadc-4e60-a2b4-b2f92cceb8a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:17.768917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab179221-dadc-4e60-a2b4-b2f92cceb8a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:17.769494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab179221-dadc-4e60-a2b4-b2f92cceb8a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:17.769962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab179221-dadc-4e60-a2b4-b2f92cceb8a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:17.881979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab179221-dadc-4e60-a2b4-b2f92cceb8a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:17.884596 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab179221-dadc-4e60-a2b4-b2f92cceb8a2 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:17.907111 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1216/2425] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:21:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:21:24.817546 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71198f-5cd3-4d57-a05f-3415c7ec0e98 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:24.888153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71198f-5cd3-4d57-a05f-3415c7ec0e98 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:24.894186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04fbcc-6d05-4593-bfd7-179a30bc6a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:24.895259 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04fbcc-6d05-4593-bfd7-179a30bc6a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:24.895552 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04fbcc-6d05-4593-bfd7-179a30bc6a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:24.896016 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04fbcc-6d05-4593-bfd7-179a30bc6a41 admin admin] PATH_INFO: `/v3/users/db39879b41d047e98baecf8c1cd6b11e` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:24.897573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04fbcc-6d05-4593-bfd7-179a30bc6a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db39879b41d047e98baecf8c1cd6b11e)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:24.899626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04fbcc-6d05-4593-bfd7-179a30bc6a41 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:24.954476 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ee04fbcc-6d05-4593-bfd7-179a30bc6a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db39879b41d047e98baecf8c1cd6b11e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:24.955126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ee04fbcc-6d05-4593-bfd7-179a30bc6a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db39879b41d047e98baecf8c1cd6b11e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:24.969116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ee04fbcc-6d05-4593-bfd7-179a30bc6a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db39879b41d047e98baecf8c1cd6b11e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:24.969832 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ee04fbcc-6d05-4593-bfd7-179a30bc6a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db39879b41d047e98baecf8c1cd6b11e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:24.983753 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ee04fbcc-6d05-4593-bfd7-179a30bc6a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db39879b41d047e98baecf8c1cd6b11e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:24.995605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:25.004880 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1210/2426] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:21:24 2022] DELETE /identity/v3/users/db39879b41d047e98baecf8c1cd6b11e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:25.006695 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5666a1-19a3-433f-9db1-607251b5cbf7 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:25.007220 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5666a1-19a3-433f-9db1-607251b5cbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:25.007354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5666a1-19a3-433f-9db1-607251b5cbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:25.025206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-8e5666a1-19a3-433f-9db1-607251b5cbf7 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:25.026570 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8e5666a1-19a3-433f-9db1-607251b5cbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:25.092807 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1217/2427] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:25.102347 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04fbcc-6d05-4593-bfd7-179a30bc6a41 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:25.103766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ee04fbcc-6d05-4593-bfd7-179a30bc6a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:25.166145 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04fbcc-6d05-4593-bfd7-179a30bc6a41 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:25.170557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadd814-54a0-4c8d-8d59-b2f1d23e106c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:25.171214 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadd814-54a0-4c8d-8d59-b2f1d23e106c service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:25.171503 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadd814-54a0-4c8d-8d59-b2f1d23e106c service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:25.171787 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadd814-54a0-4c8d-8d59-b2f1d23e106c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:25.181309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadd814-54a0-4c8d-8d59-b2f1d23e106c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:25.182874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbadd814-54a0-4c8d-8d59-b2f1d23e106c service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:25.193352 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1211/2428] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:21:25.468625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5666a1-19a3-433f-9db1-607251b5cbf7 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:25.470085 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8e5666a1-19a3-433f-9db1-607251b5cbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:25.483402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5666a1-19a3-433f-9db1-607251b5cbf7 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:25.488165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d9011-1e93-462e-9696-34d7baa349fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:25.489006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d9011-1e93-462e-9696-34d7baa349fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:25.489290 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d9011-1e93-462e-9696-34d7baa349fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:25.489568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d9011-1e93-462e-9696-34d7baa349fb admin admin] PATH_INFO: `/v3/projects/65cab64db8c14b948aeec05f41fccabf` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:25.490767 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d9011-1e93-462e-9696-34d7baa349fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=65cab64db8c14b948aeec05f41fccabf)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:25.492674 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d9011-1e93-462e-9696-34d7baa349fb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:25.549098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-784d9011-1e93-462e-9696-34d7baa349fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65cab64db8c14b948aeec05f41fccabf', 'request_id': 'req-784d9011-1e93-462e-9696-34d7baa349fb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:25.550283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:25.556018 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-784d9011-1e93-462e-9696-34d7baa349fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65cab64db8c14b948aeec05f41fccabf', 'request_id': 'req-784d9011-1e93-462e-9696-34d7baa349fb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:25.563881 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-784d9011-1e93-462e-9696-34d7baa349fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65cab64db8c14b948aeec05f41fccabf', 'request_id': 'req-784d9011-1e93-462e-9696-34d7baa349fb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:25.575533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-784d9011-1e93-462e-9696-34d7baa349fb admin admin] The token cache is being invalidate because project 65cab64db8c14b948aeec05f41fccabf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:21:25.575814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-784d9011-1e93-462e-9696-34d7baa349fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:25.576434 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-784d9011-1e93-462e-9696-34d7baa349fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:25.577956 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1218/2429] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:21:25 2022] DELETE /identity/v3/projects/65cab64db8c14b948aeec05f41fccabf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:25.581906 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadd814-54a0-4c8d-8d59-b2f1d23e106c service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:25.591727 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadd814-54a0-4c8d-8d59-b2f1d23e106c service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:25.650693 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d5788-3aa2-47f0-b9a5-07bab802c377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:25.651567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d5788-3aa2-47f0-b9a5-07bab802c377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:25.651851 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d5788-3aa2-47f0-b9a5-07bab802c377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:25.652140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d5788-3aa2-47f0-b9a5-07bab802c377 admin admin] PATH_INFO: `/v3/users/1b69f2256a2c4a39aa1bc0def4548dc0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:25.653613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d5788-3aa2-47f0-b9a5-07bab802c377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b69f2256a2c4a39aa1bc0def4548dc0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:25.655595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d5788-3aa2-47f0-b9a5-07bab802c377 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:25.720250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-231d5788-3aa2-47f0-b9a5-07bab802c377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b69f2256a2c4a39aa1bc0def4548dc0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:25.720842 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-231d5788-3aa2-47f0-b9a5-07bab802c377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b69f2256a2c4a39aa1bc0def4548dc0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:25.732994 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-231d5788-3aa2-47f0-b9a5-07bab802c377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b69f2256a2c4a39aa1bc0def4548dc0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:25.733664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-231d5788-3aa2-47f0-b9a5-07bab802c377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b69f2256a2c4a39aa1bc0def4548dc0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:25.740666 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-231d5788-3aa2-47f0-b9a5-07bab802c377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b69f2256a2c4a39aa1bc0def4548dc0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:25.756433 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1212/2430] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:21:25 2022] DELETE /identity/v3/users/1b69f2256a2c4a39aa1bc0def4548dc0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:26.067289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d9011-1e93-462e-9696-34d7baa349fb admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:26.069129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-784d9011-1e93-462e-9696-34d7baa349fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:26.086840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d9011-1e93-462e-9696-34d7baa349fb admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:26.158320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01f365-b8e3-41a3-81f5-00e7712612b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:26.166688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01f365-b8e3-41a3-81f5-00e7712612b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:26.166688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01f365-b8e3-41a3-81f5-00e7712612b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:26.166688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01f365-b8e3-41a3-81f5-00e7712612b3 admin admin] PATH_INFO: `/v3/projects/f04f0f2539b1478083370e056227afa3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:26.166688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01f365-b8e3-41a3-81f5-00e7712612b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04f0f2539b1478083370e056227afa3)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:26.166688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01f365-b8e3-41a3-81f5-00e7712612b3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:26.217558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5f01f365-b8e3-41a3-81f5-00e7712612b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04f0f2539b1478083370e056227afa3', 'request_id': 'req-5f01f365-b8e3-41a3-81f5-00e7712612b3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:26.227698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5f01f365-b8e3-41a3-81f5-00e7712612b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04f0f2539b1478083370e056227afa3', 'request_id': 'req-5f01f365-b8e3-41a3-81f5-00e7712612b3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:26.238160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5f01f365-b8e3-41a3-81f5-00e7712612b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04f0f2539b1478083370e056227afa3', 'request_id': 'req-5f01f365-b8e3-41a3-81f5-00e7712612b3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:26.254215 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5f01f365-b8e3-41a3-81f5-00e7712612b3 admin admin] The token cache is being invalidate because project f04f0f2539b1478083370e056227afa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:21:26.254456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5f01f365-b8e3-41a3-81f5-00e7712612b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:26.255716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-5f01f365-b8e3-41a3-81f5-00e7712612b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:26.256883 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1219/2431] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:21:26 2022] DELETE /identity/v3/projects/f04f0f2539b1478083370e056227afa3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:26.262589 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a1050-27d1-49d8-ba86-47f2f54ea21a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:26.263124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a1050-27d1-49d8-ba86-47f2f54ea21a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:26.263424 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a1050-27d1-49d8-ba86-47f2f54ea21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:26.301916 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-260a1050-27d1-49d8-ba86-47f2f54ea21a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:26.303337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-260a1050-27d1-49d8-ba86-47f2f54ea21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:26.330478 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:26.403592 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1213/2432] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:21:26.411154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b808a4-eace-4a7a-a53c-ccb2516a350a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:26.411448 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b808a4-eace-4a7a-a53c-ccb2516a350a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:26.411722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b808a4-eace-4a7a-a53c-ccb2516a350a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:26.436968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-03b808a4-eace-4a7a-a53c-ccb2516a350a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:26.442721 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-03b808a4-eace-4a7a-a53c-ccb2516a350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:26.448392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1220/2433] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:26.453508 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a1050-27d1-49d8-ba86-47f2f54ea21a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:26.466251 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a1050-27d1-49d8-ba86-47f2f54ea21a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:26.471543 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539dbc5-ee46-4f85-b52f-473a5b27a26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:26.472340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539dbc5-ee46-4f85-b52f-473a5b27a26b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:26.472698 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539dbc5-ee46-4f85-b52f-473a5b27a26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:26.473036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539dbc5-ee46-4f85-b52f-473a5b27a26b admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:26.473989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539dbc5-ee46-4f85-b52f-473a5b27a26b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:21:26.474389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539dbc5-ee46-4f85-b52f-473a5b27a26b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:26.476152 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539dbc5-ee46-4f85-b52f-473a5b27a26b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:26.497351 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1214/2434] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:21:26.498221 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b808a4-eace-4a7a-a53c-ccb2516a350a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:26.509527 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b808a4-eace-4a7a-a53c-ccb2516a350a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:26.517254 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9845c-1f21-4f29-97e6-627cc4084c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:26.517957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9845c-1f21-4f29-97e6-627cc4084c56 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:26.518235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9845c-1f21-4f29-97e6-627cc4084c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:26.518548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9845c-1f21-4f29-97e6-627cc4084c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:26.519283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9845c-1f21-4f29-97e6-627cc4084c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:26.521226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9845c-1f21-4f29-97e6-627cc4084c56 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:26.555440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1221/2435] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:21:26 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:21:26.557091 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539dbc5-ee46-4f85-b52f-473a5b27a26b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:26.570855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539dbc5-ee46-4f85-b52f-473a5b27a26b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:26.658054 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ce9c9-b424-41ec-a893-11aa37a3e6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:26.658811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ce9c9-b424-41ec-a893-11aa37a3e6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:26.659057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ce9c9-b424-41ec-a893-11aa37a3e6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:26.659334 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ce9c9-b424-41ec-a893-11aa37a3e6a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:26.660021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ce9c9-b424-41ec-a893-11aa37a3e6a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:26.661943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ce9c9-b424-41ec-a893-11aa37a3e6a6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:26.686236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1215/2436] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:21:26 2022] POST /identity/v3/users => generated 282 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:21:26.695341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9845c-1f21-4f29-97e6-627cc4084c56 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:26.709213 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9845c-1f21-4f29-97e6-627cc4084c56 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:26.714406 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f3a22-683b-4ee0-bcbb-07b7e3077944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:26.715274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f3a22-683b-4ee0-bcbb-07b7e3077944 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:26.715768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f3a22-683b-4ee0-bcbb-07b7e3077944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:26.716117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f3a22-683b-4ee0-bcbb-07b7e3077944 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:26.716955 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f3a22-683b-4ee0-bcbb-07b7e3077944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:26.718688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f3a22-683b-4ee0-bcbb-07b7e3077944 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:26.729922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1222/2437] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:26.734735 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ce9c9-b424-41ec-a893-11aa37a3e6a6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:26.744890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ce9c9-b424-41ec-a893-11aa37a3e6a6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:26.750334 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ab091-8c29-4e07-9233-e55ffe77fc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:26.750968 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ab091-8c29-4e07-9233-e55ffe77fc0d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:26.751245 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ab091-8c29-4e07-9233-e55ffe77fc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:26.751523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ab091-8c29-4e07-9233-e55ffe77fc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:26.752245 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ab091-8c29-4e07-9233-e55ffe77fc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:26.753849 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ab091-8c29-4e07-9233-e55ffe77fc0d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:26.766466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1216/2438] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:26.769819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f3a22-683b-4ee0-bcbb-07b7e3077944 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:26.781162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f3a22-683b-4ee0-bcbb-07b7e3077944 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:26.786719 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2c839-d34a-48d8-97df-88b2de1255ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:26.787699 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2c839-d34a-48d8-97df-88b2de1255ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:26.788058 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2c839-d34a-48d8-97df-88b2de1255ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:26.788409 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2c839-d34a-48d8-97df-88b2de1255ae admin admin] PATH_INFO: `/v3/projects/d80d44adec294c1c94ae6d9be4008dd6/users/8ca4af8445704524a8e1b229b78522d3/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:26.804335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2c839-d34a-48d8-97df-88b2de1255ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80d44adec294c1c94ae6d9be4008dd6, user_id=8ca4af8445704524a8e1b229b78522d3, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:26.807240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2c839-d34a-48d8-97df-88b2de1255ae admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:26.820465 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1223/2439] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:21:26 2022] PUT /identity/v3/projects/d80d44adec294c1c94ae6d9be4008dd6/users/8ca4af8445704524a8e1b229b78522d3/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:26.831401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e9318-6124-4621-a0c2-c2f6bb64a60a None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:26.831720 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e9318-6124-4621-a0c2-c2f6bb64a60a None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:26.831996 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e9318-6124-4621-a0c2-c2f6bb64a60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:26.860229 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-d05e9318-6124-4621-a0c2-c2f6bb64a60a None None] MFA Rules not processed for user `8ca4af8445704524a8e1b229b78522d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:26.861449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d05e9318-6124-4621-a0c2-c2f6bb64a60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:26.935792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1217/2440] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:26.940281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2c839-d34a-48d8-97df-88b2de1255ae admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:26.945870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:27.031909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2c839-d34a-48d8-97df-88b2de1255ae admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:27.037552 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a21e0-bc64-430d-b1e2-d80a5571b5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:27.038240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a21e0-bc64-430d-b1e2-d80a5571b5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:27.038560 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a21e0-bc64-430d-b1e2-d80a5571b5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:27.038844 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a21e0-bc64-430d-b1e2-d80a5571b5c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:27.039691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a21e0-bc64-430d-b1e2-d80a5571b5c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:27.041906 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a21e0-bc64-430d-b1e2-d80a5571b5c3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:27.068638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1224/2441] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:21:26 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:21:27.072909 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e9318-6124-4621-a0c2-c2f6bb64a60a None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:27.084755 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e9318-6124-4621-a0c2-c2f6bb64a60a None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:27.097811 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:27.148447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1eee2-8c09-49e5-bf2b-679c2cb65047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:27.149139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1eee2-8c09-49e5-bf2b-679c2cb65047 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:27.149428 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1eee2-8c09-49e5-bf2b-679c2cb65047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:27.149705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1eee2-8c09-49e5-bf2b-679c2cb65047 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:27.150403 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1eee2-8c09-49e5-bf2b-679c2cb65047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:27.153108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1eee2-8c09-49e5-bf2b-679c2cb65047 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:27.181597 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1218/2442] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:21:27 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:21:27.182894 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a21e0-bc64-430d-b1e2-d80a5571b5c3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:27.194705 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a21e0-bc64-430d-b1e2-d80a5571b5c3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:27.203184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933ce00-8991-4047-a588-aa952b087635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:27.204161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933ce00-8991-4047-a588-aa952b087635 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:27.204451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933ce00-8991-4047-a588-aa952b087635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:27.204903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933ce00-8991-4047-a588-aa952b087635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:27.205661 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933ce00-8991-4047-a588-aa952b087635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:27.207367 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933ce00-8991-4047-a588-aa952b087635 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:27.219370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1225/2443] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:27.223523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1eee2-8c09-49e5-bf2b-679c2cb65047 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:27.234668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1eee2-8c09-49e5-bf2b-679c2cb65047 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:27.239405 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195aecf-74c0-4e4a-8aa6-08a3ac1ae24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:27.240299 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195aecf-74c0-4e4a-8aa6-08a3ac1ae24d admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:27.240586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195aecf-74c0-4e4a-8aa6-08a3ac1ae24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:27.240865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195aecf-74c0-4e4a-8aa6-08a3ac1ae24d admin admin] PATH_INFO: `/v3/projects/3da3f6c0e7314c898770535021dd1b74/users/3e0be22ecb504e45a989dc84831b74bd/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:27.258923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195aecf-74c0-4e4a-8aa6-08a3ac1ae24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da3f6c0e7314c898770535021dd1b74, user_id=3e0be22ecb504e45a989dc84831b74bd, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:27.261498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195aecf-74c0-4e4a-8aa6-08a3ac1ae24d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:27.276635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1219/2444] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:21:27 2022] PUT /identity/v3/projects/3da3f6c0e7314c898770535021dd1b74/users/3e0be22ecb504e45a989dc84831b74bd/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:21:27.283029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933ce00-8991-4047-a588-aa952b087635 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:27.300147 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933ce00-8991-4047-a588-aa952b087635 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:27.365530 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a11dc2-46de-4110-a9f5-94e60c6adfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:27.367280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a11dc2-46de-4110-a9f5-94e60c6adfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:27.367742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a11dc2-46de-4110-a9f5-94e60c6adfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:27.368420 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a11dc2-46de-4110-a9f5-94e60c6adfd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:27.370071 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a11dc2-46de-4110-a9f5-94e60c6adfd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:27.373219 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a11dc2-46de-4110-a9f5-94e60c6adfd4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:27.384224 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1226/2445] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:27.389135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195aecf-74c0-4e4a-8aa6-08a3ac1ae24d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:27.399544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195aecf-74c0-4e4a-8aa6-08a3ac1ae24d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:27.405545 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671ab0e-2408-45d3-a6ff-bc247dc961a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:27.406673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671ab0e-2408-45d3-a6ff-bc247dc961a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:27.406806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671ab0e-2408-45d3-a6ff-bc247dc961a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:27.407076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671ab0e-2408-45d3-a6ff-bc247dc961a7 admin admin] PATH_INFO: `/v3/projects/3da3f6c0e7314c898770535021dd1b74/users/3e0be22ecb504e45a989dc84831b74bd/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:27.409084 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671ab0e-2408-45d3-a6ff-bc247dc961a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da3f6c0e7314c898770535021dd1b74, user_id=3e0be22ecb504e45a989dc84831b74bd, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:27.411807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671ab0e-2408-45d3-a6ff-bc247dc961a7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:27.424982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1220/2446] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:21:27 2022] PUT /identity/v3/projects/3da3f6c0e7314c898770535021dd1b74/users/3e0be22ecb504e45a989dc84831b74bd/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:27.437088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e2af1-ed9e-44b4-94c3-6a9d3e8cd9f2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:27.437389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e2af1-ed9e-44b4-94c3-6a9d3e8cd9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:27.437708 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e2af1-ed9e-44b4-94c3-6a9d3e8cd9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:27.469329 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-585e2af1-ed9e-44b4-94c3-6a9d3e8cd9f2 None None] MFA Rules not processed for user `3e0be22ecb504e45a989dc84831b74bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:27.470605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-585e2af1-ed9e-44b4-94c3-6a9d3e8cd9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:27.562628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:27.567088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1227/2447] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:27 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:27.582753 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671ab0e-2408-45d3-a6ff-bc247dc961a7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:27.587474 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4671ab0e-2408-45d3-a6ff-bc247dc961a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:27.673315 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671ab0e-2408-45d3-a6ff-bc247dc961a7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:27.678914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cd8a0-98c3-4340-8efc-a88711e4d845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:27.679879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cd8a0-98c3-4340-8efc-a88711e4d845 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:27.680131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cd8a0-98c3-4340-8efc-a88711e4d845 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:27.680414 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cd8a0-98c3-4340-8efc-a88711e4d845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:27.692998 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cd8a0-98c3-4340-8efc-a88711e4d845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:27.695579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cd8a0-98c3-4340-8efc-a88711e4d845 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:27.709369 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1221/2448] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:21:27 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:21:28.221618 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e2af1-ed9e-44b4-94c3-6a9d3e8cd9f2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:28.302217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e2af1-ed9e-44b4-94c3-6a9d3e8cd9f2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:28.308248 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a71bc-ea53-4661-9694-0a00f9df2c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:28.310086 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a71bc-ea53-4661-9694-0a00f9df2c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:28.310383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a71bc-ea53-4661-9694-0a00f9df2c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:28.310780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a71bc-ea53-4661-9694-0a00f9df2c1d admin admin] PATH_INFO: `/v3/users/8ca4af8445704524a8e1b229b78522d3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:28.312183 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a71bc-ea53-4661-9694-0a00f9df2c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca4af8445704524a8e1b229b78522d3)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:28.314133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a71bc-ea53-4661-9694-0a00f9df2c1d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:28.384211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f10a71bc-ea53-4661-9694-0a00f9df2c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca4af8445704524a8e1b229b78522d3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:28.402540 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f10a71bc-ea53-4661-9694-0a00f9df2c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca4af8445704524a8e1b229b78522d3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:28.403488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f10a71bc-ea53-4661-9694-0a00f9df2c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca4af8445704524a8e1b229b78522d3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:28.404194 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f10a71bc-ea53-4661-9694-0a00f9df2c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca4af8445704524a8e1b229b78522d3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:28.419584 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f10a71bc-ea53-4661-9694-0a00f9df2c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca4af8445704524a8e1b229b78522d3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:28.441102 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1228/2449] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:21:28 2022] DELETE /identity/v3/users/8ca4af8445704524a8e1b229b78522d3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:28.445512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9942491-a05c-4b0a-9826-9f034f363173 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:28.446015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9942491-a05c-4b0a-9826-9f034f363173 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:28.446270 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9942491-a05c-4b0a-9826-9f034f363173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:28.467259 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e9942491-a05c-4b0a-9826-9f034f363173 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:28.468534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e9942491-a05c-4b0a-9826-9f034f363173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:28.548244 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1222/2450] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:21:28.559691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a71bc-ea53-4661-9694-0a00f9df2c1d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:28.561061 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f10a71bc-ea53-4661-9694-0a00f9df2c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:28.666502 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a71bc-ea53-4661-9694-0a00f9df2c1d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:28.671407 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a6e19-65bc-4a1f-b3aa-495a12abe8af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:28.672092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a6e19-65bc-4a1f-b3aa-495a12abe8af service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:28.672363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a6e19-65bc-4a1f-b3aa-495a12abe8af service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:28.672642 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a6e19-65bc-4a1f-b3aa-495a12abe8af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:28.684703 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a6e19-65bc-4a1f-b3aa-495a12abe8af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:28.685817 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a6e19-65bc-4a1f-b3aa-495a12abe8af service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:28.703586 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1229/2451] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:21:28.991375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9942491-a05c-4b0a-9826-9f034f363173 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:28.992803 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e9942491-a05c-4b0a-9826-9f034f363173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:29.006792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9942491-a05c-4b0a-9826-9f034f363173 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:29.013680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:29.014597 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:29.014887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:29.015173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9 admin admin] PATH_INFO: `/v3/projects/d80d44adec294c1c94ae6d9be4008dd6` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:29.017578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d80d44adec294c1c94ae6d9be4008dd6)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:29.019776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:29.029712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:29.074553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80d44adec294c1c94ae6d9be4008dd6', 'request_id': 'req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:29.080117 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80d44adec294c1c94ae6d9be4008dd6', 'request_id': 'req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:29.087600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80d44adec294c1c94ae6d9be4008dd6', 'request_id': 'req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:29.099642 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9 admin admin] The token cache is being invalidate because project d80d44adec294c1c94ae6d9be4008dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:21:29.099931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:29.100558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:29.102089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1223/2452] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:21:28 2022] DELETE /identity/v3/projects/d80d44adec294c1c94ae6d9be4008dd6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:29.106744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a6e19-65bc-4a1f-b3aa-495a12abe8af service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:29.116477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a6e19-65bc-4a1f-b3aa-495a12abe8af service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:29.136692 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:29.180885 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b84bd-fa87-42db-b3da-1239eaddff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:29.181772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b84bd-fa87-42db-b3da-1239eaddff2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:29.182057 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b84bd-fa87-42db-b3da-1239eaddff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:29.182336 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b84bd-fa87-42db-b3da-1239eaddff2a admin admin] PATH_INFO: `/v3/users/3e0be22ecb504e45a989dc84831b74bd` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:29.184266 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b84bd-fa87-42db-b3da-1239eaddff2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0be22ecb504e45a989dc84831b74bd)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:29.186289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b84bd-fa87-42db-b3da-1239eaddff2a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:29.236612 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ad6b84bd-fa87-42db-b3da-1239eaddff2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0be22ecb504e45a989dc84831b74bd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:29.249278 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ad6b84bd-fa87-42db-b3da-1239eaddff2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0be22ecb504e45a989dc84831b74bd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:29.249979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ad6b84bd-fa87-42db-b3da-1239eaddff2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0be22ecb504e45a989dc84831b74bd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:29.250631 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ad6b84bd-fa87-42db-b3da-1239eaddff2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0be22ecb504e45a989dc84831b74bd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:29.257927 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ad6b84bd-fa87-42db-b3da-1239eaddff2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0be22ecb504e45a989dc84831b74bd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:29.272179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1230/2453] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:21:29 2022] DELETE /identity/v3/users/3e0be22ecb504e45a989dc84831b74bd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:29.572110 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:29.573690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:29.593674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9ac8b-8fa6-4abd-8bc1-19f1cb25d8e9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:29.656939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c00c2-aa8c-464d-be7b-3139190313c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:29.657720 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c00c2-aa8c-464d-be7b-3139190313c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:29.658009 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c00c2-aa8c-464d-be7b-3139190313c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:29.658287 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c00c2-aa8c-464d-be7b-3139190313c0 admin admin] PATH_INFO: `/v3/projects/3da3f6c0e7314c898770535021dd1b74` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:29.659519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c00c2-aa8c-464d-be7b-3139190313c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da3f6c0e7314c898770535021dd1b74)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:29.661412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c00c2-aa8c-464d-be7b-3139190313c0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:29.723397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-259c00c2-aa8c-464d-be7b-3139190313c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da3f6c0e7314c898770535021dd1b74', 'request_id': 'req-259c00c2-aa8c-464d-be7b-3139190313c0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:29.728862 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-259c00c2-aa8c-464d-be7b-3139190313c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da3f6c0e7314c898770535021dd1b74', 'request_id': 'req-259c00c2-aa8c-464d-be7b-3139190313c0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:29.736743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-259c00c2-aa8c-464d-be7b-3139190313c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da3f6c0e7314c898770535021dd1b74', 'request_id': 'req-259c00c2-aa8c-464d-be7b-3139190313c0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:29.749648 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-259c00c2-aa8c-464d-be7b-3139190313c0 admin admin] The token cache is being invalidate because project 3da3f6c0e7314c898770535021dd1b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:21:29.749938 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-259c00c2-aa8c-464d-be7b-3139190313c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:29.750639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-259c00c2-aa8c-464d-be7b-3139190313c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:21:29.752506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1224/2454] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:21:29 2022] DELETE /identity/v3/projects/3da3f6c0e7314c898770535021dd1b74 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:29.757357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e78396-205b-4021-9b08-baefef8a9c9c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:29.757653 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e78396-205b-4021-9b08-baefef8a9c9c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:29.757945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e78396-205b-4021-9b08-baefef8a9c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:29.785630 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-30e78396-205b-4021-9b08-baefef8a9c9c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:29.786891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-30e78396-205b-4021-9b08-baefef8a9c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:29.859961 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1231/2455] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:29.863086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002df4d-8c68-40f2-a253-83b8d3711c83 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:29.863389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002df4d-8c68-40f2-a253-83b8d3711c83 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:29.863685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002df4d-8c68-40f2-a253-83b8d3711c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:29.882104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f002df4d-8c68-40f2-a253-83b8d3711c83 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:29.883320 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f002df4d-8c68-40f2-a253-83b8d3711c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:29.892378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1225/2456] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:29.896622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e78396-205b-4021-9b08-baefef8a9c9c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:29.907503 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e78396-205b-4021-9b08-baefef8a9c9c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:29.912355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd5cfe-8239-4804-a6c4-7e656953bcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:29.913093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd5cfe-8239-4804-a6c4-7e656953bcfe admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:29.913350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd5cfe-8239-4804-a6c4-7e656953bcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:29.913634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd5cfe-8239-4804-a6c4-7e656953bcfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:29.914464 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd5cfe-8239-4804-a6c4-7e656953bcfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:21:29.914720 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd5cfe-8239-4804-a6c4-7e656953bcfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:29.916606 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd5cfe-8239-4804-a6c4-7e656953bcfe admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:29.938507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1232/2457] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:21:29.941206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002df4d-8c68-40f2-a253-83b8d3711c83 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:29.951254 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002df4d-8c68-40f2-a253-83b8d3711c83 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:29.955980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c9c9e-bb67-41fb-8feb-376fb96dc220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:29.956629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c9c9e-bb67-41fb-8feb-376fb96dc220 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:29.956912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c9c9e-bb67-41fb-8feb-376fb96dc220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:29.957186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c9c9e-bb67-41fb-8feb-376fb96dc220 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:29.957884 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c9c9e-bb67-41fb-8feb-376fb96dc220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:29.959800 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c9c9e-bb67-41fb-8feb-376fb96dc220 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:29.979915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:29.993061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1226/2458] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:21:29 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:21:29.994209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd5cfe-8239-4804-a6c4-7e656953bcfe admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:30.008280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd5cfe-8239-4804-a6c4-7e656953bcfe admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:30.035756 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:30.068158 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f682c6e-819b-4570-91a0-84d59c25ae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:30.068856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f682c6e-819b-4570-91a0-84d59c25ae34 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:30.069145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f682c6e-819b-4570-91a0-84d59c25ae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:30.069430 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f682c6e-819b-4570-91a0-84d59c25ae34 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:30.070139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f682c6e-819b-4570-91a0-84d59c25ae34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:30.072167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f682c6e-819b-4570-91a0-84d59c25ae34 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:30.100902 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1233/2459] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:21:29 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:21:30.105162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c9c9e-bb67-41fb-8feb-376fb96dc220 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:30.116948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c9c9e-bb67-41fb-8feb-376fb96dc220 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:30.123143 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83746d-1e78-46d3-aa39-946072f5c031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:30.123835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83746d-1e78-46d3-aa39-946072f5c031 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:30.124122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83746d-1e78-46d3-aa39-946072f5c031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:30.124396 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83746d-1e78-46d3-aa39-946072f5c031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:30.125118 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83746d-1e78-46d3-aa39-946072f5c031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:30.126746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83746d-1e78-46d3-aa39-946072f5c031 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:30.138395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1227/2460] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:30.142764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f682c6e-819b-4570-91a0-84d59c25ae34 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:30.154014 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f682c6e-819b-4570-91a0-84d59c25ae34 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:30.158779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45533c5-e044-43de-8000-76a9e878148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:30.159537 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45533c5-e044-43de-8000-76a9e878148f admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:30.159837 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45533c5-e044-43de-8000-76a9e878148f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:30.160123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45533c5-e044-43de-8000-76a9e878148f admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:30.160862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45533c5-e044-43de-8000-76a9e878148f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:30.162533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45533c5-e044-43de-8000-76a9e878148f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:30.183332 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1234/2461] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:30.187398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83746d-1e78-46d3-aa39-946072f5c031 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:30.197358 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83746d-1e78-46d3-aa39-946072f5c031 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:30.202664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e717a0-e055-45c9-940a-fb27e0ec3279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:30.203548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e717a0-e055-45c9-940a-fb27e0ec3279 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:30.203830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e717a0-e055-45c9-940a-fb27e0ec3279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:30.204118 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e717a0-e055-45c9-940a-fb27e0ec3279 admin admin] PATH_INFO: `/v3/projects/1d95f85011d048b78cef674403d42200/users/dc8e11a12094481ba63e0cf351f5f367/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:30.219582 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e717a0-e055-45c9-940a-fb27e0ec3279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d95f85011d048b78cef674403d42200, user_id=dc8e11a12094481ba63e0cf351f5f367, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:30.222244 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e717a0-e055-45c9-940a-fb27e0ec3279 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:30.236341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1228/2462] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:21:30 2022] PUT /identity/v3/projects/1d95f85011d048b78cef674403d42200/users/dc8e11a12094481ba63e0cf351f5f367/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:30.241490 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f4282-3eaf-4056-9593-1d0beb7b139d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:30.241968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f4282-3eaf-4056-9593-1d0beb7b139d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:30.242083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f4282-3eaf-4056-9593-1d0beb7b139d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:30.260809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ab5f4282-3eaf-4056-9593-1d0beb7b139d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:30.262762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ab5f4282-3eaf-4056-9593-1d0beb7b139d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:30.325041 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1235/2463] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:30.338333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e717a0-e055-45c9-940a-fb27e0ec3279 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:30.341273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-37e717a0-e055-45c9-940a-fb27e0ec3279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:30.406134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e717a0-e055-45c9-940a-fb27e0ec3279 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:30.410021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de018a4a-5c3f-4493-aaa4-8f86bbbcacc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:30.410659 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de018a4a-5c3f-4493-aaa4-8f86bbbcacc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:30.410951 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de018a4a-5c3f-4493-aaa4-8f86bbbcacc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:30.411231 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de018a4a-5c3f-4493-aaa4-8f86bbbcacc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:30.423006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de018a4a-5c3f-4493-aaa4-8f86bbbcacc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:30.424461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de018a4a-5c3f-4493-aaa4-8f86bbbcacc6 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:30.434175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1229/2464] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:21:31.010999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f4282-3eaf-4056-9593-1d0beb7b139d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:31.021685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f4282-3eaf-4056-9593-1d0beb7b139d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:31.026598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dbe79-10c6-47d3-a794-c4b6b90404e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:31.027921 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dbe79-10c6-47d3-a794-c4b6b90404e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:31.028206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dbe79-10c6-47d3-a794-c4b6b90404e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:31.028485 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dbe79-10c6-47d3-a794-c4b6b90404e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:31.030519 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e21dbe79-10c6-47d3-a794-c4b6b90404e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:31.060140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9373551-daa8-45df-9016-95d9f57c2118 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:31.060626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9373551-daa8-45df-9016-95d9f57c2118 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:31.060736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9373551-daa8-45df-9016-95d9f57c2118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:31.093341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f9373551-daa8-45df-9016-95d9f57c2118 None None] MFA Rules not processed for user `dc8e11a12094481ba63e0cf351f5f367`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:31.094628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f9373551-daa8-45df-9016-95d9f57c2118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:31.127614 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dbe79-10c6-47d3-a794-c4b6b90404e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:31.129371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dbe79-10c6-47d3-a794-c4b6b90404e2 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:31.144525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1236/2465] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:21:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:21:31.186004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1230/2466] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:21:31.190305 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dbe79-10c6-47d3-a794-c4b6b90404e2 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:31.203066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dbe79-10c6-47d3-a794-c4b6b90404e2 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:31.208209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d741c51-aee0-4d1e-864d-43f5955ad8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:31.208886 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d741c51-aee0-4d1e-864d-43f5955ad8bc admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:31.209420 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d741c51-aee0-4d1e-864d-43f5955ad8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:31.209775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d741c51-aee0-4d1e-864d-43f5955ad8bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:31.212107 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d741c51-aee0-4d1e-864d-43f5955ad8bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:31.213649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d741c51-aee0-4d1e-864d-43f5955ad8bc admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:31.272569 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9373551-daa8-45df-9016-95d9f57c2118 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:31.272784 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1237/2467] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:21:31 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:21:31.281961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9373551-daa8-45df-9016-95d9f57c2118 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:31.344049 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:31.353857 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc0389-c6eb-486f-ae93-3436b4bce3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:31.354819 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc0389-c6eb-486f-ae93-3436b4bce3dd admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:31.357690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc0389-c6eb-486f-ae93-3436b4bce3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:31.357979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc0389-c6eb-486f-ae93-3436b4bce3dd admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:31.358818 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc0389-c6eb-486f-ae93-3436b4bce3dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:31.360782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc0389-c6eb-486f-ae93-3436b4bce3dd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:31.383859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1231/2468] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:21:31 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:21:31.388832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d741c51-aee0-4d1e-864d-43f5955ad8bc admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:31.399553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d741c51-aee0-4d1e-864d-43f5955ad8bc admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:31.405333 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829f187-c604-4934-8eef-8fd7b69a0ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:31.406044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829f187-c604-4934-8eef-8fd7b69a0ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:31.406325 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829f187-c604-4934-8eef-8fd7b69a0ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:31.407260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829f187-c604-4934-8eef-8fd7b69a0ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:31.408017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829f187-c604-4934-8eef-8fd7b69a0ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:31.409631 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829f187-c604-4934-8eef-8fd7b69a0ee7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:31.415850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:31.426745 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1238/2469] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:31.428435 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc0389-c6eb-486f-ae93-3436b4bce3dd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:31.439066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc0389-c6eb-486f-ae93-3436b4bce3dd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:31.445191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f089abc-db81-4c06-b686-dd083e4dc98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:31.446095 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089abc-db81-4c06-b686-dd083e4dc98e admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:31.446476 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089abc-db81-4c06-b686-dd083e4dc98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:31.446690 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089abc-db81-4c06-b686-dd083e4dc98e admin admin] PATH_INFO: `/v3/projects/709bf8fe4aef4a5db231bdda11bc9ffc/users/ca750d88ba7345bb8c14457eb5c2ea78/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:31.467557 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f089abc-db81-4c06-b686-dd083e4dc98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=709bf8fe4aef4a5db231bdda11bc9ffc, user_id=ca750d88ba7345bb8c14457eb5c2ea78, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:31.470146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f089abc-db81-4c06-b686-dd083e4dc98e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:31.484203 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1232/2470] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:21:31 2022] PUT /identity/v3/projects/709bf8fe4aef4a5db231bdda11bc9ffc/users/ca750d88ba7345bb8c14457eb5c2ea78/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:21:31.488520 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829f187-c604-4934-8eef-8fd7b69a0ee7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:31.499549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829f187-c604-4934-8eef-8fd7b69a0ee7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:31.562593 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23986171-e768-4a6e-930b-fbba0c1645de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:31.563278 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23986171-e768-4a6e-930b-fbba0c1645de admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:31.563565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23986171-e768-4a6e-930b-fbba0c1645de admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:31.563845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23986171-e768-4a6e-930b-fbba0c1645de admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:31.564572 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23986171-e768-4a6e-930b-fbba0c1645de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:31.566166 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23986171-e768-4a6e-930b-fbba0c1645de admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:31.577233 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1239/2471] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:21:31.581366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f089abc-db81-4c06-b686-dd083e4dc98e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:31.592131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f089abc-db81-4c06-b686-dd083e4dc98e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:31.596666 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad9dcc-415c-4640-8dca-b8c2061a1abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:31.597573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad9dcc-415c-4640-8dca-b8c2061a1abc admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:31.597856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad9dcc-415c-4640-8dca-b8c2061a1abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:31.598129 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad9dcc-415c-4640-8dca-b8c2061a1abc admin admin] PATH_INFO: `/v3/projects/709bf8fe4aef4a5db231bdda11bc9ffc/users/ca750d88ba7345bb8c14457eb5c2ea78/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:31.600112 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad9dcc-415c-4640-8dca-b8c2061a1abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=709bf8fe4aef4a5db231bdda11bc9ffc, user_id=ca750d88ba7345bb8c14457eb5c2ea78, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:31.602826 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad9dcc-415c-4640-8dca-b8c2061a1abc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:31.613585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1233/2472] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:21:31 2022] PUT /identity/v3/projects/709bf8fe4aef4a5db231bdda11bc9ffc/users/ca750d88ba7345bb8c14457eb5c2ea78/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:21:32.221604 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e33cf-bdf0-4502-8303-331a6b1782ef None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:32.221952 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e33cf-bdf0-4502-8303-331a6b1782ef None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:32.222257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e33cf-bdf0-4502-8303-331a6b1782ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:32.251054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-464e33cf-bdf0-4502-8303-331a6b1782ef None None] MFA Rules not processed for user `ca750d88ba7345bb8c14457eb5c2ea78`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:32.252292 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-464e33cf-bdf0-4502-8303-331a6b1782ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:32.334448 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1240/2473] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:32.348155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b387e-b8a0-44d7-a49a-c28e6748c1d6 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:32.349280 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b387e-b8a0-44d7-a49a-c28e6748c1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:32.349747 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b387e-b8a0-44d7-a49a-c28e6748c1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:32.360236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e33cf-bdf0-4502-8303-331a6b1782ef None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:32.373131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4b1b387e-b8a0-44d7-a49a-c28e6748c1d6 None None] MFA Rules not processed for user `dc8e11a12094481ba63e0cf351f5f367`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:32.374933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4b1b387e-b8a0-44d7-a49a-c28e6748c1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:32.444526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e33cf-bdf0-4502-8303-331a6b1782ef None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:32.450797 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346506ca-60c5-4ad5-9f87-59d4220152ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:32.451512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1234/2474] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:21:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:32.451758 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346506ca-60c5-4ad5-9f87-59d4220152ec service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:32.452080 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346506ca-60c5-4ad5-9f87-59d4220152ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:32.452394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346506ca-60c5-4ad5-9f87-59d4220152ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:32.454328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-346506ca-60c5-4ad5-9f87-59d4220152ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:32.462868 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b387e-b8a0-44d7-a49a-c28e6748c1d6 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:32.464185 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4b1b387e-b8a0-44d7-a49a-c28e6748c1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:32.489773 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=100 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:32.531662 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346506ca-60c5-4ad5-9f87-59d4220152ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:32.533012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346506ca-60c5-4ad5-9f87-59d4220152ec service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:32.541712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b387e-b8a0-44d7-a49a-c28e6748c1d6 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:32.544533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1241/2475] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:21:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:21:32.548124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd348e2b-4e7f-48e4-b463-da7514044135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:32.548784 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd348e2b-4e7f-48e4-b463-da7514044135 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:32.549073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd348e2b-4e7f-48e4-b463-da7514044135 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:32.549355 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd348e2b-4e7f-48e4-b463-da7514044135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:32.557594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd348e2b-4e7f-48e4-b463-da7514044135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:32.559438 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd348e2b-4e7f-48e4-b463-da7514044135 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:32.568718 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1235/2476] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:21:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:21:38.473062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346506ca-60c5-4ad5-9f87-59d4220152ec service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:38.487956 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346506ca-60c5-4ad5-9f87-59d4220152ec service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:38.496812 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19b292-4153-4708-a662-693a25741efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:38.497777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19b292-4153-4708-a662-693a25741efc service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:38.498201 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19b292-4153-4708-a662-693a25741efc service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:38.498673 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19b292-4153-4708-a662-693a25741efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:38.501176 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1f19b292-4153-4708-a662-693a25741efc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:38.576235 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19b292-4153-4708-a662-693a25741efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:38.577907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19b292-4153-4708-a662-693a25741efc service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:38.588267 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1242/2477] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:21:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:21:42.564480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=78,keystone:INSERT=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:46.747570 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd348e2b-4e7f-48e4-b463-da7514044135 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:46.749045 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fd348e2b-4e7f-48e4-b463-da7514044135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:46.807463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd348e2b-4e7f-48e4-b463-da7514044135 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:46.811801 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5269e-09af-426f-91f4-2b9076f6f66c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:46.812443 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5269e-09af-426f-91f4-2b9076f6f66c service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:46.812726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5269e-09af-426f-91f4-2b9076f6f66c service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:46.813002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5269e-09af-426f-91f4-2b9076f6f66c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:46.821955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5269e-09af-426f-91f4-2b9076f6f66c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:46.823456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5269e-09af-426f-91f4-2b9076f6f66c service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:46.833437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1236/2478] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:21:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:21:48.583143 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=45 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:21:49.679162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19b292-4153-4708-a662-693a25741efc service nova] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:49.680590 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-1f19b292-4153-4708-a662-693a25741efc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:49.693359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19b292-4153-4708-a662-693a25741efc service nova] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:49.697140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90ef50-eaa4-41b7-9001-ca1e40924a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:49.697788 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90ef50-eaa4-41b7-9001-ca1e40924a21 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:49.698074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90ef50-eaa4-41b7-9001-ca1e40924a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:49.698354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90ef50-eaa4-41b7-9001-ca1e40924a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:49.700771 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-dc90ef50-eaa4-41b7-9001-ca1e40924a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:49.767545 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90ef50-eaa4-41b7-9001-ca1e40924a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:49.769233 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90ef50-eaa4-41b7-9001-ca1e40924a21 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:49.781636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1243/2479] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:21:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:21:49.820472 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dc82f-2612-406f-9810-57a8d0f3b435 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:49.821002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dc82f-2612-406f-9810-57a8d0f3b435 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:49.821002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dc82f-2612-406f-9810-57a8d0f3b435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:49.873616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-809dc82f-2612-406f-9810-57a8d0f3b435 None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:21:49.874879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-809dc82f-2612-406f-9810-57a8d0f3b435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:49.948027 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1237/2480] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 16 16:21:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:21:50.003173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90ef50-eaa4-41b7-9001-ca1e40924a21 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:50.004894 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-dc90ef50-eaa4-41b7-9001-ca1e40924a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:50.125893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90ef50-eaa4-41b7-9001-ca1e40924a21 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:50.131602 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c01044-16cf-4afb-8a05-93c74a6fec17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:50.132623 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c01044-16cf-4afb-8a05-93c74a6fec17 service swift] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:50.132623 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c01044-16cf-4afb-8a05-93c74a6fec17 service swift] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:50.132870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c01044-16cf-4afb-8a05-93c74a6fec17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:50.144222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c01044-16cf-4afb-8a05-93c74a6fec17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:50.145467 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c01044-16cf-4afb-8a05-93c74a6fec17 service swift] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:50.155362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1244/2481] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:21:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 16:21:53.342897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809dc82f-2612-406f-9810-57a8d0f3b435 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:21:53.357678 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809dc82f-2612-406f-9810-57a8d0f3b435 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:21:53.366693 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eddb1f-b84d-4d04-b205-456872c05ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:21:53.367524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eddb1f-b84d-4d04-b205-456872c05ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:21:53.367975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eddb1f-b84d-4d04-b205-456872c05ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:21:53.368766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eddb1f-b84d-4d04-b205-456872c05ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:21:53.372241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-34eddb1f-b84d-4d04-b205-456872c05ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:21:53.401667 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eddb1f-b84d-4d04-b205-456872c05ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:21:53.405484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eddb1f-b84d-4d04-b205-456872c05ed7 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:21:53.419002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1238/2482] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:21:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:00.151083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=71 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:03.413478 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=72 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:04.574726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c01044-16cf-4afb-8a05-93c74a6fec17 service swift] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:04.587439 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c01044-16cf-4afb-8a05-93c74a6fec17 service swift] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:04.588869 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631cc54-a0d0-463e-b43e-00c1563daa5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:04.589525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631cc54-a0d0-463e-b43e-00c1563daa5f service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:04.589812 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631cc54-a0d0-463e-b43e-00c1563daa5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:04.590093 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631cc54-a0d0-463e-b43e-00c1563daa5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:04.592691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2631cc54-a0d0-463e-b43e-00c1563daa5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:04.602651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631cc54-a0d0-463e-b43e-00c1563daa5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:04.604080 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631cc54-a0d0-463e-b43e-00c1563daa5f service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:04.612935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1245/2483] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:04.940155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eddb1f-b84d-4d04-b205-456872c05ed7 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:04.941687 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-34eddb1f-b84d-4d04-b205-456872c05ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:05.017734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eddb1f-b84d-4d04-b205-456872c05ed7 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:05.023014 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66973d3-2a11-4de4-ac25-21f80e0294c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e8222d303aa487ca2b5c5bed6124f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:05.023667 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66973d3-2a11-4de4-ac25-21f80e0294c1 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:05.023952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66973d3-2a11-4de4-ac25-21f80e0294c1 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:05.024232 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66973d3-2a11-4de4-ac25-21f80e0294c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:05.026093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b66973d3-2a11-4de4-ac25-21f80e0294c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:05.038665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66973d3-2a11-4de4-ac25-21f80e0294c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:05.040666 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66973d3-2a11-4de4-ac25-21f80e0294c1 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:05.051804 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1239/2484] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:06.849330 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8f9a8-492f-4444-bb0e-0be56f96b0c5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:06.849793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8f9a8-492f-4444-bb0e-0be56f96b0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:06.849920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8f9a8-492f-4444-bb0e-0be56f96b0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:06.868352 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-fda8f9a8-492f-4444-bb0e-0be56f96b0c5 None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:06.869585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fda8f9a8-492f-4444-bb0e-0be56f96b0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:06.877148 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1246/2485] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 16 16:22:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:06.889100 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66973d3-2a11-4de4-ac25-21f80e0294c1 service placement] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:06.900179 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66973d3-2a11-4de4-ac25-21f80e0294c1 service placement] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:06.906665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19900b5b-960e-41b7-92b6-eb947e86b803 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:06.907309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19900b5b-960e-41b7-92b6-eb947e86b803 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:06.907588 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19900b5b-960e-41b7-92b6-eb947e86b803 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:06.907861 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19900b5b-960e-41b7-92b6-eb947e86b803 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:06.916489 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19900b5b-960e-41b7-92b6-eb947e86b803 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:06.918056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19900b5b-960e-41b7-92b6-eb947e86b803 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:06.926794 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1240/2486] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:22:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 16:22:07.913675 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8f9a8-492f-4444-bb0e-0be56f96b0c5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:07.927245 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8f9a8-492f-4444-bb0e-0be56f96b0c5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:07.932746 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e91038-2312-4653-b4fc-ee0c865a94b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e8222d303aa487ca2b5c5bed6124f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:07.933421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e91038-2312-4653-b4fc-ee0c865a94b6 service placement] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:07.933730 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e91038-2312-4653-b4fc-ee0c865a94b6 service placement] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:07.934041 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e91038-2312-4653-b4fc-ee0c865a94b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:07.936384 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e5e91038-2312-4653-b4fc-ee0c865a94b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:07.948901 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e91038-2312-4653-b4fc-ee0c865a94b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:07.951421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e91038-2312-4653-b4fc-ee0c865a94b6 service placement] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:07.978853 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1247/2487] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:08.632632 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19900b5b-960e-41b7-92b6-eb947e86b803 service swift] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:08.712002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19900b5b-960e-41b7-92b6-eb947e86b803 service swift] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:08.717328 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769484f-e60c-44f6-9832-47a98276ceef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:08.718366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769484f-e60c-44f6-9832-47a98276ceef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:08.718678 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769484f-e60c-44f6-9832-47a98276ceef admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:08.718955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769484f-e60c-44f6-9832-47a98276ceef admin admin] PATH_INFO: `/v3/users/dc8e11a12094481ba63e0cf351f5f367` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:08.720136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769484f-e60c-44f6-9832-47a98276ceef admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8e11a12094481ba63e0cf351f5f367)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:08.722872 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769484f-e60c-44f6-9832-47a98276ceef admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:08.777831 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0769484f-e60c-44f6-9832-47a98276ceef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8e11a12094481ba63e0cf351f5f367'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:08.778447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0769484f-e60c-44f6-9832-47a98276ceef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8e11a12094481ba63e0cf351f5f367'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:08.791448 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0769484f-e60c-44f6-9832-47a98276ceef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8e11a12094481ba63e0cf351f5f367'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:08.792140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0769484f-e60c-44f6-9832-47a98276ceef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8e11a12094481ba63e0cf351f5f367'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:08.799904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0769484f-e60c-44f6-9832-47a98276ceef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8e11a12094481ba63e0cf351f5f367'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:08.804035 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:08.819304 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1241/2488] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:22:08 2022] DELETE /identity/v3/users/dc8e11a12094481ba63e0cf351f5f367 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:22:09.015534 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e91038-2312-4653-b4fc-ee0c865a94b6 service placement] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:09.027723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e91038-2312-4653-b4fc-ee0c865a94b6 service placement] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:09.095016 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92409e49-685a-4d81-8630-f82bc3f49d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:09.095939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92409e49-685a-4d81-8630-f82bc3f49d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:09.096420 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92409e49-685a-4d81-8630-f82bc3f49d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:09.096668 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92409e49-685a-4d81-8630-f82bc3f49d9a admin admin] PATH_INFO: `/v3/projects/1d95f85011d048b78cef674403d42200` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:09.097914 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92409e49-685a-4d81-8630-f82bc3f49d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d95f85011d048b78cef674403d42200)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:09.099882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92409e49-685a-4d81-8630-f82bc3f49d9a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:09.154536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-92409e49-685a-4d81-8630-f82bc3f49d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d95f85011d048b78cef674403d42200', 'request_id': 'req-92409e49-685a-4d81-8630-f82bc3f49d9a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:09.160140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-92409e49-685a-4d81-8630-f82bc3f49d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d95f85011d048b78cef674403d42200', 'request_id': 'req-92409e49-685a-4d81-8630-f82bc3f49d9a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:09.170918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-92409e49-685a-4d81-8630-f82bc3f49d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d95f85011d048b78cef674403d42200', 'request_id': 'req-92409e49-685a-4d81-8630-f82bc3f49d9a'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:09.185628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-92409e49-685a-4d81-8630-f82bc3f49d9a admin admin] The token cache is being invalidate because project 1d95f85011d048b78cef674403d42200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:22:09.186279 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-92409e49-685a-4d81-8630-f82bc3f49d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:09.187239 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-92409e49-685a-4d81-8630-f82bc3f49d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:09.189735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1248/2489] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:22:09 2022] DELETE /identity/v3/projects/1d95f85011d048b78cef674403d42200 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:09.193896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769484f-e60c-44f6-9832-47a98276ceef admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:09.195627 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0769484f-e60c-44f6-9832-47a98276ceef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:09.210605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769484f-e60c-44f6-9832-47a98276ceef admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:09.279711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89031855-85de-4fff-b03b-90fb33841f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:09.280489 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89031855-85de-4fff-b03b-90fb33841f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:09.280768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89031855-85de-4fff-b03b-90fb33841f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:09.281040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89031855-85de-4fff-b03b-90fb33841f1d admin admin] PATH_INFO: `/v3/users/ca750d88ba7345bb8c14457eb5c2ea78` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:09.282236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89031855-85de-4fff-b03b-90fb33841f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca750d88ba7345bb8c14457eb5c2ea78)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:09.284255 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89031855-85de-4fff-b03b-90fb33841f1d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:09.338678 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-89031855-85de-4fff-b03b-90fb33841f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca750d88ba7345bb8c14457eb5c2ea78'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:09.339344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-89031855-85de-4fff-b03b-90fb33841f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca750d88ba7345bb8c14457eb5c2ea78'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:09.358670 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-89031855-85de-4fff-b03b-90fb33841f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca750d88ba7345bb8c14457eb5c2ea78'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:09.359468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-89031855-85de-4fff-b03b-90fb33841f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca750d88ba7345bb8c14457eb5c2ea78'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:09.366525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-89031855-85de-4fff-b03b-90fb33841f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca750d88ba7345bb8c14457eb5c2ea78'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:09.379724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1242/2490] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:22:09 2022] DELETE /identity/v3/users/ca750d88ba7345bb8c14457eb5c2ea78 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:22:09.611184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92409e49-685a-4d81-8630-f82bc3f49d9a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:09.612268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-92409e49-685a-4d81-8630-f82bc3f49d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:09.627622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92409e49-685a-4d81-8630-f82bc3f49d9a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:09.713701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:09.736340 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b4d2c-1437-435d-96f7-ca029eb06341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:09.737441 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4d2c-1437-435d-96f7-ca029eb06341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:09.737739 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4d2c-1437-435d-96f7-ca029eb06341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:09.738088 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4d2c-1437-435d-96f7-ca029eb06341 admin admin] PATH_INFO: `/v3/projects/709bf8fe4aef4a5db231bdda11bc9ffc` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:09.739736 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b4d2c-1437-435d-96f7-ca029eb06341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=709bf8fe4aef4a5db231bdda11bc9ffc)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:09.742048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b4d2c-1437-435d-96f7-ca029eb06341 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:09.796741 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e17b4d2c-1437-435d-96f7-ca029eb06341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '709bf8fe4aef4a5db231bdda11bc9ffc', 'request_id': 'req-e17b4d2c-1437-435d-96f7-ca029eb06341'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:09.802648 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e17b4d2c-1437-435d-96f7-ca029eb06341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '709bf8fe4aef4a5db231bdda11bc9ffc', 'request_id': 'req-e17b4d2c-1437-435d-96f7-ca029eb06341'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:09.810689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e17b4d2c-1437-435d-96f7-ca029eb06341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '709bf8fe4aef4a5db231bdda11bc9ffc', 'request_id': 'req-e17b4d2c-1437-435d-96f7-ca029eb06341'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:09.829175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e17b4d2c-1437-435d-96f7-ca029eb06341 admin admin] The token cache is being invalidate because project 709bf8fe4aef4a5db231bdda11bc9ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:22:09.829468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e17b4d2c-1437-435d-96f7-ca029eb06341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:09.830120 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e17b4d2c-1437-435d-96f7-ca029eb06341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:09.831701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1249/2491] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:22:09 2022] DELETE /identity/v3/projects/709bf8fe4aef4a5db231bdda11bc9ffc => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:09.836711 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e601fe-ff13-4d40-9d80-5822925c0ddf None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:09.837183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e601fe-ff13-4d40-9d80-5822925c0ddf None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:09.837279 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e601fe-ff13-4d40-9d80-5822925c0ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:09.855556 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-91e601fe-ff13-4d40-9d80-5822925c0ddf None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:09.857440 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-91e601fe-ff13-4d40-9d80-5822925c0ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:09.922157 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1243/2492] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:09.930618 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074f4f1-01a7-4d50-9753-7ee2d29fae79 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:09.931096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074f4f1-01a7-4d50-9753-7ee2d29fae79 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:09.931548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074f4f1-01a7-4d50-9753-7ee2d29fae79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:09.951827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-c074f4f1-01a7-4d50-9753-7ee2d29fae79 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:09.953176 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c074f4f1-01a7-4d50-9753-7ee2d29fae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:09.961728 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1250/2493] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:09.966836 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e601fe-ff13-4d40-9d80-5822925c0ddf None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:09.977517 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e601fe-ff13-4d40-9d80-5822925c0ddf None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:09.983734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef96f5-4b6b-4518-8c7d-13c488406116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:09.984416 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef96f5-4b6b-4518-8c7d-13c488406116 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:09.984788 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef96f5-4b6b-4518-8c7d-13c488406116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:09.985076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef96f5-4b6b-4518-8c7d-13c488406116 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:09.985910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef96f5-4b6b-4518-8c7d-13c488406116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:22:09.986225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef96f5-4b6b-4518-8c7d-13c488406116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:09.988227 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef96f5-4b6b-4518-8c7d-13c488406116 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:10.004644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1244/2494] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:22:10.006089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074f4f1-01a7-4d50-9753-7ee2d29fae79 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:10.017335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074f4f1-01a7-4d50-9753-7ee2d29fae79 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:10.023141 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def817e-18fe-45a0-924c-647546d3f525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:10.023807 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def817e-18fe-45a0-924c-647546d3f525 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:10.024094 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def817e-18fe-45a0-924c-647546d3f525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:10.024375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def817e-18fe-45a0-924c-647546d3f525 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:10.025501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def817e-18fe-45a0-924c-647546d3f525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:10.027132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def817e-18fe-45a0-924c-647546d3f525 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:10.060139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1251/2495] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:22:10 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:22:10.064434 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef96f5-4b6b-4518-8c7d-13c488406116 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:10.069877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:10.077444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef96f5-4b6b-4518-8c7d-13c488406116 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:10.170728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509cfed-05f2-4148-a0a0-9c88e6264a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:10.172002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509cfed-05f2-4148-a0a0-9c88e6264a94 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:10.172521 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509cfed-05f2-4148-a0a0-9c88e6264a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:10.174096 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509cfed-05f2-4148-a0a0-9c88e6264a94 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:10.175113 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509cfed-05f2-4148-a0a0-9c88e6264a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:10.177122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509cfed-05f2-4148-a0a0-9c88e6264a94 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:10.201939 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1245/2496] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:22:10 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:22:10.206010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def817e-18fe-45a0-924c-647546d3f525 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:10.217350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def817e-18fe-45a0-924c-647546d3f525 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:10.221982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9740010-3baa-450c-b026-f56ab8b96fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:10.222683 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9740010-3baa-450c-b026-f56ab8b96fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:10.223022 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9740010-3baa-450c-b026-f56ab8b96fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:10.223362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9740010-3baa-450c-b026-f56ab8b96fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:10.224137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9740010-3baa-450c-b026-f56ab8b96fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:10.225825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9740010-3baa-450c-b026-f56ab8b96fd6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:10.240081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1252/2497] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:22:10.241430 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509cfed-05f2-4148-a0a0-9c88e6264a94 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:10.252347 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509cfed-05f2-4148-a0a0-9c88e6264a94 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:10.258351 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bca789-ee5b-4d9a-84c7-47010eb710f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:10.259074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bca789-ee5b-4d9a-84c7-47010eb710f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:10.259364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bca789-ee5b-4d9a-84c7-47010eb710f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:10.259623 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bca789-ee5b-4d9a-84c7-47010eb710f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:10.260349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bca789-ee5b-4d9a-84c7-47010eb710f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:10.261958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bca789-ee5b-4d9a-84c7-47010eb710f5 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:10.273498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1246/2498] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:22:10.277637 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9740010-3baa-450c-b026-f56ab8b96fd6 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:10.289476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9740010-3baa-450c-b026-f56ab8b96fd6 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:10.295612 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83cc00-8d08-4651-aecb-32691763bd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:10.296520 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83cc00-8d08-4651-aecb-32691763bd0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:10.296823 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83cc00-8d08-4651-aecb-32691763bd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:10.297223 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83cc00-8d08-4651-aecb-32691763bd0f admin admin] PATH_INFO: `/v3/projects/779e094b993c4fa394d5a02c7f3523a3/users/9756b56e279b41fea2b122b30844d2d8/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:10.314669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83cc00-8d08-4651-aecb-32691763bd0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=779e094b993c4fa394d5a02c7f3523a3, user_id=9756b56e279b41fea2b122b30844d2d8, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:10.317279 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83cc00-8d08-4651-aecb-32691763bd0f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:10.331639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1253/2499] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:22:10 2022] PUT /identity/v3/projects/779e094b993c4fa394d5a02c7f3523a3/users/9756b56e279b41fea2b122b30844d2d8/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:10.342077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a6c84-b7dc-4429-8cf1-30960234f013 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:10.342365 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a6c84-b7dc-4429-8cf1-30960234f013 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:10.342673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a6c84-b7dc-4429-8cf1-30960234f013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:10.379954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-8e0a6c84-b7dc-4429-8cf1-30960234f013 None None] MFA Rules not processed for user `9756b56e279b41fea2b122b30844d2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:10.381686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8e0a6c84-b7dc-4429-8cf1-30960234f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:10.453127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1247/2500] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:10.464766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83cc00-8d08-4651-aecb-32691763bd0f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:10.467111 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7a83cc00-8d08-4651-aecb-32691763bd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:10.534125 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83cc00-8d08-4651-aecb-32691763bd0f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:10.539237 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987dce76-17e3-4c6b-9958-d6221bf0c5c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:10.539908 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987dce76-17e3-4c6b-9958-d6221bf0c5c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:10.540196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987dce76-17e3-4c6b-9958-d6221bf0c5c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:10.540478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987dce76-17e3-4c6b-9958-d6221bf0c5c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:10.550624 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987dce76-17e3-4c6b-9958-d6221bf0c5c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:10.552086 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987dce76-17e3-4c6b-9958-d6221bf0c5c7 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:10.563134 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1254/2501] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:20.449077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:20.557342 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:21.764516 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a6c84-b7dc-4429-8cf1-30960234f013 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:21.766062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8e0a6c84-b7dc-4429-8cf1-30960234f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:21.860191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a6c84-b7dc-4429-8cf1-30960234f013 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:21.868206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5bc84-6a86-4eff-a867-596468d1713a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:21.868807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5bc84-6a86-4eff-a867-596468d1713a service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:21.869092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5bc84-6a86-4eff-a867-596468d1713a service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:21.869395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5bc84-6a86-4eff-a867-596468d1713a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:21.871234 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5ab5bc84-6a86-4eff-a867-596468d1713a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:21.884935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5bc84-6a86-4eff-a867-596468d1713a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:21.886564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5bc84-6a86-4eff-a867-596468d1713a service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:21.902914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1248/2502] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:22.310543 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987dce76-17e3-4c6b-9958-d6221bf0c5c7 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:22.390368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987dce76-17e3-4c6b-9958-d6221bf0c5c7 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:22.396277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b7890-c740-4321-892e-99ded8a6212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:22.397587 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b7890-c740-4321-892e-99ded8a6212f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:22.398052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b7890-c740-4321-892e-99ded8a6212f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:22.398347 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b7890-c740-4321-892e-99ded8a6212f admin admin] PATH_INFO: `/v3/users/9756b56e279b41fea2b122b30844d2d8` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:22.399687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b7890-c740-4321-892e-99ded8a6212f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9756b56e279b41fea2b122b30844d2d8)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:22.402102 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b7890-c740-4321-892e-99ded8a6212f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:22.458621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b38b7890-c740-4321-892e-99ded8a6212f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9756b56e279b41fea2b122b30844d2d8'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:22.475955 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b38b7890-c740-4321-892e-99ded8a6212f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9756b56e279b41fea2b122b30844d2d8'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:22.478353 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b38b7890-c740-4321-892e-99ded8a6212f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9756b56e279b41fea2b122b30844d2d8'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:22.479059 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b38b7890-c740-4321-892e-99ded8a6212f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9756b56e279b41fea2b122b30844d2d8'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:22.489000 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b38b7890-c740-4321-892e-99ded8a6212f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9756b56e279b41fea2b122b30844d2d8'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:22.509581 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1255/2503] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:22:22 2022] DELETE /identity/v3/users/9756b56e279b41fea2b122b30844d2d8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:22.515436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90536b-a268-4308-8093-44069e09373d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:22.515628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90536b-a268-4308-8093-44069e09373d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:22.515892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90536b-a268-4308-8093-44069e09373d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:22.534298 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-fe90536b-a268-4308-8093-44069e09373d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:22.535555 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fe90536b-a268-4308-8093-44069e09373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:22.598654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1249/2504] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:22.608295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b7890-c740-4321-892e-99ded8a6212f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:22.609727 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b38b7890-c740-4321-892e-99ded8a6212f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:22.667895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b7890-c740-4321-892e-99ded8a6212f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:22.671899 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982234c7-b168-46e4-a110-eff00202a9b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:22.672587 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982234c7-b168-46e4-a110-eff00202a9b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:22.672876 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982234c7-b168-46e4-a110-eff00202a9b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:22.673159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982234c7-b168-46e4-a110-eff00202a9b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:22.682769 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982234c7-b168-46e4-a110-eff00202a9b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:22.684217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982234c7-b168-46e4-a110-eff00202a9b3 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:22.694865 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1256/2505] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:22.980377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90536b-a268-4308-8093-44069e09373d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:22.982370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fe90536b-a268-4308-8093-44069e09373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:23.012686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90536b-a268-4308-8093-44069e09373d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:23.031217 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab9d6d-9772-4345-9f42-f8cc8c4becaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:23.032087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab9d6d-9772-4345-9f42-f8cc8c4becaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:23.032368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab9d6d-9772-4345-9f42-f8cc8c4becaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:23.032643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab9d6d-9772-4345-9f42-f8cc8c4becaa admin admin] PATH_INFO: `/v3/projects/779e094b993c4fa394d5a02c7f3523a3` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:23.033897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab9d6d-9772-4345-9f42-f8cc8c4becaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=779e094b993c4fa394d5a02c7f3523a3)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:23.035866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab9d6d-9772-4345-9f42-f8cc8c4becaa admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:23.123617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-65ab9d6d-9772-4345-9f42-f8cc8c4becaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779e094b993c4fa394d5a02c7f3523a3', 'request_id': 'req-65ab9d6d-9772-4345-9f42-f8cc8c4becaa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:23.132070 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-65ab9d6d-9772-4345-9f42-f8cc8c4becaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779e094b993c4fa394d5a02c7f3523a3', 'request_id': 'req-65ab9d6d-9772-4345-9f42-f8cc8c4becaa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:23.146809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-65ab9d6d-9772-4345-9f42-f8cc8c4becaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779e094b993c4fa394d5a02c7f3523a3', 'request_id': 'req-65ab9d6d-9772-4345-9f42-f8cc8c4becaa'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:23.163162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-65ab9d6d-9772-4345-9f42-f8cc8c4becaa admin admin] The token cache is being invalidate because project 779e094b993c4fa394d5a02c7f3523a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:22:23.163805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-65ab9d6d-9772-4345-9f42-f8cc8c4becaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:23.164723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-65ab9d6d-9772-4345-9f42-f8cc8c4becaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:23.170807 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1250/2506] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:22:22 2022] DELETE /identity/v3/projects/779e094b993c4fa394d5a02c7f3523a3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:23.172596 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864a4f6-b30e-49ba-a6a1-41b58fac9538 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:23.173305 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864a4f6-b30e-49ba-a6a1-41b58fac9538 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:23.173598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864a4f6-b30e-49ba-a6a1-41b58fac9538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:23.196084 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-8864a4f6-b30e-49ba-a6a1-41b58fac9538 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:23.197304 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8864a4f6-b30e-49ba-a6a1-41b58fac9538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:23.217254 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:23.262777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1257/2507] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:23.271205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b154c-081f-4f68-be9f-15ad8ba7bce9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:23.271488 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b154c-081f-4f68-be9f-15ad8ba7bce9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:23.271760 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b154c-081f-4f68-be9f-15ad8ba7bce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:23.293971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2d4b154c-081f-4f68-be9f-15ad8ba7bce9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:23.296117 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2d4b154c-081f-4f68-be9f-15ad8ba7bce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:23.303979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1251/2508] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:23.308184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864a4f6-b30e-49ba-a6a1-41b58fac9538 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:23.317975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864a4f6-b30e-49ba-a6a1-41b58fac9538 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:23.322642 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950aabb-fb62-4895-8392-e8a95f84f875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:23.323297 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950aabb-fb62-4895-8392-e8a95f84f875 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:23.323583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950aabb-fb62-4895-8392-e8a95f84f875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:23.323862 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950aabb-fb62-4895-8392-e8a95f84f875 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:23.324579 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950aabb-fb62-4895-8392-e8a95f84f875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:22:23.324888 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950aabb-fb62-4895-8392-e8a95f84f875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:23.326756 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950aabb-fb62-4895-8392-e8a95f84f875 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:23.338507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1258/2509] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:22:23.343463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b154c-081f-4f68-be9f-15ad8ba7bce9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:23.348043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:23.354702 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b154c-081f-4f68-be9f-15ad8ba7bce9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:23.361404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b498ee-862e-4b3b-94e5-3d7750bc9a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:23.362060 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b498ee-862e-4b3b-94e5-3d7750bc9a69 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:23.362369 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b498ee-862e-4b3b-94e5-3d7750bc9a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:23.362697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b498ee-862e-4b3b-94e5-3d7750bc9a69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:23.363403 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b498ee-862e-4b3b-94e5-3d7750bc9a69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:23.365308 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b498ee-862e-4b3b-94e5-3d7750bc9a69 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:23.391958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1252/2510] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:22:23 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:22:23.396175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950aabb-fb62-4895-8392-e8a95f84f875 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:23.407330 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950aabb-fb62-4895-8392-e8a95f84f875 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:23.464663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348e3cc-af23-4eea-bbe7-1019411c5823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:23.465339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e3cc-af23-4eea-bbe7-1019411c5823 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:23.465627 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e3cc-af23-4eea-bbe7-1019411c5823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:23.465912 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e3cc-af23-4eea-bbe7-1019411c5823 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:23.467701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348e3cc-af23-4eea-bbe7-1019411c5823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:23.469569 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348e3cc-af23-4eea-bbe7-1019411c5823 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:23.490811 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1259/2511] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:22:23 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:22:23.494992 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b498ee-862e-4b3b-94e5-3d7750bc9a69 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:23.505348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b498ee-862e-4b3b-94e5-3d7750bc9a69 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:23.509896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aacbb4-caa1-48e8-8c1b-3ffce0d4da96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:23.510593 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aacbb4-caa1-48e8-8c1b-3ffce0d4da96 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:23.510874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aacbb4-caa1-48e8-8c1b-3ffce0d4da96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:23.511150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aacbb4-caa1-48e8-8c1b-3ffce0d4da96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:23.511870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aacbb4-caa1-48e8-8c1b-3ffce0d4da96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:23.513491 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aacbb4-caa1-48e8-8c1b-3ffce0d4da96 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:23.523959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1253/2512] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:22:23.528063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348e3cc-af23-4eea-bbe7-1019411c5823 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:23.539138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348e3cc-af23-4eea-bbe7-1019411c5823 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:23.543750 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04b2ea-e506-473a-9edf-ca6ad296f238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:23.545046 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b2ea-e506-473a-9edf-ca6ad296f238 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:23.545330 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b2ea-e506-473a-9edf-ca6ad296f238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:23.545604 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b2ea-e506-473a-9edf-ca6ad296f238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:23.546348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04b2ea-e506-473a-9edf-ca6ad296f238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:23.547965 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04b2ea-e506-473a-9edf-ca6ad296f238 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:23.561061 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1260/2513] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:22:23.562032 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aacbb4-caa1-48e8-8c1b-3ffce0d4da96 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:23.572273 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aacbb4-caa1-48e8-8c1b-3ffce0d4da96 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:23.579867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039549d-387f-4550-96c3-f69acf625849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:23.580758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039549d-387f-4550-96c3-f69acf625849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:23.581037 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039549d-387f-4550-96c3-f69acf625849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:23.581340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039549d-387f-4550-96c3-f69acf625849 admin admin] PATH_INFO: `/v3/projects/ad85c2c9a93340dea47b685117579917/users/8d13efeaf05243a683848e85202d8520/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:23.598149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039549d-387f-4550-96c3-f69acf625849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad85c2c9a93340dea47b685117579917, user_id=8d13efeaf05243a683848e85202d8520, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:23.600845 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039549d-387f-4550-96c3-f69acf625849 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:23.615133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1254/2514] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:22:23 2022] PUT /identity/v3/projects/ad85c2c9a93340dea47b685117579917/users/8d13efeaf05243a683848e85202d8520/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:23.625173 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c13aae-27e8-4460-bb47-1a0f0cc36ca2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:23.625361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c13aae-27e8-4460-bb47-1a0f0cc36ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:23.625643 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c13aae-27e8-4460-bb47-1a0f0cc36ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:23.653121 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-26c13aae-27e8-4460-bb47-1a0f0cc36ca2 None None] MFA Rules not processed for user `8d13efeaf05243a683848e85202d8520`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:23.654986 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-26c13aae-27e8-4460-bb47-1a0f0cc36ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:23.722208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1261/2515] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:23.726761 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039549d-387f-4550-96c3-f69acf625849 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:23.789261 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039549d-387f-4550-96c3-f69acf625849 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:23.794275 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d737bd0-aaf4-4240-8eee-31537bed3663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:23.795400 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d737bd0-aaf4-4240-8eee-31537bed3663 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:23.795871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d737bd0-aaf4-4240-8eee-31537bed3663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:23.795871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d737bd0-aaf4-4240-8eee-31537bed3663 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:23.796445 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d737bd0-aaf4-4240-8eee-31537bed3663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:23.798583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d737bd0-aaf4-4240-8eee-31537bed3663 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:23.824930 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1255/2516] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:22:23 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:22:23.827929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c13aae-27e8-4460-bb47-1a0f0cc36ca2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:23.838649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c13aae-27e8-4460-bb47-1a0f0cc36ca2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:23.851779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:23.900477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d884e0-8cdb-443d-9cc7-c2544340c6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:23.901168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d884e0-8cdb-443d-9cc7-c2544340c6ae admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:23.901456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d884e0-8cdb-443d-9cc7-c2544340c6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:23.901734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d884e0-8cdb-443d-9cc7-c2544340c6ae admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:23.902421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d884e0-8cdb-443d-9cc7-c2544340c6ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:23.905001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d884e0-8cdb-443d-9cc7-c2544340c6ae admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:23.926051 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1262/2517] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:22:23 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:22:23.929846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d737bd0-aaf4-4240-8eee-31537bed3663 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:23.941171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d737bd0-aaf4-4240-8eee-31537bed3663 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:23.945773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf6cca-5a02-4394-b79f-251229b8eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:23.946467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf6cca-5a02-4394-b79f-251229b8eeba admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:23.946739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf6cca-5a02-4394-b79f-251229b8eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:23.947015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf6cca-5a02-4394-b79f-251229b8eeba admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:23.947735 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf6cca-5a02-4394-b79f-251229b8eeba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:23.949386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf6cca-5a02-4394-b79f-251229b8eeba admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:23.963980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1256/2518] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:22:23.965392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d884e0-8cdb-443d-9cc7-c2544340c6ae admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:23.976624 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d884e0-8cdb-443d-9cc7-c2544340c6ae admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:23.982340 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e7389-a192-46b7-b343-17388e495acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:23.983402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e7389-a192-46b7-b343-17388e495acd admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:23.983915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e7389-a192-46b7-b343-17388e495acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:23.984434 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e7389-a192-46b7-b343-17388e495acd admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:23.985832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e7389-a192-46b7-b343-17388e495acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:23.987740 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e7389-a192-46b7-b343-17388e495acd admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:24.000748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1263/2519] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:22:24.004921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf6cca-5a02-4394-b79f-251229b8eeba admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:24.017565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf6cca-5a02-4394-b79f-251229b8eeba admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:24.022309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce786e5-e83f-4c2a-ad57-cfd061a80074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:24.023230 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce786e5-e83f-4c2a-ad57-cfd061a80074 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:24.023518 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce786e5-e83f-4c2a-ad57-cfd061a80074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:24.023800 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce786e5-e83f-4c2a-ad57-cfd061a80074 admin admin] PATH_INFO: `/v3/projects/525ea45cae704c6498dfa17a62829897/users/21e50e4b74d74534a69c5811bcf0efda/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:24.040411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce786e5-e83f-4c2a-ad57-cfd061a80074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=525ea45cae704c6498dfa17a62829897, user_id=21e50e4b74d74534a69c5811bcf0efda, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:24.043138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce786e5-e83f-4c2a-ad57-cfd061a80074 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:24.057284 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1257/2520] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:22:24 2022] PUT /identity/v3/projects/525ea45cae704c6498dfa17a62829897/users/21e50e4b74d74534a69c5811bcf0efda/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:24.068077 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7660-136e-4be1-b648-e2755087b6f5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:24.068561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7660-136e-4be1-b648-e2755087b6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:24.068848 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7660-136e-4be1-b648-e2755087b6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:24.101247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2fbf7660-136e-4be1-b648-e2755087b6f5 None None] MFA Rules not processed for user `21e50e4b74d74534a69c5811bcf0efda`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:24.102827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2fbf7660-136e-4be1-b648-e2755087b6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:24.178501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1264/2521] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:22:24.182832 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce786e5-e83f-4c2a-ad57-cfd061a80074 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:24.249522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:24.253615 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce786e5-e83f-4c2a-ad57-cfd061a80074 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:24.260395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab22d4-7722-4e60-8815-e83c839dda3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:24.261127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab22d4-7722-4e60-8815-e83c839dda3d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:24.261414 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab22d4-7722-4e60-8815-e83c839dda3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:24.261695 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab22d4-7722-4e60-8815-e83c839dda3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:24.262397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab22d4-7722-4e60-8815-e83c839dda3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:24.264912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab22d4-7722-4e60-8815-e83c839dda3d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:24.297256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1258/2522] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:22:24 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:22:24.299288 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf7660-136e-4be1-b648-e2755087b6f5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:24.314149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf7660-136e-4be1-b648-e2755087b6f5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:24.377423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25e5dd-1211-43b1-9346-a10fb2d27015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:24.378327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25e5dd-1211-43b1-9346-a10fb2d27015 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:24.378664 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25e5dd-1211-43b1-9346-a10fb2d27015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:24.379075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25e5dd-1211-43b1-9346-a10fb2d27015 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:24.379781 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25e5dd-1211-43b1-9346-a10fb2d27015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:24.381870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25e5dd-1211-43b1-9346-a10fb2d27015 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:24.407250 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1265/2523] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:22:24 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:22:24.411257 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab22d4-7722-4e60-8815-e83c839dda3d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:24.422650 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab22d4-7722-4e60-8815-e83c839dda3d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:24.427358 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ebb38-e582-4fdb-81b8-fef3aa2a8883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:24.428012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ebb38-e582-4fdb-81b8-fef3aa2a8883 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:24.428294 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ebb38-e582-4fdb-81b8-fef3aa2a8883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:24.428569 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ebb38-e582-4fdb-81b8-fef3aa2a8883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:24.429286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ebb38-e582-4fdb-81b8-fef3aa2a8883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:24.430921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ebb38-e582-4fdb-81b8-fef3aa2a8883 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:24.441960 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1259/2524] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:22:24.446160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25e5dd-1211-43b1-9346-a10fb2d27015 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:24.456916 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25e5dd-1211-43b1-9346-a10fb2d27015 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:24.461595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee73d1-1408-447a-ab22-504c9251c7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:24.462516 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee73d1-1408-447a-ab22-504c9251c7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:24.462810 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee73d1-1408-447a-ab22-504c9251c7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:24.463094 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee73d1-1408-447a-ab22-504c9251c7ce admin admin] PATH_INFO: `/v3/projects/fc89b796a79444e3a87ea835da748c96/users/e018a3344c5d48e2b69926e8d8cb94b1/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:24.476297 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:24.479956 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee73d1-1408-447a-ab22-504c9251c7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc89b796a79444e3a87ea835da748c96, user_id=e018a3344c5d48e2b69926e8d8cb94b1, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:24.484168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee73d1-1408-447a-ab22-504c9251c7ce admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:24.498492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1266/2525] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:22:24 2022] PUT /identity/v3/projects/fc89b796a79444e3a87ea835da748c96/users/e018a3344c5d48e2b69926e8d8cb94b1/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:24.502538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ebb38-e582-4fdb-81b8-fef3aa2a8883 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:24.512840 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ebb38-e582-4fdb-81b8-fef3aa2a8883 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:24.572553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3aec1-006d-4abd-a0ed-6d5e3a325344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:24.573232 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3aec1-006d-4abd-a0ed-6d5e3a325344 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:24.573519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3aec1-006d-4abd-a0ed-6d5e3a325344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:24.573798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3aec1-006d-4abd-a0ed-6d5e3a325344 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:24.574565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3aec1-006d-4abd-a0ed-6d5e3a325344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:24.576199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3aec1-006d-4abd-a0ed-6d5e3a325344 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:24.589599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1260/2526] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:22:24.589757 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94a868-df08-458c-887c-42b191bb45ae None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:24.589757 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94a868-df08-458c-887c-42b191bb45ae None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:24.589757 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94a868-df08-458c-887c-42b191bb45ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:24.590741 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3aec1-006d-4abd-a0ed-6d5e3a325344 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:24.601136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3aec1-006d-4abd-a0ed-6d5e3a325344 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:24.606344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdbf65-d3ce-4012-93c0-c2cc3143f5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:24.608431 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdbf65-d3ce-4012-93c0-c2cc3143f5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:24.608833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdbf65-d3ce-4012-93c0-c2cc3143f5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:24.609120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdbf65-d3ce-4012-93c0-c2cc3143f5bf admin admin] PATH_INFO: `/v3/projects/fc89b796a79444e3a87ea835da748c96/users/e018a3344c5d48e2b69926e8d8cb94b1/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:24.609565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-7c94a868-df08-458c-887c-42b191bb45ae None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:24.610824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7c94a868-df08-458c-887c-42b191bb45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:24.611167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdbf65-d3ce-4012-93c0-c2cc3143f5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc89b796a79444e3a87ea835da748c96, user_id=e018a3344c5d48e2b69926e8d8cb94b1, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:24.613995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdbf65-d3ce-4012-93c0-c2cc3143f5bf admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:24.627224 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1261/2527] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:22:24 2022] PUT /identity/v3/projects/fc89b796a79444e3a87ea835da748c96/users/e018a3344c5d48e2b69926e8d8cb94b1/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:22:24.639780 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05daeb-06f3-427a-aae9-c6ce71b6989e None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:24.640086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05daeb-06f3-427a-aae9-c6ce71b6989e None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:24.640377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05daeb-06f3-427a-aae9-c6ce71b6989e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:24.671360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7c05daeb-06f3-427a-aae9-c6ce71b6989e None None] MFA Rules not processed for user `e018a3344c5d48e2b69926e8d8cb94b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:24.672587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7c05daeb-06f3-427a-aae9-c6ce71b6989e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:24.677399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1267/2528] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jun 16 16:22:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:22:24.691696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94a868-df08-458c-887c-42b191bb45ae None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:24.693341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7c94a868-df08-458c-887c-42b191bb45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:24.744976 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1262/2529] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:22:24.755933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05daeb-06f3-427a-aae9-c6ce71b6989e None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:24.757269 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7c05daeb-06f3-427a-aae9-c6ce71b6989e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:24.766219 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94a868-df08-458c-887c-42b191bb45ae None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:24.800771 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:24.816569 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05daeb-06f3-427a-aae9-c6ce71b6989e None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:24.820220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd177a94-a4c1-43d8-9c97-6871a6e47493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:24.821012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd177a94-a4c1-43d8-9c97-6871a6e47493 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:24.821297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd177a94-a4c1-43d8-9c97-6871a6e47493 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:24.821397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd177a94-a4c1-43d8-9c97-6871a6e47493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:24.825826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d0c30-7fa6-435f-bbcf-31f0d51c40a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:24.826496 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d0c30-7fa6-435f-bbcf-31f0d51c40a6 service swift] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:24.826798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d0c30-7fa6-435f-bbcf-31f0d51c40a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:24.827055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d0c30-7fa6-435f-bbcf-31f0d51c40a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:24.869154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:24.880998 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd177a94-a4c1-43d8-9c97-6871a6e47493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:24.882471 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd177a94-a4c1-43d8-9c97-6871a6e47493 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:24.886177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d0c30-7fa6-435f-bbcf-31f0d51c40a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:24.887809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d0c30-7fa6-435f-bbcf-31f0d51c40a6 service swift] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:24.892597 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1263/2530] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:22:24.896332 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1268/2531] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:22:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 16:22:26.415207 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd177a94-a4c1-43d8-9c97-6871a6e47493 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:26.416611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cd177a94-a4c1-43d8-9c97-6871a6e47493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:26.429463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd177a94-a4c1-43d8-9c97-6871a6e47493 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:26.433056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909d55d-7bd3-4bd8-ba0a-cefa8607cb64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:26.433727 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909d55d-7bd3-4bd8-ba0a-cefa8607cb64 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:26.434065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909d55d-7bd3-4bd8-ba0a-cefa8607cb64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:26.434348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909d55d-7bd3-4bd8-ba0a-cefa8607cb64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:26.495425 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909d55d-7bd3-4bd8-ba0a-cefa8607cb64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:26.496878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909d55d-7bd3-4bd8-ba0a-cefa8607cb64 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:26.508362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1264/2532] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:27.071438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d0c30-7fa6-435f-bbcf-31f0d51c40a6 service swift] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:27.081630 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d0c30-7fa6-435f-bbcf-31f0d51c40a6 service swift] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:27.085479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc845d36-17b1-4686-a127-ba46f66c725f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:27.086153 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc845d36-17b1-4686-a127-ba46f66c725f service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:27.086462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc845d36-17b1-4686-a127-ba46f66c725f service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:27.086802 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc845d36-17b1-4686-a127-ba46f66c725f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:27.097279 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc845d36-17b1-4686-a127-ba46f66c725f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:27.098766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc845d36-17b1-4686-a127-ba46f66c725f service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:27.109440 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1269/2533] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:30.954406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909d55d-7bd3-4bd8-ba0a-cefa8607cb64 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:31.024532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909d55d-7bd3-4bd8-ba0a-cefa8607cb64 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:31.030160 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d9f71-6dab-40f2-9c02-2212d8e0152a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:31.031095 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d9f71-6dab-40f2-9c02-2212d8e0152a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:31.031379 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d9f71-6dab-40f2-9c02-2212d8e0152a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:31.031664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d9f71-6dab-40f2-9c02-2212d8e0152a admin admin] PATH_INFO: `/v3/users/8d13efeaf05243a683848e85202d8520` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:31.032869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d9f71-6dab-40f2-9c02-2212d8e0152a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d13efeaf05243a683848e85202d8520)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:31.034956 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d9f71-6dab-40f2-9c02-2212d8e0152a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:31.072436 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:31.086228 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a80d9f71-6dab-40f2-9c02-2212d8e0152a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d13efeaf05243a683848e85202d8520'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:31.087073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a80d9f71-6dab-40f2-9c02-2212d8e0152a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d13efeaf05243a683848e85202d8520'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:31.103156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a80d9f71-6dab-40f2-9c02-2212d8e0152a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d13efeaf05243a683848e85202d8520'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:31.103875 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a80d9f71-6dab-40f2-9c02-2212d8e0152a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d13efeaf05243a683848e85202d8520'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:31.111185 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a80d9f71-6dab-40f2-9c02-2212d8e0152a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d13efeaf05243a683848e85202d8520'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:31.124674 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1265/2534] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:22:30 2022] DELETE /identity/v3/users/8d13efeaf05243a683848e85202d8520 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:31.129238 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8326ae1-ed10-4982-a51c-c9df5d1b32d0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:31.129715 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8326ae1-ed10-4982-a51c-c9df5d1b32d0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:31.129949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8326ae1-ed10-4982-a51c-c9df5d1b32d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:31.149765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e8326ae1-ed10-4982-a51c-c9df5d1b32d0 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:31.151167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e8326ae1-ed10-4982-a51c-c9df5d1b32d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:31.221920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1270/2535] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:31.228277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d9f71-6dab-40f2-9c02-2212d8e0152a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:31.231596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a80d9f71-6dab-40f2-9c02-2212d8e0152a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:31.232447 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8326ae1-ed10-4982-a51c-c9df5d1b32d0 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:31.233929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e8326ae1-ed10-4982-a51c-c9df5d1b32d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:31.329376 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8326ae1-ed10-4982-a51c-c9df5d1b32d0 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:31.335971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da88b2f-eb71-4543-9c4a-fc22e1cfb408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:31.337408 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da88b2f-eb71-4543-9c4a-fc22e1cfb408 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:31.338068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da88b2f-eb71-4543-9c4a-fc22e1cfb408 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:31.339374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d9f71-6dab-40f2-9c02-2212d8e0152a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:31.339912 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da88b2f-eb71-4543-9c4a-fc22e1cfb408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:31.355277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd007e4f-f333-4459-8255-894d604d690d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:31.355884 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da88b2f-eb71-4543-9c4a-fc22e1cfb408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:31.356035 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd007e4f-f333-4459-8255-894d604d690d service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:31.356236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd007e4f-f333-4459-8255-894d604d690d service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:31.356649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd007e4f-f333-4459-8255-894d604d690d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:31.359453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da88b2f-eb71-4543-9c4a-fc22e1cfb408 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:31.371569 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-bd007e4f-f333-4459-8255-894d604d690d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:31.379208 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1271/2536] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:31.394416 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd007e4f-f333-4459-8255-894d604d690d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:31.396106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd007e4f-f333-4459-8255-894d604d690d service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:31.420902 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1266/2537] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:31.763658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da88b2f-eb71-4543-9c4a-fc22e1cfb408 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:31.766354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2da88b2f-eb71-4543-9c4a-fc22e1cfb408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:31.789053 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da88b2f-eb71-4543-9c4a-fc22e1cfb408 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:31.795013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18250a-b272-4ab5-b995-292c8167aaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:31.796066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18250a-b272-4ab5-b995-292c8167aaeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:31.796349 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18250a-b272-4ab5-b995-292c8167aaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:31.796634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18250a-b272-4ab5-b995-292c8167aaeb admin admin] PATH_INFO: `/v3/projects/ad85c2c9a93340dea47b685117579917` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:31.807691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18250a-b272-4ab5-b995-292c8167aaeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad85c2c9a93340dea47b685117579917)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:31.810559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18250a-b272-4ab5-b995-292c8167aaeb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:31.912706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3b18250a-b272-4ab5-b995-292c8167aaeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad85c2c9a93340dea47b685117579917', 'request_id': 'req-3b18250a-b272-4ab5-b995-292c8167aaeb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:31.921191 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3b18250a-b272-4ab5-b995-292c8167aaeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad85c2c9a93340dea47b685117579917', 'request_id': 'req-3b18250a-b272-4ab5-b995-292c8167aaeb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:31.932158 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3b18250a-b272-4ab5-b995-292c8167aaeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad85c2c9a93340dea47b685117579917', 'request_id': 'req-3b18250a-b272-4ab5-b995-292c8167aaeb'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:31.934204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:31.953537 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3b18250a-b272-4ab5-b995-292c8167aaeb admin admin] The token cache is being invalidate because project ad85c2c9a93340dea47b685117579917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:22:31.953845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3b18250a-b272-4ab5-b995-292c8167aaeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:31.954864 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3b18250a-b272-4ab5-b995-292c8167aaeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:31.956983 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1272/2538] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:22:31 2022] DELETE /identity/v3/projects/ad85c2c9a93340dea47b685117579917 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:31.961829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd007e4f-f333-4459-8255-894d604d690d service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:31.975409 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd007e4f-f333-4459-8255-894d604d690d service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:32.047209 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047058c0-f39e-42d0-9e18-5502e894dfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:32.048100 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047058c0-f39e-42d0-9e18-5502e894dfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:32.048386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047058c0-f39e-42d0-9e18-5502e894dfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:32.048667 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047058c0-f39e-42d0-9e18-5502e894dfcb admin admin] PATH_INFO: `/v3/users/21e50e4b74d74534a69c5811bcf0efda` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:32.049905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047058c0-f39e-42d0-9e18-5502e894dfcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e50e4b74d74534a69c5811bcf0efda)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:32.051896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047058c0-f39e-42d0-9e18-5502e894dfcb admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:32.096669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:32.109317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-047058c0-f39e-42d0-9e18-5502e894dfcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e50e4b74d74534a69c5811bcf0efda'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:32.109975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-047058c0-f39e-42d0-9e18-5502e894dfcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e50e4b74d74534a69c5811bcf0efda'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:32.123864 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-047058c0-f39e-42d0-9e18-5502e894dfcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e50e4b74d74534a69c5811bcf0efda'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:32.124484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-047058c0-f39e-42d0-9e18-5502e894dfcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e50e4b74d74534a69c5811bcf0efda'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:32.131796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-047058c0-f39e-42d0-9e18-5502e894dfcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e50e4b74d74534a69c5811bcf0efda'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:32.146820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1267/2539] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:22:31 2022] DELETE /identity/v3/users/21e50e4b74d74534a69c5811bcf0efda => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:32.448568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18250a-b272-4ab5-b995-292c8167aaeb admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:32.450259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3b18250a-b272-4ab5-b995-292c8167aaeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:32.479528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18250a-b272-4ab5-b995-292c8167aaeb admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:32.541825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245daff-1e31-4334-9bfd-b5f5398c4480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:32.543637 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245daff-1e31-4334-9bfd-b5f5398c4480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:32.545123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245daff-1e31-4334-9bfd-b5f5398c4480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:32.545335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245daff-1e31-4334-9bfd-b5f5398c4480 admin admin] PATH_INFO: `/v3/projects/525ea45cae704c6498dfa17a62829897` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:32.546805 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245daff-1e31-4334-9bfd-b5f5398c4480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=525ea45cae704c6498dfa17a62829897)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:32.548773 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245daff-1e31-4334-9bfd-b5f5398c4480 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:32.601660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a245daff-1e31-4334-9bfd-b5f5398c4480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '525ea45cae704c6498dfa17a62829897', 'request_id': 'req-a245daff-1e31-4334-9bfd-b5f5398c4480'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:32.607073 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a245daff-1e31-4334-9bfd-b5f5398c4480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '525ea45cae704c6498dfa17a62829897', 'request_id': 'req-a245daff-1e31-4334-9bfd-b5f5398c4480'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:32.614063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a245daff-1e31-4334-9bfd-b5f5398c4480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '525ea45cae704c6498dfa17a62829897', 'request_id': 'req-a245daff-1e31-4334-9bfd-b5f5398c4480'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:32.625355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a245daff-1e31-4334-9bfd-b5f5398c4480 admin admin] The token cache is being invalidate because project 525ea45cae704c6498dfa17a62829897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:22:32.625639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a245daff-1e31-4334-9bfd-b5f5398c4480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:32.626268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-a245daff-1e31-4334-9bfd-b5f5398c4480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:32.627853 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1273/2540] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:22:32 2022] DELETE /identity/v3/projects/525ea45cae704c6498dfa17a62829897 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:32.631830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047058c0-f39e-42d0-9e18-5502e894dfcb admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:32.633221 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-047058c0-f39e-42d0-9e18-5502e894dfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:32.646476 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047058c0-f39e-42d0-9e18-5502e894dfcb admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:32.707434 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4bc8a-08fe-4c01-8d11-090f454ef531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:32.708350 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4bc8a-08fe-4c01-8d11-090f454ef531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:32.708639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4bc8a-08fe-4c01-8d11-090f454ef531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:32.708921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4bc8a-08fe-4c01-8d11-090f454ef531 admin admin] PATH_INFO: `/v3/users/e018a3344c5d48e2b69926e8d8cb94b1` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:32.710156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4bc8a-08fe-4c01-8d11-090f454ef531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e018a3344c5d48e2b69926e8d8cb94b1)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:32.712531 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4bc8a-08fe-4c01-8d11-090f454ef531 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:32.768562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4ef4bc8a-08fe-4c01-8d11-090f454ef531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e018a3344c5d48e2b69926e8d8cb94b1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:32.769266 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4ef4bc8a-08fe-4c01-8d11-090f454ef531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e018a3344c5d48e2b69926e8d8cb94b1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:32.783259 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4ef4bc8a-08fe-4c01-8d11-090f454ef531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e018a3344c5d48e2b69926e8d8cb94b1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:32.783962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4ef4bc8a-08fe-4c01-8d11-090f454ef531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e018a3344c5d48e2b69926e8d8cb94b1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:32.791539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4ef4bc8a-08fe-4c01-8d11-090f454ef531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e018a3344c5d48e2b69926e8d8cb94b1'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:32.805149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1268/2541] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:22:32 2022] DELETE /identity/v3/users/e018a3344c5d48e2b69926e8d8cb94b1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:33.251809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245daff-1e31-4334-9bfd-b5f5398c4480 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:33.253437 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a245daff-1e31-4334-9bfd-b5f5398c4480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:33.267029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245daff-1e31-4334-9bfd-b5f5398c4480 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:33.355199 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7b089-4614-4aeb-ae38-dbee722bf970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:33.356100 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b089-4614-4aeb-ae38-dbee722bf970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:33.356919 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b089-4614-4aeb-ae38-dbee722bf970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:33.357199 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b089-4614-4aeb-ae38-dbee722bf970 admin admin] PATH_INFO: `/v3/projects/fc89b796a79444e3a87ea835da748c96` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:33.358666 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7b089-4614-4aeb-ae38-dbee722bf970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc89b796a79444e3a87ea835da748c96)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:33.361310 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7b089-4614-4aeb-ae38-dbee722bf970 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:33.405749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:33.431766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-17a7b089-4614-4aeb-ae38-dbee722bf970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc89b796a79444e3a87ea835da748c96', 'request_id': 'req-17a7b089-4614-4aeb-ae38-dbee722bf970'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:33.440114 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-17a7b089-4614-4aeb-ae38-dbee722bf970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc89b796a79444e3a87ea835da748c96', 'request_id': 'req-17a7b089-4614-4aeb-ae38-dbee722bf970'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:33.449870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-17a7b089-4614-4aeb-ae38-dbee722bf970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc89b796a79444e3a87ea835da748c96', 'request_id': 'req-17a7b089-4614-4aeb-ae38-dbee722bf970'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:33.464956 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-17a7b089-4614-4aeb-ae38-dbee722bf970 admin admin] The token cache is being invalidate because project fc89b796a79444e3a87ea835da748c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:22:33.465326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-17a7b089-4614-4aeb-ae38-dbee722bf970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:33.466103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-17a7b089-4614-4aeb-ae38-dbee722bf970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:33.470918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1274/2542] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:22:33 2022] DELETE /identity/v3/projects/fc89b796a79444e3a87ea835da748c96 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:33.472685 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d72adb-0dec-4ead-9047-91e7045a4ed7 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:33.473544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d72adb-0dec-4ead-9047-91e7045a4ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:33.473834 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d72adb-0dec-4ead-9047-91e7045a4ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:33.494390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-90d72adb-0dec-4ead-9047-91e7045a4ed7 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:33.495809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-90d72adb-0dec-4ead-9047-91e7045a4ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:33.528434 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:33.574497 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1269/2543] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:33.579752 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ac8eb-eff0-4bdc-b38d-efcb7ca2b471 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:33.580050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ac8eb-eff0-4bdc-b38d-efcb7ca2b471 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:33.580338 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ac8eb-eff0-4bdc-b38d-efcb7ca2b471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:33.600884 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-fa7ac8eb-eff0-4bdc-b38d-efcb7ca2b471 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:33.602104 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fa7ac8eb-eff0-4bdc-b38d-efcb7ca2b471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:33.614354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1275/2544] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:33.619001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d72adb-0dec-4ead-9047-91e7045a4ed7 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:33.630751 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d72adb-0dec-4ead-9047-91e7045a4ed7 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:33.635532 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9f65f-f7c7-48e1-a8d5-611297af8733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:33.636195 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9f65f-f7c7-48e1-a8d5-611297af8733 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:33.636479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9f65f-f7c7-48e1-a8d5-611297af8733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:33.636818 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9f65f-f7c7-48e1-a8d5-611297af8733 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:33.637702 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9f65f-f7c7-48e1-a8d5-611297af8733 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:22:33.638134 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9f65f-f7c7-48e1-a8d5-611297af8733 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:33.639812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9f65f-f7c7-48e1-a8d5-611297af8733 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:33.663225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1270/2545] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:22:33.669530 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ac8eb-eff0-4bdc-b38d-efcb7ca2b471 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:33.681112 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ac8eb-eff0-4bdc-b38d-efcb7ca2b471 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:33.687606 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce724fc-c934-48cd-a1bc-3e3ae1fb65ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:33.688465 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce724fc-c934-48cd-a1bc-3e3ae1fb65ca admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:33.688748 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce724fc-c934-48cd-a1bc-3e3ae1fb65ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:33.689029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce724fc-c934-48cd-a1bc-3e3ae1fb65ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:33.689724 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce724fc-c934-48cd-a1bc-3e3ae1fb65ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:33.691727 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce724fc-c934-48cd-a1bc-3e3ae1fb65ca admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:33.720414 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1276/2546] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:22:33 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:22:33.724548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9f65f-f7c7-48e1-a8d5-611297af8733 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:33.735394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9f65f-f7c7-48e1-a8d5-611297af8733 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:33.794617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd198141-0fbc-438c-857a-e554ccfc63a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:33.795697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd198141-0fbc-438c-857a-e554ccfc63a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:33.796005 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd198141-0fbc-438c-857a-e554ccfc63a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:33.796428 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd198141-0fbc-438c-857a-e554ccfc63a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:33.797077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd198141-0fbc-438c-857a-e554ccfc63a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:33.799047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd198141-0fbc-438c-857a-e554ccfc63a4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:33.821382 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1271/2547] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:22:33 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:22:33.822587 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce724fc-c934-48cd-a1bc-3e3ae1fb65ca admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:33.833458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce724fc-c934-48cd-a1bc-3e3ae1fb65ca admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:33.838142 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d14f56-1426-48bc-8dd1-95e642b51b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:33.838836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d14f56-1426-48bc-8dd1-95e642b51b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:33.839122 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d14f56-1426-48bc-8dd1-95e642b51b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:33.839402 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d14f56-1426-48bc-8dd1-95e642b51b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:33.840161 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d14f56-1426-48bc-8dd1-95e642b51b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:33.842309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d14f56-1426-48bc-8dd1-95e642b51b61 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:33.852789 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1277/2548] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:22:33.857572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd198141-0fbc-438c-857a-e554ccfc63a4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:33.867677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd198141-0fbc-438c-857a-e554ccfc63a4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:33.872540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebda2b-20b1-4d75-9ed4-fc4e302a6af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:33.873198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebda2b-20b1-4d75-9ed4-fc4e302a6af2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:33.873482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebda2b-20b1-4d75-9ed4-fc4e302a6af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:33.873756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebda2b-20b1-4d75-9ed4-fc4e302a6af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:33.874508 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebda2b-20b1-4d75-9ed4-fc4e302a6af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:33.876094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebda2b-20b1-4d75-9ed4-fc4e302a6af2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:33.885874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1272/2549] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:22:33.890413 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d14f56-1426-48bc-8dd1-95e642b51b61 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:33.900615 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d14f56-1426-48bc-8dd1-95e642b51b61 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:33.906609 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a93c0-8d1d-44be-8884-bda241682d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:33.907529 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a93c0-8d1d-44be-8884-bda241682d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:33.907818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a93c0-8d1d-44be-8884-bda241682d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:33.908102 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a93c0-8d1d-44be-8884-bda241682d95 admin admin] PATH_INFO: `/v3/projects/132906b7faae4298ad1f424791091848/users/003c2c4e1e634e21a94fc863deccaeda/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:33.924136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a93c0-8d1d-44be-8884-bda241682d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132906b7faae4298ad1f424791091848, user_id=003c2c4e1e634e21a94fc863deccaeda, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:33.926841 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a93c0-8d1d-44be-8884-bda241682d95 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:33.941554 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1278/2550] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:22:33 2022] PUT /identity/v3/projects/132906b7faae4298ad1f424791091848/users/003c2c4e1e634e21a94fc863deccaeda/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:33.953157 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d5895-e439-43a8-9de3-c33db28d20b4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:33.953383 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d5895-e439-43a8-9de3-c33db28d20b4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:33.953666 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d5895-e439-43a8-9de3-c33db28d20b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:33.984848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2b7d5895-e439-43a8-9de3-c33db28d20b4 None None] MFA Rules not processed for user `003c2c4e1e634e21a94fc863deccaeda`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:33.986189 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2b7d5895-e439-43a8-9de3-c33db28d20b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:34.050441 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1273/2551] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:22:34.061868 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a93c0-8d1d-44be-8884-bda241682d95 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:34.063591 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-296a93c0-8d1d-44be-8884-bda241682d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:34.120722 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a93c0-8d1d-44be-8884-bda241682d95 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:34.124618 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab6fbe-b07f-40e4-93e1-a26862907080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:34.125259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab6fbe-b07f-40e4-93e1-a26862907080 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:34.125541 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab6fbe-b07f-40e4-93e1-a26862907080 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:34.125817 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab6fbe-b07f-40e4-93e1-a26862907080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:34.134027 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab6fbe-b07f-40e4-93e1-a26862907080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:34.135479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab6fbe-b07f-40e4-93e1-a26862907080 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:34.145101 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1279/2552] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:37.007420 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d5895-e439-43a8-9de3-c33db28d20b4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:37.008814 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2b7d5895-e439-43a8-9de3-c33db28d20b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:37.043317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:37.072540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d5895-e439-43a8-9de3-c33db28d20b4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:37.076830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55482c-e872-4f2d-96c9-8b9ecfde50fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:37.077474 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55482c-e872-4f2d-96c9-8b9ecfde50fe service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:37.077763 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55482c-e872-4f2d-96c9-8b9ecfde50fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:37.078038 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55482c-e872-4f2d-96c9-8b9ecfde50fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:37.079846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6e55482c-e872-4f2d-96c9-8b9ecfde50fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:37.149186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55482c-e872-4f2d-96c9-8b9ecfde50fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:37.150743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55482c-e872-4f2d-96c9-8b9ecfde50fe service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:37.161986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1274/2553] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:40.577181 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab6fbe-b07f-40e4-93e1-a26862907080 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:40.578781 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a3ab6fbe-b07f-40e4-93e1-a26862907080 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:40.594207 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab6fbe-b07f-40e4-93e1-a26862907080 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:40.598942 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bceab-1c7c-4002-95c2-c173d24611c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:40.599822 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bceab-1c7c-4002-95c2-c173d24611c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:40.600135 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bceab-1c7c-4002-95c2-c173d24611c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:40.600412 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bceab-1c7c-4002-95c2-c173d24611c8 admin admin] PATH_INFO: `/v3/users/10638aa389dd4bb9bb82da7bf11c4b60` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:40.601670 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bceab-1c7c-4002-95c2-c173d24611c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10638aa389dd4bb9bb82da7bf11c4b60)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:40.603632 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bceab-1c7c-4002-95c2-c173d24611c8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:40.651929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1d8bceab-1c7c-4002-95c2-c173d24611c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10638aa389dd4bb9bb82da7bf11c4b60'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:40.654098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:40.667495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1d8bceab-1c7c-4002-95c2-c173d24611c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10638aa389dd4bb9bb82da7bf11c4b60'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:40.668196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1d8bceab-1c7c-4002-95c2-c173d24611c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10638aa389dd4bb9bb82da7bf11c4b60'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:40.669869 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1d8bceab-1c7c-4002-95c2-c173d24611c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10638aa389dd4bb9bb82da7bf11c4b60'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:40.677940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1d8bceab-1c7c-4002-95c2-c173d24611c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10638aa389dd4bb9bb82da7bf11c4b60'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:40.690234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1280/2554] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:22:40 2022] DELETE /identity/v3/users/10638aa389dd4bb9bb82da7bf11c4b60 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:40.870080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55482c-e872-4f2d-96c9-8b9ecfde50fe service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:40.881432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55482c-e872-4f2d-96c9-8b9ecfde50fe service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:40.943708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cb7d2-cbb2-46d0-a405-c2d15f36927d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:40.944505 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cb7d2-cbb2-46d0-a405-c2d15f36927d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:40.944792 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cb7d2-cbb2-46d0-a405-c2d15f36927d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:40.945079 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cb7d2-cbb2-46d0-a405-c2d15f36927d admin admin] PATH_INFO: `/v3/projects/1a92b5c9383f4497bea2a2971cca40e4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:40.946573 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cb7d2-cbb2-46d0-a405-c2d15f36927d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a92b5c9383f4497bea2a2971cca40e4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:40.948626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cb7d2-cbb2-46d0-a405-c2d15f36927d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:41.000664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f7cb7d2-cbb2-46d0-a405-c2d15f36927d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a92b5c9383f4497bea2a2971cca40e4', 'request_id': 'req-4f7cb7d2-cbb2-46d0-a405-c2d15f36927d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:41.006731 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f7cb7d2-cbb2-46d0-a405-c2d15f36927d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a92b5c9383f4497bea2a2971cca40e4', 'request_id': 'req-4f7cb7d2-cbb2-46d0-a405-c2d15f36927d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:41.014289 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f7cb7d2-cbb2-46d0-a405-c2d15f36927d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a92b5c9383f4497bea2a2971cca40e4', 'request_id': 'req-4f7cb7d2-cbb2-46d0-a405-c2d15f36927d'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:41.031215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f7cb7d2-cbb2-46d0-a405-c2d15f36927d admin admin] The token cache is being invalidate because project 1a92b5c9383f4497bea2a2971cca40e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:22:41.031574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f7cb7d2-cbb2-46d0-a405-c2d15f36927d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:41.032673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-4f7cb7d2-cbb2-46d0-a405-c2d15f36927d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:22:41.038117 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1275/2555] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:22:40 2022] DELETE /identity/v3/projects/1a92b5c9383f4497bea2a2971cca40e4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:41.040490 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd342d-a539-4c11-b86d-9ed8ea738400 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:41.040970 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd342d-a539-4c11-b86d-9ed8ea738400 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:41.041316 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd342d-a539-4c11-b86d-9ed8ea738400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:41.060961 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0cfd342d-a539-4c11-b86d-9ed8ea738400 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:41.062172 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0cfd342d-a539-4c11-b86d-9ed8ea738400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:41.134090 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1281/2556] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:41.142677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38e606-ead5-4871-8a1f-5fed233ecf14 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:41.143072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38e606-ead5-4871-8a1f-5fed233ecf14 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:41.143470 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38e606-ead5-4871-8a1f-5fed233ecf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:41.173556 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-2e38e606-ead5-4871-8a1f-5fed233ecf14 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:41.174846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2e38e606-ead5-4871-8a1f-5fed233ecf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:41.183026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1276/2557] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:41.187943 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd342d-a539-4c11-b86d-9ed8ea738400 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:41.197944 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd342d-a539-4c11-b86d-9ed8ea738400 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:41.205796 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cded1e-5849-434f-89e7-051933ef7a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:41.206929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cded1e-5849-434f-89e7-051933ef7a06 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:41.207226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cded1e-5849-434f-89e7-051933ef7a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:41.207516 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cded1e-5849-434f-89e7-051933ef7a06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:41.208319 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cded1e-5849-434f-89e7-051933ef7a06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:22:41.208634 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cded1e-5849-434f-89e7-051933ef7a06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:41.210254 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cded1e-5849-434f-89e7-051933ef7a06 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:41.223500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1282/2558] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:22:41.228077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38e606-ead5-4871-8a1f-5fed233ecf14 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:41.233344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:41.240052 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38e606-ead5-4871-8a1f-5fed233ecf14 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:41.246062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52c496-20fb-4525-bfa8-dd784c26b0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:41.247122 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52c496-20fb-4525-bfa8-dd784c26b0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:41.247249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52c496-20fb-4525-bfa8-dd784c26b0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:41.247458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52c496-20fb-4525-bfa8-dd784c26b0c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:41.248197 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52c496-20fb-4525-bfa8-dd784c26b0c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:41.250096 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52c496-20fb-4525-bfa8-dd784c26b0c7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:41.285639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1277/2559] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:22:41 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:22:41.289584 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cded1e-5849-434f-89e7-051933ef7a06 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:41.300675 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cded1e-5849-434f-89e7-051933ef7a06 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:41.359138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236014f-b490-4a5e-ac42-235da38d430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:41.359818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236014f-b490-4a5e-ac42-235da38d430d admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:41.360104 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236014f-b490-4a5e-ac42-235da38d430d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:41.360387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236014f-b490-4a5e-ac42-235da38d430d admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:41.361068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236014f-b490-4a5e-ac42-235da38d430d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:41.363017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236014f-b490-4a5e-ac42-235da38d430d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:41.383707 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1283/2560] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:22:41 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:22:41.388033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52c496-20fb-4525-bfa8-dd784c26b0c7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:41.398202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52c496-20fb-4525-bfa8-dd784c26b0c7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:41.403446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518b4d5-c8d8-4fd0-938e-442b7bcdfd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:41.404193 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518b4d5-c8d8-4fd0-938e-442b7bcdfd21 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:41.404475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518b4d5-c8d8-4fd0-938e-442b7bcdfd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:41.404747 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518b4d5-c8d8-4fd0-938e-442b7bcdfd21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:41.405468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518b4d5-c8d8-4fd0-938e-442b7bcdfd21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:41.407093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518b4d5-c8d8-4fd0-938e-442b7bcdfd21 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:41.417652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1278/2561] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:22:41.422507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236014f-b490-4a5e-ac42-235da38d430d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:41.433777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236014f-b490-4a5e-ac42-235da38d430d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:41.439299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ab4c8-ce83-45aa-a846-f1a329de1925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:41.439971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab4c8-ce83-45aa-a846-f1a329de1925 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:41.440261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab4c8-ce83-45aa-a846-f1a329de1925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:41.440554 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab4c8-ce83-45aa-a846-f1a329de1925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:41.441281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ab4c8-ce83-45aa-a846-f1a329de1925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:41.442990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ab4c8-ce83-45aa-a846-f1a329de1925 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:41.454115 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1284/2562] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:22:41.458452 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518b4d5-c8d8-4fd0-938e-442b7bcdfd21 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:41.469263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518b4d5-c8d8-4fd0-938e-442b7bcdfd21 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:41.473927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befaea9-b737-41dd-9d47-604778f67d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:41.474840 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befaea9-b737-41dd-9d47-604778f67d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:41.475126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befaea9-b737-41dd-9d47-604778f67d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:41.475407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befaea9-b737-41dd-9d47-604778f67d76 admin admin] PATH_INFO: `/v3/projects/9ed316beab9f499baf80ab42a00586aa/users/d50fd94260f446e1add25376647b22ab/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:41.490594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befaea9-b737-41dd-9d47-604778f67d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed316beab9f499baf80ab42a00586aa, user_id=d50fd94260f446e1add25376647b22ab, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:41.493311 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befaea9-b737-41dd-9d47-604778f67d76 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:41.506728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1279/2563] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:22:41 2022] PUT /identity/v3/projects/9ed316beab9f499baf80ab42a00586aa/users/d50fd94260f446e1add25376647b22ab/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:22:41.512760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a4a7f-48f4-4b12-b696-4b5fbf1c6278 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:41.513053 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a4a7f-48f4-4b12-b696-4b5fbf1c6278 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:41.513391 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a4a7f-48f4-4b12-b696-4b5fbf1c6278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:41.530933 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-281a4a7f-48f4-4b12-b696-4b5fbf1c6278 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:41.532132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-281a4a7f-48f4-4b12-b696-4b5fbf1c6278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:41.558155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:41.595746 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1285/2564] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:41.605329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befaea9-b737-41dd-9d47-604778f67d76 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:41.607910 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1befaea9-b737-41dd-9d47-604778f67d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:41.670695 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befaea9-b737-41dd-9d47-604778f67d76 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:41.674328 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31b81d-7319-4770-8a96-e7475dc60180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:41.675492 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31b81d-7319-4770-8a96-e7475dc60180 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:41.675955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31b81d-7319-4770-8a96-e7475dc60180 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:41.676906 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31b81d-7319-4770-8a96-e7475dc60180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:41.688421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31b81d-7319-4770-8a96-e7475dc60180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:41.689858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31b81d-7319-4770-8a96-e7475dc60180 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:41.700053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1280/2565] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:45.829997 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3f19b-7fdb-462e-ae59-35a89f7a26d0 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:45.830462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3f19b-7fdb-462e-ae59-35a89f7a26d0 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:45.830593 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3f19b-7fdb-462e-ae59-35a89f7a26d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:45.860351 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-30d3f19b-7fdb-462e-ae59-35a89f7a26d0 None None] MFA Rules not processed for user `d50fd94260f446e1add25376647b22ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:45.861612 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-30d3f19b-7fdb-462e-ae59-35a89f7a26d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:45.937941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1286/2566] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:45.952986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31b81d-7319-4770-8a96-e7475dc60180 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:45.955024 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1e31b81d-7319-4770-8a96-e7475dc60180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:46.040948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31b81d-7319-4770-8a96-e7475dc60180 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:46.048357 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7bcb3-f259-4503-8ad3-e5c78269a820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:46.048702 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7bcb3-f259-4503-8ad3-e5c78269a820 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:46.048891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7bcb3-f259-4503-8ad3-e5c78269a820 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:46.049163 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7bcb3-f259-4503-8ad3-e5c78269a820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:46.060736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7bcb3-f259-4503-8ad3-e5c78269a820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:46.062360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7bcb3-f259-4503-8ad3-e5c78269a820 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:46.072731 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1281/2567] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:47.532712 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c830ef-cbf1-4530-ae27-7483ba4aa2e7 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:47.533257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c830ef-cbf1-4530-ae27-7483ba4aa2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:47.533444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c830ef-cbf1-4530-ae27-7483ba4aa2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:47.555263 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b0c830ef-cbf1-4530-ae27-7483ba4aa2e7 None None] MFA Rules not processed for user `d50fd94260f446e1add25376647b22ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:22:47.556591 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b0c830ef-cbf1-4530-ae27-7483ba4aa2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:47.568907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1287/2568] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:22:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:22:47.933886 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7bcb3-f259-4503-8ad3-e5c78269a820 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:22:47.935460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3de7bcb3-f259-4503-8ad3-e5c78269a820 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:47.948231 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7bcb3-f259-4503-8ad3-e5c78269a820 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:22:47.952508 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4314c-c77c-4f61-8027-1ed5477f7ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:22:47.953372 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4314c-c77c-4f61-8027-1ed5477f7ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:22:47.953680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4314c-c77c-4f61-8027-1ed5477f7ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:22:47.953936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4314c-c77c-4f61-8027-1ed5477f7ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:22:47.955785 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7aa4314c-c77c-4f61-8027-1ed5477f7ad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:22:47.967237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4314c-c77c-4f61-8027-1ed5477f7ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:22:47.968695 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4314c-c77c-4f61-8027-1ed5477f7ad6 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:22:47.987835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1282/2569] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:22:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:22:57.548958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=48 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:22:57.973609 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:06.403704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c830ef-cbf1-4530-ae27-7483ba4aa2e7 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:06.405332 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b0c830ef-cbf1-4530-ae27-7483ba4aa2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:06.420306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c830ef-cbf1-4530-ae27-7483ba4aa2e7 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:06.425139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8949f3-11b7-4dfb-b090-7c50104fab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:06.426024 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8949f3-11b7-4dfb-b090-7c50104fab6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:06.426307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8949f3-11b7-4dfb-b090-7c50104fab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:06.426619 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8949f3-11b7-4dfb-b090-7c50104fab6f admin admin] PATH_INFO: `/v3/users/003c2c4e1e634e21a94fc863deccaeda` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:06.427821 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8949f3-11b7-4dfb-b090-7c50104fab6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=003c2c4e1e634e21a94fc863deccaeda)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:06.429758 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8949f3-11b7-4dfb-b090-7c50104fab6f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:06.480737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6a8949f3-11b7-4dfb-b090-7c50104fab6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003c2c4e1e634e21a94fc863deccaeda'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:06.493965 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6a8949f3-11b7-4dfb-b090-7c50104fab6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003c2c4e1e634e21a94fc863deccaeda'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:06.494744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6a8949f3-11b7-4dfb-b090-7c50104fab6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003c2c4e1e634e21a94fc863deccaeda'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:06.495354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6a8949f3-11b7-4dfb-b090-7c50104fab6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003c2c4e1e634e21a94fc863deccaeda'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:06.503653 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-6a8949f3-11b7-4dfb-b090-7c50104fab6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003c2c4e1e634e21a94fc863deccaeda'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:06.517432 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1288/2570] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:23:06 2022] DELETE /identity/v3/users/003c2c4e1e634e21a94fc863deccaeda => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:06.522108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d048310-c20c-41ca-91ab-2f7ae9c1d2be None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:06.522613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d048310-c20c-41ca-91ab-2f7ae9c1d2be None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:06.526761 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d048310-c20c-41ca-91ab-2f7ae9c1d2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:06.545340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-4d048310-c20c-41ca-91ab-2f7ae9c1d2be None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:06.546595 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4d048310-c20c-41ca-91ab-2f7ae9c1d2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:06.608958 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1283/2571] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:06.622220 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8949f3-11b7-4dfb-b090-7c50104fab6f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:06.623617 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6a8949f3-11b7-4dfb-b090-7c50104fab6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:06.707312 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8949f3-11b7-4dfb-b090-7c50104fab6f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:06.711475 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d241bfb-6d16-47cd-9958-8b4f2ce03ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:06.711918 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d241bfb-6d16-47cd-9958-8b4f2ce03ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:06.712228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d241bfb-6d16-47cd-9958-8b4f2ce03ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:06.712506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d241bfb-6d16-47cd-9958-8b4f2ce03ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:06.723133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d241bfb-6d16-47cd-9958-8b4f2ce03ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:06.724623 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d241bfb-6d16-47cd-9958-8b4f2ce03ff1 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:06.735327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1289/2572] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:07.096496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d048310-c20c-41ca-91ab-2f7ae9c1d2be None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:07.097914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4d048310-c20c-41ca-91ab-2f7ae9c1d2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:07.113230 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d048310-c20c-41ca-91ab-2f7ae9c1d2be None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:07.117867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7ca5d-44c3-47e3-9da2-66a9721e05b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:07.118803 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7ca5d-44c3-47e3-9da2-66a9721e05b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:07.119093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7ca5d-44c3-47e3-9da2-66a9721e05b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:07.119375 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7ca5d-44c3-47e3-9da2-66a9721e05b2 admin admin] PATH_INFO: `/v3/projects/132906b7faae4298ad1f424791091848` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:07.120600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7ca5d-44c3-47e3-9da2-66a9721e05b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=132906b7faae4298ad1f424791091848)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:07.123316 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7ca5d-44c3-47e3-9da2-66a9721e05b2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:07.172555 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-57d7ca5d-44c3-47e3-9da2-66a9721e05b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132906b7faae4298ad1f424791091848', 'request_id': 'req-57d7ca5d-44c3-47e3-9da2-66a9721e05b2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:07.178472 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-57d7ca5d-44c3-47e3-9da2-66a9721e05b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132906b7faae4298ad1f424791091848', 'request_id': 'req-57d7ca5d-44c3-47e3-9da2-66a9721e05b2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:07.187956 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-57d7ca5d-44c3-47e3-9da2-66a9721e05b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132906b7faae4298ad1f424791091848', 'request_id': 'req-57d7ca5d-44c3-47e3-9da2-66a9721e05b2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:07.199987 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-57d7ca5d-44c3-47e3-9da2-66a9721e05b2 admin admin] The token cache is being invalidate because project 132906b7faae4298ad1f424791091848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:07.200279 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-57d7ca5d-44c3-47e3-9da2-66a9721e05b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:07.200925 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-57d7ca5d-44c3-47e3-9da2-66a9721e05b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:07.202500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1284/2573] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:07 2022] DELETE /identity/v3/projects/132906b7faae4298ad1f424791091848 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:07.207359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25451f-ebe3-465c-bd8a-5a126722c39a None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:07.207652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25451f-ebe3-465c-bd8a-5a126722c39a None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:07.207936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25451f-ebe3-465c-bd8a-5a126722c39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:07.225968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9d25451f-ebe3-465c-bd8a-5a126722c39a None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:07.227222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9d25451f-ebe3-465c-bd8a-5a126722c39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:07.288011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1290/2574] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:07.296293 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a501c06-d07e-4c5a-929e-285b722b4dfe None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:07.296614 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a501c06-d07e-4c5a-929e-285b722b4dfe None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:07.296895 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a501c06-d07e-4c5a-929e-285b722b4dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:07.315394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7a501c06-d07e-4c5a-929e-285b722b4dfe None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:07.316583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7a501c06-d07e-4c5a-929e-285b722b4dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:07.324501 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1285/2575] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:07.328749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25451f-ebe3-465c-bd8a-5a126722c39a None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:07.338520 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25451f-ebe3-465c-bd8a-5a126722c39a None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:07.343813 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2758cf9-8a00-462b-9ec3-b734eeb55742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:07.344484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2758cf9-8a00-462b-9ec3-b734eeb55742 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:07.344774 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2758cf9-8a00-462b-9ec3-b734eeb55742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:07.345062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2758cf9-8a00-462b-9ec3-b734eeb55742 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:07.345793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2758cf9-8a00-462b-9ec3-b734eeb55742 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:23:07.346105 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2758cf9-8a00-462b-9ec3-b734eeb55742 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:07.347795 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2758cf9-8a00-462b-9ec3-b734eeb55742 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:07.361200 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1291/2576] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:23:07.365950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a501c06-d07e-4c5a-929e-285b722b4dfe None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:07.376633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a501c06-d07e-4c5a-929e-285b722b4dfe None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:07.381447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defecfe8-8152-4cc6-b9c1-ae85e20f63d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:07.382079 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defecfe8-8152-4cc6-b9c1-ae85e20f63d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:07.382364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defecfe8-8152-4cc6-b9c1-ae85e20f63d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:07.382680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defecfe8-8152-4cc6-b9c1-ae85e20f63d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:07.383377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defecfe8-8152-4cc6-b9c1-ae85e20f63d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:07.385265 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defecfe8-8152-4cc6-b9c1-ae85e20f63d6 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:07.415565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1286/2577] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:07 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:07.420562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2758cf9-8a00-462b-9ec3-b734eeb55742 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:07.425671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:07.431992 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2758cf9-8a00-462b-9ec3-b734eeb55742 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:07.492656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c235caf-a1f6-4643-ba8b-69655e37cfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:07.493334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c235caf-a1f6-4643-ba8b-69655e37cfc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:07.493622 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c235caf-a1f6-4643-ba8b-69655e37cfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:07.493910 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c235caf-a1f6-4643-ba8b-69655e37cfc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:07.494636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c235caf-a1f6-4643-ba8b-69655e37cfc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:07.496766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c235caf-a1f6-4643-ba8b-69655e37cfc5 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:07.519790 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1292/2578] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:07 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:07.522795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defecfe8-8152-4cc6-b9c1-ae85e20f63d6 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:07.537432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defecfe8-8152-4cc6-b9c1-ae85e20f63d6 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:07.543899 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838d9be-21db-4209-9906-97e1a3906e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:07.544580 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838d9be-21db-4209-9906-97e1a3906e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:07.544870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838d9be-21db-4209-9906-97e1a3906e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:07.545151 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838d9be-21db-4209-9906-97e1a3906e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:07.545886 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838d9be-21db-4209-9906-97e1a3906e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:07.547539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838d9be-21db-4209-9906-97e1a3906e33 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:07.558562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1287/2579] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:07.562908 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c235caf-a1f6-4643-ba8b-69655e37cfc5 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:07.572972 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c235caf-a1f6-4643-ba8b-69655e37cfc5 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:07.577600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a672e-0727-491a-bf9f-362ad9a09cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:07.578255 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a672e-0727-491a-bf9f-362ad9a09cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:07.578575 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a672e-0727-491a-bf9f-362ad9a09cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:07.578856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a672e-0727-491a-bf9f-362ad9a09cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:07.579571 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a672e-0727-491a-bf9f-362ad9a09cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:07.581155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a672e-0727-491a-bf9f-362ad9a09cb3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:07.591829 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1293/2580] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:07.596076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838d9be-21db-4209-9906-97e1a3906e33 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:07.607439 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838d9be-21db-4209-9906-97e1a3906e33 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:07.612140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bc7ac-0526-4ece-9b5e-631b161d6bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:07.613029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bc7ac-0526-4ece-9b5e-631b161d6bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:07.613312 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bc7ac-0526-4ece-9b5e-631b161d6bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:07.613592 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bc7ac-0526-4ece-9b5e-631b161d6bb7 admin admin] PATH_INFO: `/v3/projects/6e03a3e7829a48b4b24e92249cbf4e0e/users/43505a663f184b10be217ffa4a680e33/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:07.628499 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bc7ac-0526-4ece-9b5e-631b161d6bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e03a3e7829a48b4b24e92249cbf4e0e, user_id=43505a663f184b10be217ffa4a680e33, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:07.633299 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bc7ac-0526-4ece-9b5e-631b161d6bb7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:07.648525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1288/2581] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:07 2022] PUT /identity/v3/projects/6e03a3e7829a48b4b24e92249cbf4e0e/users/43505a663f184b10be217ffa4a680e33/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:07.659216 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469ce5f-0e54-4ec5-acca-e60ada1dde8b None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:07.659511 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469ce5f-0e54-4ec5-acca-e60ada1dde8b None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:07.659796 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469ce5f-0e54-4ec5-acca-e60ada1dde8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:07.687268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-b469ce5f-0e54-4ec5-acca-e60ada1dde8b None None] MFA Rules not processed for user `43505a663f184b10be217ffa4a680e33`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:07.688490 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b469ce5f-0e54-4ec5-acca-e60ada1dde8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:07.753052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1294/2582] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:07.763579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bc7ac-0526-4ece-9b5e-631b161d6bb7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:07.765345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5d8bc7ac-0526-4ece-9b5e-631b161d6bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:07.787790 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:07.824994 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bc7ac-0526-4ece-9b5e-631b161d6bb7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:07.828959 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cb484-07b1-4f4f-b0b9-8a08b0b17f2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:07.829612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cb484-07b1-4f4f-b0b9-8a08b0b17f2f service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:07.829897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cb484-07b1-4f4f-b0b9-8a08b0b17f2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:07.830184 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cb484-07b1-4f4f-b0b9-8a08b0b17f2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:07.839035 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cb484-07b1-4f4f-b0b9-8a08b0b17f2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:07.841333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cb484-07b1-4f4f-b0b9-8a08b0b17f2f service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:07.850280 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1289/2583] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:13.413273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469ce5f-0e54-4ec5-acca-e60ada1dde8b None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:13.414932 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b469ce5f-0e54-4ec5-acca-e60ada1dde8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:13.474709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469ce5f-0e54-4ec5-acca-e60ada1dde8b None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:13.478881 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc85d2-ca99-4162-bf95-dd707dcf638e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:13.479646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc85d2-ca99-4162-bf95-dd707dcf638e service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:13.479929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc85d2-ca99-4162-bf95-dd707dcf638e service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:13.480222 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc85d2-ca99-4162-bf95-dd707dcf638e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:13.482320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c4bc85d2-ca99-4162-bf95-dd707dcf638e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:13.517409 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:13.560671 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc85d2-ca99-4162-bf95-dd707dcf638e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:13.563122 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc85d2-ca99-4162-bf95-dd707dcf638e service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:13.576245 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1295/2584] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:16.936232 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cb484-07b1-4f4f-b0b9-8a08b0b17f2f service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:16.937684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b88cb484-07b1-4f4f-b0b9-8a08b0b17f2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:16.952643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cb484-07b1-4f4f-b0b9-8a08b0b17f2f service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:16.958108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dedbd-f4ee-4c74-b6d5-54109dab5578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:16.959323 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dedbd-f4ee-4c74-b6d5-54109dab5578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:16.959728 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dedbd-f4ee-4c74-b6d5-54109dab5578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:16.960066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dedbd-f4ee-4c74-b6d5-54109dab5578 admin admin] PATH_INFO: `/v3/users/9b1d8005a49f4760ab587ca00edd2ae9` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:16.961657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dedbd-f4ee-4c74-b6d5-54109dab5578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b1d8005a49f4760ab587ca00edd2ae9)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:16.975574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dedbd-f4ee-4c74-b6d5-54109dab5578 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:17.037948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d61dedbd-f4ee-4c74-b6d5-54109dab5578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b1d8005a49f4760ab587ca00edd2ae9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:17.038630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d61dedbd-f4ee-4c74-b6d5-54109dab5578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b1d8005a49f4760ab587ca00edd2ae9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:17.050944 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d61dedbd-f4ee-4c74-b6d5-54109dab5578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b1d8005a49f4760ab587ca00edd2ae9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:17.051605 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d61dedbd-f4ee-4c74-b6d5-54109dab5578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b1d8005a49f4760ab587ca00edd2ae9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:17.058642 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-d61dedbd-f4ee-4c74-b6d5-54109dab5578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b1d8005a49f4760ab587ca00edd2ae9'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:17.072693 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1290/2585] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:23:16 2022] DELETE /identity/v3/users/9b1d8005a49f4760ab587ca00edd2ae9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:17.253370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc85d2-ca99-4162-bf95-dd707dcf638e service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:17.264372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc85d2-ca99-4162-bf95-dd707dcf638e service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:17.325508 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c750cc7-1a11-4bb4-8342-4a8c92d7c558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:17.326309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c750cc7-1a11-4bb4-8342-4a8c92d7c558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:17.326628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c750cc7-1a11-4bb4-8342-4a8c92d7c558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:17.326915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c750cc7-1a11-4bb4-8342-4a8c92d7c558 admin admin] PATH_INFO: `/v3/projects/1ef76a1224a7440083db1884d9efb9d0` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:17.328205 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c750cc7-1a11-4bb4-8342-4a8c92d7c558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef76a1224a7440083db1884d9efb9d0)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:17.330127 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c750cc7-1a11-4bb4-8342-4a8c92d7c558 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:17.378303 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2c750cc7-1a11-4bb4-8342-4a8c92d7c558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef76a1224a7440083db1884d9efb9d0', 'request_id': 'req-2c750cc7-1a11-4bb4-8342-4a8c92d7c558'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:17.383844 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2c750cc7-1a11-4bb4-8342-4a8c92d7c558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef76a1224a7440083db1884d9efb9d0', 'request_id': 'req-2c750cc7-1a11-4bb4-8342-4a8c92d7c558'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:17.391744 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2c750cc7-1a11-4bb4-8342-4a8c92d7c558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef76a1224a7440083db1884d9efb9d0', 'request_id': 'req-2c750cc7-1a11-4bb4-8342-4a8c92d7c558'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:17.403462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2c750cc7-1a11-4bb4-8342-4a8c92d7c558 admin admin] The token cache is being invalidate because project 1ef76a1224a7440083db1884d9efb9d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:17.403754 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2c750cc7-1a11-4bb4-8342-4a8c92d7c558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:17.404406 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-2c750cc7-1a11-4bb4-8342-4a8c92d7c558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:17.405964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1296/2586] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:17 2022] DELETE /identity/v3/projects/1ef76a1224a7440083db1884d9efb9d0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:17.410908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd23b7-5090-4955-b899-bd0f20cd5aca None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:17.411206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd23b7-5090-4955-b899-bd0f20cd5aca None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:17.411755 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd23b7-5090-4955-b899-bd0f20cd5aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:17.429559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e5fd23b7-5090-4955-b899-bd0f20cd5aca None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:17.430808 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e5fd23b7-5090-4955-b899-bd0f20cd5aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:17.491458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1291/2587] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:17.499771 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18210327-9d31-49e7-86da-491828c0b61f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:17.500066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18210327-9d31-49e7-86da-491828c0b61f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:17.500351 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18210327-9d31-49e7-86da-491828c0b61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:17.519502 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-18210327-9d31-49e7-86da-491828c0b61f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:17.520709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-18210327-9d31-49e7-86da-491828c0b61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:17.528962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1297/2588] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:17.533168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd23b7-5090-4955-b899-bd0f20cd5aca None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:17.543129 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd23b7-5090-4955-b899-bd0f20cd5aca None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:17.547627 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc9fd-9ead-4a2d-8092-eaedde56bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:17.548272 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc9fd-9ead-4a2d-8092-eaedde56bbba admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:17.548551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc9fd-9ead-4a2d-8092-eaedde56bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:17.548828 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc9fd-9ead-4a2d-8092-eaedde56bbba admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:17.549544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc9fd-9ead-4a2d-8092-eaedde56bbba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:23:17.549908 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc9fd-9ead-4a2d-8092-eaedde56bbba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:17.551530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc9fd-9ead-4a2d-8092-eaedde56bbba admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:17.566746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1292/2589] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:23:17.571238 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18210327-9d31-49e7-86da-491828c0b61f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:17.581512 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18210327-9d31-49e7-86da-491828c0b61f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:17.586143 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b9186-f22a-4992-8f2e-76ccb76081bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:17.586824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b9186-f22a-4992-8f2e-76ccb76081bc admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:17.587111 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b9186-f22a-4992-8f2e-76ccb76081bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:17.587388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b9186-f22a-4992-8f2e-76ccb76081bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:17.588070 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b9186-f22a-4992-8f2e-76ccb76081bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:17.590195 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b9186-f22a-4992-8f2e-76ccb76081bc admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:17.618808 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1298/2590] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:17 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:17.625280 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc9fd-9ead-4a2d-8092-eaedde56bbba admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:17.636018 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc9fd-9ead-4a2d-8092-eaedde56bbba admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:17.656466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:17.699669 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0b134-fc7b-4df6-b2f6-d56a0785a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:17.700574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0b134-fc7b-4df6-b2f6-d56a0785a871 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:17.700574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0b134-fc7b-4df6-b2f6-d56a0785a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:17.700805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0b134-fc7b-4df6-b2f6-d56a0785a871 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:17.701463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0b134-fc7b-4df6-b2f6-d56a0785a871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:17.703429 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0b134-fc7b-4df6-b2f6-d56a0785a871 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:17.724975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1293/2591] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:17 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:23:17.729290 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b9186-f22a-4992-8f2e-76ccb76081bc admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:17.741468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b9186-f22a-4992-8f2e-76ccb76081bc admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:17.747269 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aed08-8ae1-4b23-a46f-f09fa1ee1625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:17.747945 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aed08-8ae1-4b23-a46f-f09fa1ee1625 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:17.748232 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aed08-8ae1-4b23-a46f-f09fa1ee1625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:17.748513 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40aed08-8ae1-4b23-a46f-f09fa1ee1625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:17.749274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40aed08-8ae1-4b23-a46f-f09fa1ee1625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:17.750950 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40aed08-8ae1-4b23-a46f-f09fa1ee1625 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:17.764657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1299/2592] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:17.765874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0b134-fc7b-4df6-b2f6-d56a0785a871 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:17.775987 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0b134-fc7b-4df6-b2f6-d56a0785a871 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:17.781029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8641e6-ef0e-4966-a8d3-6e6422d27278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:17.781694 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8641e6-ef0e-4966-a8d3-6e6422d27278 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:17.781983 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8641e6-ef0e-4966-a8d3-6e6422d27278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:17.782256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8641e6-ef0e-4966-a8d3-6e6422d27278 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:17.783186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8641e6-ef0e-4966-a8d3-6e6422d27278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:17.783765 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aed08-8ae1-4b23-a46f-f09fa1ee1625 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:17.784773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8641e6-ef0e-4966-a8d3-6e6422d27278 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:17.785583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a40aed08-8ae1-4b23-a46f-f09fa1ee1625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:17.796247 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1294/2593] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:17.800159 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8641e6-ef0e-4966-a8d3-6e6422d27278 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:17.800687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40aed08-8ae1-4b23-a46f-f09fa1ee1625 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:17.805494 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5a59f-dccf-4859-a22d-6a119e85458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:17.806374 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5a59f-dccf-4859-a22d-6a119e85458e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:17.806691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5a59f-dccf-4859-a22d-6a119e85458e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:17.806975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5a59f-dccf-4859-a22d-6a119e85458e admin admin] PATH_INFO: `/v3/users/43505a663f184b10be217ffa4a680e33` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:17.808252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5a59f-dccf-4859-a22d-6a119e85458e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43505a663f184b10be217ffa4a680e33)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:17.810762 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8641e6-ef0e-4966-a8d3-6e6422d27278 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:17.810930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5a59f-dccf-4859-a22d-6a119e85458e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:17.815704 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:17.815899 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045062e-3b60-4cd0-8bf0-f2aa27a05098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:17.816791 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045062e-3b60-4cd0-8bf0-f2aa27a05098 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:17.817045 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045062e-3b60-4cd0-8bf0-f2aa27a05098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:17.817319 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045062e-3b60-4cd0-8bf0-f2aa27a05098 admin admin] PATH_INFO: `/v3/projects/9d957b4cde754b96ab4faf3aa9d24d84/users/77200203a71f4945a9029faaea1a5e0b/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:17.832988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045062e-3b60-4cd0-8bf0-f2aa27a05098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d957b4cde754b96ab4faf3aa9d24d84, user_id=77200203a71f4945a9029faaea1a5e0b, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:17.835599 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045062e-3b60-4cd0-8bf0-f2aa27a05098 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:17.851071 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1295/2594] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:17 2022] PUT /identity/v3/projects/9d957b4cde754b96ab4faf3aa9d24d84/users/77200203a71f4945a9029faaea1a5e0b/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:23:17.862684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdbe65-dfc9-462a-9de6-472a7b030140 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:17.862983 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdbe65-dfc9-462a-9de6-472a7b030140 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:17.863269 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdbe65-dfc9-462a-9de6-472a7b030140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:17.864599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7ff5a59f-dccf-4859-a22d-6a119e85458e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43505a663f184b10be217ffa4a680e33'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:17.877590 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7ff5a59f-dccf-4859-a22d-6a119e85458e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43505a663f184b10be217ffa4a680e33'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:17.878415 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7ff5a59f-dccf-4859-a22d-6a119e85458e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43505a663f184b10be217ffa4a680e33'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:17.879063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7ff5a59f-dccf-4859-a22d-6a119e85458e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43505a663f184b10be217ffa4a680e33'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:17.887836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7ff5a59f-dccf-4859-a22d-6a119e85458e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43505a663f184b10be217ffa4a680e33'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:17.892061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1bbdbe65-dfc9-462a-9de6-472a7b030140 None None] MFA Rules not processed for user `77200203a71f4945a9029faaea1a5e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:17.893294 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1bbdbe65-dfc9-462a-9de6-472a7b030140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:17.900935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1300/2595] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:23:17 2022] DELETE /identity/v3/users/43505a663f184b10be217ffa4a680e33 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:23:17.905903 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41bdbe-8b5c-44bb-88e1-696d897e6cb7 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:17.906198 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41bdbe-8b5c-44bb-88e1-696d897e6cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:17.906514 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41bdbe-8b5c-44bb-88e1-696d897e6cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:17.923369 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6c41bdbe-8b5c-44bb-88e1-696d897e6cb7 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:17.924557 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6c41bdbe-8b5c-44bb-88e1-696d897e6cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:17.962374 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1296/2596] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:23:17.966967 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdbe65-dfc9-462a-9de6-472a7b030140 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:17.968392 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1bbdbe65-dfc9-462a-9de6-472a7b030140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:17.991249 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1301/2597] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:18.002113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41bdbe-8b5c-44bb-88e1-696d897e6cb7 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:18.003923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6c41bdbe-8b5c-44bb-88e1-696d897e6cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:18.037554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdbe65-dfc9-462a-9de6-472a7b030140 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:18.042295 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07719c30-07b1-44d6-a31b-31cd0f8619da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:18.042995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07719c30-07b1-44d6-a31b-31cd0f8619da admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.043274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07719c30-07b1-44d6-a31b-31cd0f8619da admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.043552 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07719c30-07b1-44d6-a31b-31cd0f8619da admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.044238 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07719c30-07b1-44d6-a31b-31cd0f8619da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:18.046137 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07719c30-07b1-44d6-a31b-31cd0f8619da admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:18.056149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:18.061839 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41bdbe-8b5c-44bb-88e1-696d897e6cb7 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:18.065731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d629f76-0e66-4d4d-86f9-566650ff115a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:18.066373 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629f76-0e66-4d4d-86f9-566650ff115a service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.066688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629f76-0e66-4d4d-86f9-566650ff115a service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.066980 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629f76-0e66-4d4d-86f9-566650ff115a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.078001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1297/2598] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:17 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:23:18.079033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07719c30-07b1-44d6-a31b-31cd0f8619da admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:18.080906 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d629f76-0e66-4d4d-86f9-566650ff115a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:18.082397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d629f76-0e66-4d4d-86f9-566650ff115a service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:18.092653 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1302/2599] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:23:18.144710 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07719c30-07b1-44d6-a31b-31cd0f8619da admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:18.151021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e5856-241e-4230-b5a7-76012365595b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:18.151714 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e5856-241e-4230-b5a7-76012365595b admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.152911 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e5856-241e-4230-b5a7-76012365595b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.153205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e5856-241e-4230-b5a7-76012365595b admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.153914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e5856-241e-4230-b5a7-76012365595b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:18.155886 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e5856-241e-4230-b5a7-76012365595b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:18.184504 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1298/2600] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:18 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:23:18.186938 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d629f76-0e66-4d4d-86f9-566650ff115a service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:18.196809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d629f76-0e66-4d4d-86f9-566650ff115a service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:18.204570 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb82df-a979-4478-bce6-7acb708ff8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:18.205267 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb82df-a979-4478-bce6-7acb708ff8da admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.205558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb82df-a979-4478-bce6-7acb708ff8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.205845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb82df-a979-4478-bce6-7acb708ff8da admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.206604 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb82df-a979-4478-bce6-7acb708ff8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:18.208279 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb82df-a979-4478-bce6-7acb708ff8da admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:18.219189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1303/2601] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:18.223490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e5856-241e-4230-b5a7-76012365595b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:18.234551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e5856-241e-4230-b5a7-76012365595b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:18.239378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb2c8a-4a5b-433c-8698-3805c50fc1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:18.240144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb2c8a-4a5b-433c-8698-3805c50fc1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.240450 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb2c8a-4a5b-433c-8698-3805c50fc1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.240716 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb2c8a-4a5b-433c-8698-3805c50fc1a7 admin admin] PATH_INFO: `/v3/projects/c500032de82d4a74aaab234fb4cdeb8e/users/d7bd8f7c48134401b25d77a73a069d04/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.266610 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb2c8a-4a5b-433c-8698-3805c50fc1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c500032de82d4a74aaab234fb4cdeb8e, user_id=d7bd8f7c48134401b25d77a73a069d04, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:18.269304 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb2c8a-4a5b-433c-8698-3805c50fc1a7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:18.283148 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1299/2602] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:18 2022] PUT /identity/v3/projects/c500032de82d4a74aaab234fb4cdeb8e/users/d7bd8f7c48134401b25d77a73a069d04/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:18.287977 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb82df-a979-4478-bce6-7acb708ff8da admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:18.299269 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb82df-a979-4478-bce6-7acb708ff8da admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:18.312441 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:18.366324 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28b0a-5406-4eb7-8548-4920968cc00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:18.367087 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28b0a-5406-4eb7-8548-4920968cc00d admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.367304 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28b0a-5406-4eb7-8548-4920968cc00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.367639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28b0a-5406-4eb7-8548-4920968cc00d admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.368733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a28b0a-5406-4eb7-8548-4920968cc00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:18.369991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a28b0a-5406-4eb7-8548-4920968cc00d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:18.382928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1304/2603] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:18.387175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb2c8a-4a5b-433c-8698-3805c50fc1a7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:18.392341 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28b0a-5406-4eb7-8548-4920968cc00d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:18.394495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-77a28b0a-5406-4eb7-8548-4920968cc00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:18.398414 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb2c8a-4a5b-433c-8698-3805c50fc1a7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:18.403536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e20b1f-de23-4bde-b5bd-55cb7740262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:18.404447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e20b1f-de23-4bde-b5bd-55cb7740262b admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.404775 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e20b1f-de23-4bde-b5bd-55cb7740262b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.405190 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e20b1f-de23-4bde-b5bd-55cb7740262b admin admin] PATH_INFO: `/v3/projects/c500032de82d4a74aaab234fb4cdeb8e/users/d7bd8f7c48134401b25d77a73a069d04/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.407511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e20b1f-de23-4bde-b5bd-55cb7740262b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c500032de82d4a74aaab234fb4cdeb8e, user_id=d7bd8f7c48134401b25d77a73a069d04, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:18.409626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28b0a-5406-4eb7-8548-4920968cc00d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:18.410216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e20b1f-de23-4bde-b5bd-55cb7740262b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:18.415548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16aa17b-5323-4cbb-9a1b-e6b4b7f707c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:18.416776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa17b-5323-4cbb-9a1b-e6b4b7f707c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.417234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa17b-5323-4cbb-9a1b-e6b4b7f707c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.418052 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa17b-5323-4cbb-9a1b-e6b4b7f707c9 admin admin] PATH_INFO: `/v3/projects/6e03a3e7829a48b4b24e92249cbf4e0e` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.419462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16aa17b-5323-4cbb-9a1b-e6b4b7f707c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e03a3e7829a48b4b24e92249cbf4e0e)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:18.421453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16aa17b-5323-4cbb-9a1b-e6b4b7f707c9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:18.426835 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1300/2604] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:18 2022] PUT /identity/v3/projects/c500032de82d4a74aaab234fb4cdeb8e/users/d7bd8f7c48134401b25d77a73a069d04/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:18.438101 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25a587-66ec-48e6-a703-be33e632153b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.438388 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25a587-66ec-48e6-a703-be33e632153b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.438706 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25a587-66ec-48e6-a703-be33e632153b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.466877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5e25a587-66ec-48e6-a703-be33e632153b None None] MFA Rules not processed for user `d7bd8f7c48134401b25d77a73a069d04`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:18.468099 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5e25a587-66ec-48e6-a703-be33e632153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:18.471935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e16aa17b-5323-4cbb-9a1b-e6b4b7f707c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e03a3e7829a48b4b24e92249cbf4e0e', 'request_id': 'req-e16aa17b-5323-4cbb-9a1b-e6b4b7f707c9'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:18.477660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e16aa17b-5323-4cbb-9a1b-e6b4b7f707c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e03a3e7829a48b4b24e92249cbf4e0e', 'request_id': 'req-e16aa17b-5323-4cbb-9a1b-e6b4b7f707c9'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:18.486840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e16aa17b-5323-4cbb-9a1b-e6b4b7f707c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e03a3e7829a48b4b24e92249cbf4e0e', 'request_id': 'req-e16aa17b-5323-4cbb-9a1b-e6b4b7f707c9'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:18.499731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e16aa17b-5323-4cbb-9a1b-e6b4b7f707c9 admin admin] The token cache is being invalidate because project 6e03a3e7829a48b4b24e92249cbf4e0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:18.500020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e16aa17b-5323-4cbb-9a1b-e6b4b7f707c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:18.500685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e16aa17b-5323-4cbb-9a1b-e6b4b7f707c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:18.502307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1305/2605] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:18 2022] DELETE /identity/v3/projects/6e03a3e7829a48b4b24e92249cbf4e0e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:18.507345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac61c2-2bfb-4ec0-b619-0601f19b3814 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.507680 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac61c2-2bfb-4ec0-b619-0601f19b3814 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.507967 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac61c2-2bfb-4ec0-b619-0601f19b3814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.526204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-9fac61c2-2bfb-4ec0-b619-0601f19b3814 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:18.527714 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9fac61c2-2bfb-4ec0-b619-0601f19b3814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:18.547839 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1301/2606] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:23:18.562199 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25a587-66ec-48e6-a703-be33e632153b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:18.564067 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5e25a587-66ec-48e6-a703-be33e632153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:18.595734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1306/2607] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:18.603299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f6225-19cf-4ab9-862b-0a16fe4ef059 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.603600 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f6225-19cf-4ab9-862b-0a16fe4ef059 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.603884 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f6225-19cf-4ab9-862b-0a16fe4ef059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.607240 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:18.625136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-748f6225-19cf-4ab9-862b-0a16fe4ef059 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:18.626275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-748f6225-19cf-4ab9-862b-0a16fe4ef059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:18.634311 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1307/2608] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:23:18.634929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25a587-66ec-48e6-a703-be33e632153b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:18.638488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f6225-19cf-4ab9-862b-0a16fe4ef059 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:18.638994 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9da85e-cfa7-490d-a0f1-43dc4d7029e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:18.639644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9da85e-cfa7-490d-a0f1-43dc4d7029e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.639916 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9da85e-cfa7-490d-a0f1-43dc4d7029e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.640563 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9da85e-cfa7-490d-a0f1-43dc4d7029e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.642389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cb9da85e-cfa7-490d-a0f1-43dc4d7029e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:18.648541 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f6225-19cf-4ab9-862b-0a16fe4ef059 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:18.653764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffdd00-42e2-4074-aa4f-f6a667a7c4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:18.654520 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffdd00-42e2-4074-aa4f-f6a667a7c4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.654809 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffdd00-42e2-4074-aa4f-f6a667a7c4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.655089 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffdd00-42e2-4074-aa4f-f6a667a7c4e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.655817 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffdd00-42e2-4074-aa4f-f6a667a7c4e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:23:18.656130 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffdd00-42e2-4074-aa4f-f6a667a7c4e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:18.657746 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffdd00-42e2-4074-aa4f-f6a667a7c4e0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:18.670477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1308/2609] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:23:18.674550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffdd00-42e2-4074-aa4f-f6a667a7c4e0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:18.684854 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffdd00-42e2-4074-aa4f-f6a667a7c4e0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:18.689784 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09825ca5-50d8-4e43-9016-357b934439c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:18.690443 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825ca5-50d8-4e43-9016-357b934439c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.690752 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825ca5-50d8-4e43-9016-357b934439c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.691025 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825ca5-50d8-4e43-9016-357b934439c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.692294 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09825ca5-50d8-4e43-9016-357b934439c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:18.694203 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09825ca5-50d8-4e43-9016-357b934439c4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:18.703643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9da85e-cfa7-490d-a0f1-43dc4d7029e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:18.705087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9da85e-cfa7-490d-a0f1-43dc4d7029e1 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:18.707661 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:18.715794 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1302/2610] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:23:18.725431 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1309/2611] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:18 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:23:18.729487 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9da85e-cfa7-490d-a0f1-43dc4d7029e1 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:18.740895 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9da85e-cfa7-490d-a0f1-43dc4d7029e1 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:18.800275 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f74c9c-ccbe-40e8-82e0-86236844f84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:18.800981 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f74c9c-ccbe-40e8-82e0-86236844f84e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.801289 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f74c9c-ccbe-40e8-82e0-86236844f84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.801561 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f74c9c-ccbe-40e8-82e0-86236844f84e admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.802286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f74c9c-ccbe-40e8-82e0-86236844f84e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:18.804324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f74c9c-ccbe-40e8-82e0-86236844f84e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:18.828519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1303/2612] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:18 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:18.830064 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09825ca5-50d8-4e43-9016-357b934439c4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:18.841756 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09825ca5-50d8-4e43-9016-357b934439c4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:18.847254 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add264b-66c9-4aa4-ae26-33f6dbcf99f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:18.847935 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add264b-66c9-4aa4-ae26-33f6dbcf99f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.848216 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add264b-66c9-4aa4-ae26-33f6dbcf99f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.848506 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add264b-66c9-4aa4-ae26-33f6dbcf99f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.849249 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add264b-66c9-4aa4-ae26-33f6dbcf99f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:18.851070 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add264b-66c9-4aa4-ae26-33f6dbcf99f8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:18.875929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1310/2613] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:18.879911 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f74c9c-ccbe-40e8-82e0-86236844f84e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:18.891854 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f74c9c-ccbe-40e8-82e0-86236844f84e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:18.896896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecffbd8-ac50-4dd6-bcfe-e4b1c8586311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:18.897809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecffbd8-ac50-4dd6-bcfe-e4b1c8586311 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.898205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecffbd8-ac50-4dd6-bcfe-e4b1c8586311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.898534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecffbd8-ac50-4dd6-bcfe-e4b1c8586311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.899360 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecffbd8-ac50-4dd6-bcfe-e4b1c8586311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:18.900976 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecffbd8-ac50-4dd6-bcfe-e4b1c8586311 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:18.912574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1304/2614] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:23:18.917024 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add264b-66c9-4aa4-ae26-33f6dbcf99f8 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:18.929154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add264b-66c9-4aa4-ae26-33f6dbcf99f8 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:18.935320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc82fbf-8b33-404e-b1df-2bbad83995ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:18.936220 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc82fbf-8b33-404e-b1df-2bbad83995ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.936507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc82fbf-8b33-404e-b1df-2bbad83995ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.936791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc82fbf-8b33-404e-b1df-2bbad83995ea admin admin] PATH_INFO: `/v3/projects/de0cc62c02cc411fb4e690f57044f910/users/dcb117cb2fb5447ea2c56894869843f0/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.955401 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc82fbf-8b33-404e-b1df-2bbad83995ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0cc62c02cc411fb4e690f57044f910, user_id=dcb117cb2fb5447ea2c56894869843f0, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:18.958105 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc82fbf-8b33-404e-b1df-2bbad83995ea admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:18.977042 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1311/2615] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:18 2022] PUT /identity/v3/projects/de0cc62c02cc411fb4e690f57044f910/users/dcb117cb2fb5447ea2c56894869843f0/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:18.978766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21966777-f946-4f20-90d7-d5816fa562de None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:18.979247 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21966777-f946-4f20-90d7-d5816fa562de None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:18.979441 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21966777-f946-4f20-90d7-d5816fa562de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:18.999467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-21966777-f946-4f20-90d7-d5816fa562de None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:19.000701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-21966777-f946-4f20-90d7-d5816fa562de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:19.067587 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1305/2616] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:23:19.078569 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc82fbf-8b33-404e-b1df-2bbad83995ea admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:19.080357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5bc82fbf-8b33-404e-b1df-2bbad83995ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:19.139184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc82fbf-8b33-404e-b1df-2bbad83995ea admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:19.143014 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c174d-bd89-4f04-b191-e862c49e913d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:19.143679 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c174d-bd89-4f04-b191-e862c49e913d service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:19.143968 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c174d-bd89-4f04-b191-e862c49e913d service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:19.144258 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c174d-bd89-4f04-b191-e862c49e913d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:19.154639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c174d-bd89-4f04-b191-e862c49e913d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:19.156078 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c174d-bd89-4f04-b191-e862c49e913d service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:19.165985 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1312/2617] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:20.091868 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21966777-f946-4f20-90d7-d5816fa562de None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:20.101188 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-21966777-f946-4f20-90d7-d5816fa562de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:20.114133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:20.193471 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21966777-f946-4f20-90d7-d5816fa562de None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:20.197163 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112c525-4b9b-408d-b096-819645c987b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:20.197820 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112c525-4b9b-408d-b096-819645c987b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:20.198099 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112c525-4b9b-408d-b096-819645c987b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:20.198371 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112c525-4b9b-408d-b096-819645c987b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:20.272633 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112c525-4b9b-408d-b096-819645c987b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:20.274099 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112c525-4b9b-408d-b096-819645c987b0 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:20.288306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1306/2618] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:23.535334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c53ce-3b9c-4717-be7e-4c1d843d29ec None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:23.535746 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c53ce-3b9c-4717-be7e-4c1d843d29ec None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:23.535872 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c53ce-3b9c-4717-be7e-4c1d843d29ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:23.564640 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-332c53ce-3b9c-4717-be7e-4c1d843d29ec None None] MFA Rules not processed for user `dcb117cb2fb5447ea2c56894869843f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:23.565898 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-332c53ce-3b9c-4717-be7e-4c1d843d29ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:23.649139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1313/2619] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:23.655535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112c525-4b9b-408d-b096-819645c987b0 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:23.670398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112c525-4b9b-408d-b096-819645c987b0 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:23.680991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323a45d-19ac-48ca-b2f8-85abb718debc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:23.682132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323a45d-19ac-48ca-b2f8-85abb718debc admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:23.682449 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323a45d-19ac-48ca-b2f8-85abb718debc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:23.682757 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323a45d-19ac-48ca-b2f8-85abb718debc admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:23.684417 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323a45d-19ac-48ca-b2f8-85abb718debc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:23.686949 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323a45d-19ac-48ca-b2f8-85abb718debc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:23.719312 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1307/2620] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:23 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:23.723505 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c53ce-3b9c-4717-be7e-4c1d843d29ec None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:23.739606 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c53ce-3b9c-4717-be7e-4c1d843d29ec None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:23.796123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:23.811042 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5947b-2b6a-4279-b5fe-37182c9afe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:23.811741 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5947b-2b6a-4279-b5fe-37182c9afe09 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:23.812035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5947b-2b6a-4279-b5fe-37182c9afe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:23.812323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5947b-2b6a-4279-b5fe-37182c9afe09 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:23.813023 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5947b-2b6a-4279-b5fe-37182c9afe09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:23.815059 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5947b-2b6a-4279-b5fe-37182c9afe09 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:23.840727 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1314/2621] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:23 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:23.841860 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323a45d-19ac-48ca-b2f8-85abb718debc admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:23.859155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323a45d-19ac-48ca-b2f8-85abb718debc admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:23.884961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cce862-ead8-4dd4-866f-80ef14744f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:23.885779 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cce862-ead8-4dd4-866f-80ef14744f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:23.887638 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cce862-ead8-4dd4-866f-80ef14744f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:23.887944 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cce862-ead8-4dd4-866f-80ef14744f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:23.888706 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cce862-ead8-4dd4-866f-80ef14744f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:23.890336 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cce862-ead8-4dd4-866f-80ef14744f71 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:23.902316 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1308/2622] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:23.907015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5947b-2b6a-4279-b5fe-37182c9afe09 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:23.918098 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5947b-2b6a-4279-b5fe-37182c9afe09 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:23.923199 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c7745-a7cd-4890-b3a0-9088890d0c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:23.923701 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c7745-a7cd-4890-b3a0-9088890d0c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:23.924010 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c7745-a7cd-4890-b3a0-9088890d0c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:23.924994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c7745-a7cd-4890-b3a0-9088890d0c90 admin admin] PATH_INFO: `/v3/projects/6c2fcd2a88404d45a021d31452ea2adf/users/fa7dece2be1c451aaf5639a8070c77c7/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:23.945798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c7745-a7cd-4890-b3a0-9088890d0c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2fcd2a88404d45a021d31452ea2adf, user_id=fa7dece2be1c451aaf5639a8070c77c7, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:23.948776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c7745-a7cd-4890-b3a0-9088890d0c90 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:23.963519 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1315/2623] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:23 2022] PUT /identity/v3/projects/6c2fcd2a88404d45a021d31452ea2adf/users/fa7dece2be1c451aaf5639a8070c77c7/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:23.968168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cce862-ead8-4dd4-866f-80ef14744f71 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:23.978858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cce862-ead8-4dd4-866f-80ef14744f71 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:24.045649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ed971-2d87-49e4-9ffe-2b6ac7fa7e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:24.046260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ed971-2d87-49e4-9ffe-2b6ac7fa7e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:24.046585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ed971-2d87-49e4-9ffe-2b6ac7fa7e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:24.046867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ed971-2d87-49e4-9ffe-2b6ac7fa7e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:24.047635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ed971-2d87-49e4-9ffe-2b6ac7fa7e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:24.049243 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ed971-2d87-49e4-9ffe-2b6ac7fa7e22 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:24.060662 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1309/2624] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:24.064739 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c7745-a7cd-4890-b3a0-9088890d0c90 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:24.076179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c7745-a7cd-4890-b3a0-9088890d0c90 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:24.081080 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86780f73-da33-40ec-9396-539c99669214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:24.082013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86780f73-da33-40ec-9396-539c99669214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:24.082295 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86780f73-da33-40ec-9396-539c99669214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:24.082662 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86780f73-da33-40ec-9396-539c99669214 admin admin] PATH_INFO: `/v3/projects/6c2fcd2a88404d45a021d31452ea2adf/users/fa7dece2be1c451aaf5639a8070c77c7/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:24.084657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86780f73-da33-40ec-9396-539c99669214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2fcd2a88404d45a021d31452ea2adf, user_id=fa7dece2be1c451aaf5639a8070c77c7, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:24.087361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86780f73-da33-40ec-9396-539c99669214 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:24.099236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1316/2625] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:24 2022] PUT /identity/v3/projects/6c2fcd2a88404d45a021d31452ea2adf/users/fa7dece2be1c451aaf5639a8070c77c7/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:24.214327 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ed971-2d87-49e4-9ffe-2b6ac7fa7e22 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:24.216676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-2b6ed971-2d87-49e4-9ffe-2b6ac7fa7e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:24.229525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ed971-2d87-49e4-9ffe-2b6ac7fa7e22 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:24.244226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:24.328594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0e203-5295-43b0-8df0-9dd79c8b2fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:24.330095 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0e203-5295-43b0-8df0-9dd79c8b2fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:24.330602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0e203-5295-43b0-8df0-9dd79c8b2fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:24.330992 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0e203-5295-43b0-8df0-9dd79c8b2fa2 admin admin] PATH_INFO: `/v3/users/77200203a71f4945a9029faaea1a5e0b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:24.333795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0e203-5295-43b0-8df0-9dd79c8b2fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77200203a71f4945a9029faaea1a5e0b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:24.336236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0e203-5295-43b0-8df0-9dd79c8b2fa2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:24.446726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-22e0e203-5295-43b0-8df0-9dd79c8b2fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77200203a71f4945a9029faaea1a5e0b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:24.447586 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-22e0e203-5295-43b0-8df0-9dd79c8b2fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77200203a71f4945a9029faaea1a5e0b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:24.467770 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-22e0e203-5295-43b0-8df0-9dd79c8b2fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77200203a71f4945a9029faaea1a5e0b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:24.468833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-22e0e203-5295-43b0-8df0-9dd79c8b2fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77200203a71f4945a9029faaea1a5e0b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:24.479511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-22e0e203-5295-43b0-8df0-9dd79c8b2fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77200203a71f4945a9029faaea1a5e0b'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:24.500151 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1310/2626] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:23:24 2022] DELETE /identity/v3/users/77200203a71f4945a9029faaea1a5e0b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:24.505458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf7f1b-d4f0-45df-b0f4-073ca058ff7e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:24.505849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf7f1b-d4f0-45df-b0f4-073ca058ff7e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:24.506206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf7f1b-d4f0-45df-b0f4-073ca058ff7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:24.532096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-87cf7f1b-d4f0-45df-b0f4-073ca058ff7e None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:24.533651 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-87cf7f1b-d4f0-45df-b0f4-073ca058ff7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:24.621870 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1317/2627] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:24.632291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0e203-5295-43b0-8df0-9dd79c8b2fa2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:24.633952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-22e0e203-5295-43b0-8df0-9dd79c8b2fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:24.714205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0e203-5295-43b0-8df0-9dd79c8b2fa2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:24.718072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77097e4b-a561-40ed-bc0f-927c96b05895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:24.718780 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77097e4b-a561-40ed-bc0f-927c96b05895 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:24.719065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77097e4b-a561-40ed-bc0f-927c96b05895 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:24.719348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77097e4b-a561-40ed-bc0f-927c96b05895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:24.729624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77097e4b-a561-40ed-bc0f-927c96b05895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:24.731458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77097e4b-a561-40ed-bc0f-927c96b05895 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:24.742853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1311/2628] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:25.116133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf7f1b-d4f0-45df-b0f4-073ca058ff7e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:25.119852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-87cf7f1b-d4f0-45df-b0f4-073ca058ff7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:25.143890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf7f1b-d4f0-45df-b0f4-073ca058ff7e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:25.159917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b9c40-7b10-4659-9eac-f1c06040313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:25.160806 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b9c40-7b10-4659-9eac-f1c06040313e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:25.161421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b9c40-7b10-4659-9eac-f1c06040313e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:25.161696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b9c40-7b10-4659-9eac-f1c06040313e admin admin] PATH_INFO: `/v3/projects/9d957b4cde754b96ab4faf3aa9d24d84` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:25.167845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b9c40-7b10-4659-9eac-f1c06040313e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d957b4cde754b96ab4faf3aa9d24d84)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:25.169966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b9c40-7b10-4659-9eac-f1c06040313e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:25.250249 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d34b9c40-7b10-4659-9eac-f1c06040313e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d957b4cde754b96ab4faf3aa9d24d84', 'request_id': 'req-d34b9c40-7b10-4659-9eac-f1c06040313e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:25.263004 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d34b9c40-7b10-4659-9eac-f1c06040313e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d957b4cde754b96ab4faf3aa9d24d84', 'request_id': 'req-d34b9c40-7b10-4659-9eac-f1c06040313e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:25.275800 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d34b9c40-7b10-4659-9eac-f1c06040313e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d957b4cde754b96ab4faf3aa9d24d84', 'request_id': 'req-d34b9c40-7b10-4659-9eac-f1c06040313e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:25.291879 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d34b9c40-7b10-4659-9eac-f1c06040313e admin admin] The token cache is being invalidate because project 9d957b4cde754b96ab4faf3aa9d24d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:25.293274 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d34b9c40-7b10-4659-9eac-f1c06040313e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:25.294082 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d34b9c40-7b10-4659-9eac-f1c06040313e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:25.296759 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1318/2629] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:25 2022] DELETE /identity/v3/projects/9d957b4cde754b96ab4faf3aa9d24d84 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:25.300564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77097e4b-a561-40ed-bc0f-927c96b05895 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:25.313683 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77097e4b-a561-40ed-bc0f-927c96b05895 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:25.358961 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:25.406672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520608b-8867-4fce-89ec-15547ef69f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:25.407723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520608b-8867-4fce-89ec-15547ef69f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:25.408011 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520608b-8867-4fce-89ec-15547ef69f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:25.408292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520608b-8867-4fce-89ec-15547ef69f79 admin admin] PATH_INFO: `/v3/users/d7bd8f7c48134401b25d77a73a069d04` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:25.409519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520608b-8867-4fce-89ec-15547ef69f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7bd8f7c48134401b25d77a73a069d04)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:25.411795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520608b-8867-4fce-89ec-15547ef69f79 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:25.480643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8520608b-8867-4fce-89ec-15547ef69f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7bd8f7c48134401b25d77a73a069d04'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:25.480643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8520608b-8867-4fce-89ec-15547ef69f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7bd8f7c48134401b25d77a73a069d04'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:25.500822 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8520608b-8867-4fce-89ec-15547ef69f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7bd8f7c48134401b25d77a73a069d04'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:25.502077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8520608b-8867-4fce-89ec-15547ef69f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7bd8f7c48134401b25d77a73a069d04'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:25.510590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8520608b-8867-4fce-89ec-15547ef69f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7bd8f7c48134401b25d77a73a069d04'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:25.528019 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1312/2630] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:23:25 2022] DELETE /identity/v3/users/d7bd8f7c48134401b25d77a73a069d04 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:25.919083 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b9c40-7b10-4659-9eac-f1c06040313e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:25.921077 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d34b9c40-7b10-4659-9eac-f1c06040313e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:25.941268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b9c40-7b10-4659-9eac-f1c06040313e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:25.977369 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:26.022380 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b06f4-0ed5-4899-bdf3-60ab6d0b2096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:26.024217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b06f4-0ed5-4899-bdf3-60ab6d0b2096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:26.024685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b06f4-0ed5-4899-bdf3-60ab6d0b2096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:26.025314 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b06f4-0ed5-4899-bdf3-60ab6d0b2096 admin admin] PATH_INFO: `/v3/projects/c500032de82d4a74aaab234fb4cdeb8e` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:26.027715 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b06f4-0ed5-4899-bdf3-60ab6d0b2096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c500032de82d4a74aaab234fb4cdeb8e)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:26.030568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b06f4-0ed5-4899-bdf3-60ab6d0b2096 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:26.137167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-567b06f4-0ed5-4899-bdf3-60ab6d0b2096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c500032de82d4a74aaab234fb4cdeb8e', 'request_id': 'req-567b06f4-0ed5-4899-bdf3-60ab6d0b2096'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:26.161649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-567b06f4-0ed5-4899-bdf3-60ab6d0b2096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c500032de82d4a74aaab234fb4cdeb8e', 'request_id': 'req-567b06f4-0ed5-4899-bdf3-60ab6d0b2096'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:26.175510 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-567b06f4-0ed5-4899-bdf3-60ab6d0b2096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c500032de82d4a74aaab234fb4cdeb8e', 'request_id': 'req-567b06f4-0ed5-4899-bdf3-60ab6d0b2096'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:26.192108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-567b06f4-0ed5-4899-bdf3-60ab6d0b2096 admin admin] The token cache is being invalidate because project c500032de82d4a74aaab234fb4cdeb8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:26.192972 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-567b06f4-0ed5-4899-bdf3-60ab6d0b2096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:26.193716 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-567b06f4-0ed5-4899-bdf3-60ab6d0b2096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:26.195573 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1319/2631] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:25 2022] DELETE /identity/v3/projects/c500032de82d4a74aaab234fb4cdeb8e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:26.201419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c785b5d-1349-4159-90a9-6af7e486328d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:26.201935 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c785b5d-1349-4159-90a9-6af7e486328d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:26.202039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c785b5d-1349-4159-90a9-6af7e486328d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:26.228825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3c785b5d-1349-4159-90a9-6af7e486328d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:26.229639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3c785b5d-1349-4159-90a9-6af7e486328d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:26.314563 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1313/2632] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:26.323381 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb6879-a9c9-441a-9d9e-327e4ea31f6d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:26.323735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb6879-a9c9-441a-9d9e-327e4ea31f6d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:26.324220 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb6879-a9c9-441a-9d9e-327e4ea31f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:26.346623 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a2eb6879-a9c9-441a-9d9e-327e4ea31f6d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:26.347895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a2eb6879-a9c9-441a-9d9e-327e4ea31f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:26.360857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1320/2633] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:26.361786 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c785b5d-1349-4159-90a9-6af7e486328d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:26.374031 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c785b5d-1349-4159-90a9-6af7e486328d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:26.380167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a162a23-eb77-4a8e-b56c-ec480d1709ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:26.380612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a162a23-eb77-4a8e-b56c-ec480d1709ed admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:26.380895 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a162a23-eb77-4a8e-b56c-ec480d1709ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:26.381168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a162a23-eb77-4a8e-b56c-ec480d1709ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:26.381931 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a162a23-eb77-4a8e-b56c-ec480d1709ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:23:26.382233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a162a23-eb77-4a8e-b56c-ec480d1709ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:26.384095 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a162a23-eb77-4a8e-b56c-ec480d1709ed admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:26.399233 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1314/2634] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:23:26.403237 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb6879-a9c9-441a-9d9e-327e4ea31f6d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:26.414057 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb6879-a9c9-441a-9d9e-327e4ea31f6d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:26.420156 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04bb78-1030-457f-be74-e7cfbcc6cc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:26.421019 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04bb78-1030-457f-be74-e7cfbcc6cc3a admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:26.421896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04bb78-1030-457f-be74-e7cfbcc6cc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:26.421896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04bb78-1030-457f-be74-e7cfbcc6cc3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:26.422607 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04bb78-1030-457f-be74-e7cfbcc6cc3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:26.424665 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04bb78-1030-457f-be74-e7cfbcc6cc3a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:26.459819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1321/2635] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:26 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:26.464166 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a162a23-eb77-4a8e-b56c-ec480d1709ed admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:26.475634 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a162a23-eb77-4a8e-b56c-ec480d1709ed admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:26.531322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:26.562796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff0b8d-d55b-4d49-9950-7d9fb050a1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:26.563480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff0b8d-d55b-4d49-9950-7d9fb050a1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:26.563764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff0b8d-d55b-4d49-9950-7d9fb050a1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:26.564041 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff0b8d-d55b-4d49-9950-7d9fb050a1e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:26.564739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff0b8d-d55b-4d49-9950-7d9fb050a1e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:26.566817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff0b8d-d55b-4d49-9950-7d9fb050a1e9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:26.590743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1315/2636] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:26 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:23:26.594415 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04bb78-1030-457f-be74-e7cfbcc6cc3a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:26.606692 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04bb78-1030-457f-be74-e7cfbcc6cc3a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:26.624872 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450e2a4-88a1-489f-b50a-6360d2dfff9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:26.625655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450e2a4-88a1-489f-b50a-6360d2dfff9d admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:26.625987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450e2a4-88a1-489f-b50a-6360d2dfff9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:26.627320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450e2a4-88a1-489f-b50a-6360d2dfff9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:26.628086 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450e2a4-88a1-489f-b50a-6360d2dfff9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:26.630129 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450e2a4-88a1-489f-b50a-6360d2dfff9d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:26.642249 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1322/2637] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:23:26.646774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff0b8d-d55b-4d49-9950-7d9fb050a1e9 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:26.658264 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff0b8d-d55b-4d49-9950-7d9fb050a1e9 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:26.664926 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda3026-2958-4017-9837-9aa0c4ca9837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:26.665739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda3026-2958-4017-9837-9aa0c4ca9837 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:26.665891 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda3026-2958-4017-9837-9aa0c4ca9837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:26.666164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda3026-2958-4017-9837-9aa0c4ca9837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:26.666943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda3026-2958-4017-9837-9aa0c4ca9837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:26.669841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda3026-2958-4017-9837-9aa0c4ca9837 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:26.682470 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1316/2638] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:26.686275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450e2a4-88a1-489f-b50a-6360d2dfff9d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:26.699499 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450e2a4-88a1-489f-b50a-6360d2dfff9d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:26.705577 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893335c-ae9b-48e5-903d-c5c5720752e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:26.707282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893335c-ae9b-48e5-903d-c5c5720752e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:26.707677 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893335c-ae9b-48e5-903d-c5c5720752e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:26.708166 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893335c-ae9b-48e5-903d-c5c5720752e4 admin admin] PATH_INFO: `/v3/projects/04acf36793c147b6b9e07d3a8cb51039/users/78bfa252911f4f19a62a921821d8a1b3/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:26.726479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893335c-ae9b-48e5-903d-c5c5720752e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04acf36793c147b6b9e07d3a8cb51039, user_id=78bfa252911f4f19a62a921821d8a1b3, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:26.730999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893335c-ae9b-48e5-903d-c5c5720752e4 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:26.761897 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1323/2639] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:26 2022] PUT /identity/v3/projects/04acf36793c147b6b9e07d3a8cb51039/users/78bfa252911f4f19a62a921821d8a1b3/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:26.763313 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b74b1-28e7-44c3-b694-f487ff213a3b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:26.763616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b74b1-28e7-44c3-b694-f487ff213a3b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:26.763901 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b74b1-28e7-44c3-b694-f487ff213a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:26.801867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f90b74b1-28e7-44c3-b694-f487ff213a3b None None] MFA Rules not processed for user `78bfa252911f4f19a62a921821d8a1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:26.803182 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f90b74b1-28e7-44c3-b694-f487ff213a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:26.900236 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1317/2640] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:26.904759 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893335c-ae9b-48e5-903d-c5c5720752e4 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:26.981755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:27.007868 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893335c-ae9b-48e5-903d-c5c5720752e4 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:27.015183 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e3f6e-ee80-4b6b-8460-825aaacaaf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:27.017051 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e3f6e-ee80-4b6b-8460-825aaacaaf87 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:27.017051 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e3f6e-ee80-4b6b-8460-825aaacaaf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:27.017051 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e3f6e-ee80-4b6b-8460-825aaacaaf87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:27.017380 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e3f6e-ee80-4b6b-8460-825aaacaaf87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:27.019890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e3f6e-ee80-4b6b-8460-825aaacaaf87 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:27.065682 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1324/2641] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:26 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:27.069525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b74b1-28e7-44c3-b694-f487ff213a3b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:27.087463 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b74b1-28e7-44c3-b694-f487ff213a3b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:27.277124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca8d80-15eb-4744-b8a6-15e1e8e30cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:27.277897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca8d80-15eb-4744-b8a6-15e1e8e30cfe admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:27.278108 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca8d80-15eb-4744-b8a6-15e1e8e30cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:27.278390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca8d80-15eb-4744-b8a6-15e1e8e30cfe admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:27.279141 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca8d80-15eb-4744-b8a6-15e1e8e30cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:27.281126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca8d80-15eb-4744-b8a6-15e1e8e30cfe admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:27.320600 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1318/2642] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:27 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:27.326276 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e3f6e-ee80-4b6b-8460-825aaacaaf87 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:27.372253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e3f6e-ee80-4b6b-8460-825aaacaaf87 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:27.390447 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fba71-e696-4ef3-83d9-8c976aac84f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:27.391455 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fba71-e696-4ef3-83d9-8c976aac84f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:27.391747 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fba71-e696-4ef3-83d9-8c976aac84f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:27.392203 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fba71-e696-4ef3-83d9-8c976aac84f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:27.393004 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fba71-e696-4ef3-83d9-8c976aac84f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:27.394867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fba71-e696-4ef3-83d9-8c976aac84f0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:27.411746 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1325/2643] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:23:27.415519 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca8d80-15eb-4744-b8a6-15e1e8e30cfe admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:27.433503 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca8d80-15eb-4744-b8a6-15e1e8e30cfe admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:27.441799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be682e63-9011-44ec-9cfb-3cb2768c7830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:27.443713 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be682e63-9011-44ec-9cfb-3cb2768c7830 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:27.444467 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be682e63-9011-44ec-9cfb-3cb2768c7830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:27.445705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be682e63-9011-44ec-9cfb-3cb2768c7830 admin admin] PATH_INFO: `/v3/projects/c49434311184448881ac6cb06b17e86c/users/c076aac0f49d448895452f5aafa06bdc/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:27.469490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be682e63-9011-44ec-9cfb-3cb2768c7830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49434311184448881ac6cb06b17e86c, user_id=c076aac0f49d448895452f5aafa06bdc, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:27.472255 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be682e63-9011-44ec-9cfb-3cb2768c7830 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:27.502563 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1319/2644] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:27 2022] PUT /identity/v3/projects/c49434311184448881ac6cb06b17e86c/users/c076aac0f49d448895452f5aafa06bdc/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:27.507038 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fba71-e696-4ef3-83d9-8c976aac84f0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:27.522984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fba71-e696-4ef3-83d9-8c976aac84f0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:27.628815 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89975e91-a2fd-4e10-998f-049008f9171b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:27.629526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89975e91-a2fd-4e10-998f-049008f9171b admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:27.629823 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89975e91-a2fd-4e10-998f-049008f9171b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:27.630150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89975e91-a2fd-4e10-998f-049008f9171b admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:27.631304 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89975e91-a2fd-4e10-998f-049008f9171b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:27.637068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89975e91-a2fd-4e10-998f-049008f9171b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:27.658975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1326/2645] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:27.663218 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be682e63-9011-44ec-9cfb-3cb2768c7830 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:27.692148 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be682e63-9011-44ec-9cfb-3cb2768c7830 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:27.706085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c756a49-45a9-46af-bdb8-b97664d20f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:27.707035 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c756a49-45a9-46af-bdb8-b97664d20f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:27.707320 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c756a49-45a9-46af-bdb8-b97664d20f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:27.707893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c756a49-45a9-46af-bdb8-b97664d20f5a admin admin] PATH_INFO: `/v3/projects/c49434311184448881ac6cb06b17e86c/users/c076aac0f49d448895452f5aafa06bdc/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:27.715754 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c756a49-45a9-46af-bdb8-b97664d20f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49434311184448881ac6cb06b17e86c, user_id=c076aac0f49d448895452f5aafa06bdc, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:27.720124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c756a49-45a9-46af-bdb8-b97664d20f5a admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:27.766320 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1320/2646] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:27 2022] PUT /identity/v3/projects/c49434311184448881ac6cb06b17e86c/users/c076aac0f49d448895452f5aafa06bdc/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:27.777403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093038b5-a55e-46df-9076-bf54157feedc None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:27.777776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093038b5-a55e-46df-9076-bf54157feedc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:27.778175 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093038b5-a55e-46df-9076-bf54157feedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:27.845987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-093038b5-a55e-46df-9076-bf54157feedc None None] MFA Rules not processed for user `c076aac0f49d448895452f5aafa06bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:27.847834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-093038b5-a55e-46df-9076-bf54157feedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:27.973581 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1327/2647] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:27.989477 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c756a49-45a9-46af-bdb8-b97664d20f5a admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:27.992183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9c756a49-45a9-46af-bdb8-b97664d20f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:28.005162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:28.075653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c756a49-45a9-46af-bdb8-b97664d20f5a admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:28.087533 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15004b08-9600-49d4-a2b1-8b2c611164f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:28.088397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15004b08-9600-49d4-a2b1-8b2c611164f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:28.088748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15004b08-9600-49d4-a2b1-8b2c611164f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:28.089844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15004b08-9600-49d4-a2b1-8b2c611164f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:28.108097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15004b08-9600-49d4-a2b1-8b2c611164f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:28.109865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15004b08-9600-49d4-a2b1-8b2c611164f6 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:28.125092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1321/2648] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:28.737279 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093038b5-a55e-46df-9076-bf54157feedc None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:28.749906 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093038b5-a55e-46df-9076-bf54157feedc None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:28.783427 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec6c51-4ea5-42a9-889d-2d546f79b1a4 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c076aac0f49d448895452f5aafa06bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c49434311184448881ac6cb06b17e86c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:28.784749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec6c51-4ea5-42a9-889d-2d546f79b1a4 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:28.785061 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec6c51-4ea5-42a9-889d-2d546f79b1a4 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:28.785429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec6c51-4ea5-42a9-889d-2d546f79b1a4 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:28.786639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec6c51-4ea5-42a9-889d-2d546f79b1a4 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:23:28.788751 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec6c51-4ea5-42a9-889d-2d546f79b1a4 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:28.790878 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec6c51-4ea5-42a9-889d-2d546f79b1a4 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:28.806271 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1328/2649] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:23:28.812080 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15004b08-9600-49d4-a2b1-8b2c611164f6 service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:28.824265 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15004b08-9600-49d4-a2b1-8b2c611164f6 service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:28.831540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad36cd-b0e0-4eba-afe4-5d422cba4bc6 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c076aac0f49d448895452f5aafa06bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c49434311184448881ac6cb06b17e86c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:28.832309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad36cd-b0e0-4eba-afe4-5d422cba4bc6 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:28.832608 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad36cd-b0e0-4eba-afe4-5d422cba4bc6 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:28.832893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad36cd-b0e0-4eba-afe4-5d422cba4bc6 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:28.833596 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad36cd-b0e0-4eba-afe4-5d422cba4bc6 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:28.835936 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad36cd-b0e0-4eba-afe4-5d422cba4bc6 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:28.873460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1322/2650] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:28 2022] POST /identity/v3/projects => generated 355 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:23:28.877223 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec6c51-4ea5-42a9-889d-2d546f79b1a4 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:28.891039 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec6c51-4ea5-42a9-889d-2d546f79b1a4 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:28.936458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:28.976709 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23342ec0-6a65-46f0-9402-24537be1f0fd tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c076aac0f49d448895452f5aafa06bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c49434311184448881ac6cb06b17e86c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:28.977507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23342ec0-6a65-46f0-9402-24537be1f0fd tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:28.977861 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23342ec0-6a65-46f0-9402-24537be1f0fd tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:28.978289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23342ec0-6a65-46f0-9402-24537be1f0fd tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:28.980551 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23342ec0-6a65-46f0-9402-24537be1f0fd tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:23:28.981107 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23342ec0-6a65-46f0-9402-24537be1f0fd tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:28.983644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23342ec0-6a65-46f0-9402-24537be1f0fd tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:29.005104 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1329/2651] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:23:29.053276 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad36cd-b0e0-4eba-afe4-5d422cba4bc6 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:29.067887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad36cd-b0e0-4eba-afe4-5d422cba4bc6 tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:29.095812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39b4f5-9d2f-4678-b67b-3311922e824c tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c076aac0f49d448895452f5aafa06bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c49434311184448881ac6cb06b17e86c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:29.096722 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39b4f5-9d2f-4678-b67b-3311922e824c tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:29.097018 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39b4f5-9d2f-4678-b67b-3311922e824c tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:29.097303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39b4f5-9d2f-4678-b67b-3311922e824c tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] PATH_INFO: `/v3/projects/24936c6c47d744568beb6a309295296b` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:29.115597 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39b4f5-9d2f-4678-b67b-3311922e824c tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] RBAC: Authorizing `identity:delete_project(project_id=24936c6c47d744568beb6a309295296b)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:29.117567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39b4f5-9d2f-4678-b67b-3311922e824c tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:29.228214 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6a39b4f5-9d2f-4678-b67b-3311922e824c tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24936c6c47d744568beb6a309295296b', 'request_id': 'req-6a39b4f5-9d2f-4678-b67b-3311922e824c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:29.242194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6a39b4f5-9d2f-4678-b67b-3311922e824c tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24936c6c47d744568beb6a309295296b', 'request_id': 'req-6a39b4f5-9d2f-4678-b67b-3311922e824c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:29.258770 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6a39b4f5-9d2f-4678-b67b-3311922e824c tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24936c6c47d744568beb6a309295296b', 'request_id': 'req-6a39b4f5-9d2f-4678-b67b-3311922e824c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:29.275406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6a39b4f5-9d2f-4678-b67b-3311922e824c tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] The token cache is being invalidate because project 24936c6c47d744568beb6a309295296b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:29.275971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6a39b4f5-9d2f-4678-b67b-3311922e824c tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:29.277639 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-6a39b4f5-9d2f-4678-b67b-3311922e824c tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:29.279898 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1323/2652] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:29 2022] DELETE /identity/v3/projects/24936c6c47d744568beb6a309295296b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:29.320340 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef918f-6d5d-4b39-a98c-341ae72b1eb5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:29.321182 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef918f-6d5d-4b39-a98c-341ae72b1eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:29.321855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef918f-6d5d-4b39-a98c-341ae72b1eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:29.369403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ecef918f-6d5d-4b39-a98c-341ae72b1eb5 None None] MFA Rules not processed for user `fa7dece2be1c451aaf5639a8070c77c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:29.370905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ecef918f-6d5d-4b39-a98c-341ae72b1eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:29.460603 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1330/2653] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:29.476220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39b4f5-9d2f-4678-b67b-3311922e824c tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:29.477735 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-6a39b4f5-9d2f-4678-b67b-3311922e824c tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:29.531344 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef918f-6d5d-4b39-a98c-341ae72b1eb5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:29.532816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ecef918f-6d5d-4b39-a98c-341ae72b1eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:29.586492 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:29.590776 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39b4f5-9d2f-4678-b67b-3311922e824c tempest-VolumeQuotaClassesTest-1082254255 tempest-VolumeQuotaClassesTest-1082254255-project-admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:29.598524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd484dc0-b97d-46fe-8416-b905106272a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59174974208c469b8bb44d94d0e55427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:29.598524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd484dc0-b97d-46fe-8416-b905106272a0 service glance] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:29.598524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd484dc0-b97d-46fe-8416-b905106272a0 service glance] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:29.598524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd484dc0-b97d-46fe-8416-b905106272a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:29.601339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-fd484dc0-b97d-46fe-8416-b905106272a0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:29.615323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef918f-6d5d-4b39-a98c-341ae72b1eb5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:29.620779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175b0eb-6240-4985-aaa3-87308ded73a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:29.621825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175b0eb-6240-4985-aaa3-87308ded73a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:29.622179 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175b0eb-6240-4985-aaa3-87308ded73a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:29.622565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175b0eb-6240-4985-aaa3-87308ded73a9 admin admin] PATH_INFO: `/v3/users/78bfa252911f4f19a62a921821d8a1b3` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:29.623861 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175b0eb-6240-4985-aaa3-87308ded73a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78bfa252911f4f19a62a921821d8a1b3)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:29.625857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175b0eb-6240-4985-aaa3-87308ded73a9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:29.694097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd484dc0-b97d-46fe-8416-b905106272a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:29.698421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd484dc0-b97d-46fe-8416-b905106272a0 service glance] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:29.705330 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e175b0eb-6240-4985-aaa3-87308ded73a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78bfa252911f4f19a62a921821d8a1b3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:29.724624 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1324/2654] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:23:29.725388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:29.734718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e175b0eb-6240-4985-aaa3-87308ded73a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78bfa252911f4f19a62a921821d8a1b3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:29.736663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e175b0eb-6240-4985-aaa3-87308ded73a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78bfa252911f4f19a62a921821d8a1b3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:29.737350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e175b0eb-6240-4985-aaa3-87308ded73a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78bfa252911f4f19a62a921821d8a1b3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:29.749060 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e175b0eb-6240-4985-aaa3-87308ded73a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78bfa252911f4f19a62a921821d8a1b3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:29.767924 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1331/2655] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:23:29 2022] DELETE /identity/v3/users/78bfa252911f4f19a62a921821d8a1b3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:29.772227 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147d43e-0c60-42b7-b7f9-6e6681bdae16 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:29.772917 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147d43e-0c60-42b7-b7f9-6e6681bdae16 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:29.773448 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147d43e-0c60-42b7-b7f9-6e6681bdae16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:29.813500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-7147d43e-0c60-42b7-b7f9-6e6681bdae16 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:29.814787 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7147d43e-0c60-42b7-b7f9-6e6681bdae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:29.865768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbc65f-6c5d-4433-8406-dc50fbbeba6e None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:29.866964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbc65f-6c5d-4433-8406-dc50fbbeba6e None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:29.867547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbc65f-6c5d-4433-8406-dc50fbbeba6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:29.890764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-40dbc65f-6c5d-4433-8406-dc50fbbeba6e None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:29.892081 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-40dbc65f-6c5d-4433-8406-dc50fbbeba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:29.899631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1325/2656] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:29.911475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147d43e-0c60-42b7-b7f9-6e6681bdae16 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:29.912914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-7147d43e-0c60-42b7-b7f9-6e6681bdae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:29.960973 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1332/2657] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 16 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:23:29.994534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147d43e-0c60-42b7-b7f9-6e6681bdae16 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:29.999474 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104aad03-86b9-4e73-b683-9dd8678f5710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:30.000019 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104aad03-86b9-4e73-b683-9dd8678f5710 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:30.000389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104aad03-86b9-4e73-b683-9dd8678f5710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:30.000638 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104aad03-86b9-4e73-b683-9dd8678f5710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:30.012006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104aad03-86b9-4e73-b683-9dd8678f5710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:30.013693 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104aad03-86b9-4e73-b683-9dd8678f5710 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:30.025338 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1326/2658] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:23:30.026311 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbc65f-6c5d-4433-8406-dc50fbbeba6e None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:30.028226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-40dbc65f-6c5d-4433-8406-dc50fbbeba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:30.124518 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbc65f-6c5d-4433-8406-dc50fbbeba6e None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:30.129841 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e23ac-15d4-48da-b73e-84d7de434f84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:30.130547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e23ac-15d4-48da-b73e-84d7de434f84 service swift] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:30.130837 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e23ac-15d4-48da-b73e-84d7de434f84 service swift] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:30.131123 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e23ac-15d4-48da-b73e-84d7de434f84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:30.141075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e23ac-15d4-48da-b73e-84d7de434f84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:30.142739 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e23ac-15d4-48da-b73e-84d7de434f84 service swift] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:30.153531 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1333/2659] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:23:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 16:23:30.427389 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104aad03-86b9-4e73-b683-9dd8678f5710 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:30.428853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-104aad03-86b9-4e73-b683-9dd8678f5710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:30.456846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104aad03-86b9-4e73-b683-9dd8678f5710 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:30.467489 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:30.468391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:30.468678 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:30.468954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42 admin admin] PATH_INFO: `/v3/projects/04acf36793c147b6b9e07d3a8cb51039` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:30.470458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04acf36793c147b6b9e07d3a8cb51039)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:30.472827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:30.583040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:30.604223 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04acf36793c147b6b9e07d3a8cb51039', 'request_id': 'req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:30.615144 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04acf36793c147b6b9e07d3a8cb51039', 'request_id': 'req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:30.644841 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04acf36793c147b6b9e07d3a8cb51039', 'request_id': 'req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:30.657768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42 admin admin] The token cache is being invalidate because project 04acf36793c147b6b9e07d3a8cb51039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:30.658112 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:30.658905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:30.660764 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1327/2660] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:30 2022] DELETE /identity/v3/projects/04acf36793c147b6b9e07d3a8cb51039 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:30.664818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e23ac-15d4-48da-b73e-84d7de434f84 service swift] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:30.681853 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e23ac-15d4-48da-b73e-84d7de434f84 service swift] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:30.769082 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c30e7-5d6a-4545-994a-5c1885fd8614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:30.769965 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c30e7-5d6a-4545-994a-5c1885fd8614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:30.770394 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c30e7-5d6a-4545-994a-5c1885fd8614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:30.770711 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c30e7-5d6a-4545-994a-5c1885fd8614 admin admin] PATH_INFO: `/v3/users/c076aac0f49d448895452f5aafa06bdc` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:30.771943 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c30e7-5d6a-4545-994a-5c1885fd8614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c076aac0f49d448895452f5aafa06bdc)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:30.773866 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c30e7-5d6a-4545-994a-5c1885fd8614 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:30.789569 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:30.855196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f71c30e7-5d6a-4545-994a-5c1885fd8614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c076aac0f49d448895452f5aafa06bdc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:30.873692 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f71c30e7-5d6a-4545-994a-5c1885fd8614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c076aac0f49d448895452f5aafa06bdc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:30.874769 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f71c30e7-5d6a-4545-994a-5c1885fd8614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c076aac0f49d448895452f5aafa06bdc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:30.875409 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f71c30e7-5d6a-4545-994a-5c1885fd8614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c076aac0f49d448895452f5aafa06bdc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:30.893815 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-f71c30e7-5d6a-4545-994a-5c1885fd8614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c076aac0f49d448895452f5aafa06bdc'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:30.926302 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1334/2661] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:23:30 2022] DELETE /identity/v3/users/c076aac0f49d448895452f5aafa06bdc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:31.332490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:31.333978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:31.385014 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f11c3-95cc-4347-b7c1-3b11e57e4a42 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:31.472138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333d0ef-1759-46c2-83cc-80f1e361f736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:31.473038 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333d0ef-1759-46c2-83cc-80f1e361f736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:31.473323 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333d0ef-1759-46c2-83cc-80f1e361f736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:31.473601 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333d0ef-1759-46c2-83cc-80f1e361f736 admin admin] PATH_INFO: `/v3/projects/c49434311184448881ac6cb06b17e86c` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:31.475014 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333d0ef-1759-46c2-83cc-80f1e361f736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c49434311184448881ac6cb06b17e86c)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:31.477194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333d0ef-1759-46c2-83cc-80f1e361f736 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:31.544842 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8333d0ef-1759-46c2-83cc-80f1e361f736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c49434311184448881ac6cb06b17e86c', 'request_id': 'req-8333d0ef-1759-46c2-83cc-80f1e361f736'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:31.554979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8333d0ef-1759-46c2-83cc-80f1e361f736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c49434311184448881ac6cb06b17e86c', 'request_id': 'req-8333d0ef-1759-46c2-83cc-80f1e361f736'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:31.567363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8333d0ef-1759-46c2-83cc-80f1e361f736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c49434311184448881ac6cb06b17e86c', 'request_id': 'req-8333d0ef-1759-46c2-83cc-80f1e361f736'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:31.583378 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8333d0ef-1759-46c2-83cc-80f1e361f736 admin admin] The token cache is being invalidate because project c49434311184448881ac6cb06b17e86c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:31.583681 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8333d0ef-1759-46c2-83cc-80f1e361f736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:31.584342 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8333d0ef-1759-46c2-83cc-80f1e361f736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:31.590628 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1328/2662] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:31 2022] DELETE /identity/v3/projects/c49434311184448881ac6cb06b17e86c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:31.591668 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a470008-b178-4230-a854-ba91ac99cfb1 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:31.591979 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a470008-b178-4230-a854-ba91ac99cfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:31.592262 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a470008-b178-4230-a854-ba91ac99cfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:31.624032 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6a470008-b178-4230-a854-ba91ac99cfb1 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:31.625434 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6a470008-b178-4230-a854-ba91ac99cfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:31.742835 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1335/2663] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:31.747222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997774b-b5bc-43e9-a40e-a7c912b12cee None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:31.747512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997774b-b5bc-43e9-a40e-a7c912b12cee None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:31.747790 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997774b-b5bc-43e9-a40e-a7c912b12cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:31.786180 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5997774b-b5bc-43e9-a40e-a7c912b12cee None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:31.786180 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5997774b-b5bc-43e9-a40e-a7c912b12cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:31.795827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1329/2664] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:31.800159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a470008-b178-4230-a854-ba91ac99cfb1 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:31.812867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a470008-b178-4230-a854-ba91ac99cfb1 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:31.819365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774cc4-b62b-4b72-ab04-4df6d66b2c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:31.820641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774cc4-b62b-4b72-ab04-4df6d66b2c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:31.821124 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774cc4-b62b-4b72-ab04-4df6d66b2c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:31.821609 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774cc4-b62b-4b72-ab04-4df6d66b2c4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:31.825160 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8774cc4-b62b-4b72-ab04-4df6d66b2c4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:23:31.825686 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8774cc4-b62b-4b72-ab04-4df6d66b2c4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:31.827684 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8774cc4-b62b-4b72-ab04-4df6d66b2c4d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:31.850554 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1336/2665] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:23:31.852307 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997774b-b5bc-43e9-a40e-a7c912b12cee None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:31.865141 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997774b-b5bc-43e9-a40e-a7c912b12cee None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:31.870954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233e8d2-ec64-4932-84cf-f3df57bcd430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:31.871739 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233e8d2-ec64-4932-84cf-f3df57bcd430 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:31.872089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233e8d2-ec64-4932-84cf-f3df57bcd430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:31.872433 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233e8d2-ec64-4932-84cf-f3df57bcd430 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:31.873368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233e8d2-ec64-4932-84cf-f3df57bcd430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:31.875443 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233e8d2-ec64-4932-84cf-f3df57bcd430 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:31.924401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1330/2666] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:31 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:31.925055 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774cc4-b62b-4b72-ab04-4df6d66b2c4d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:31.936900 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774cc4-b62b-4b72-ab04-4df6d66b2c4d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:32.072778 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002dd69-ab65-4032-aa01-db03a2d57a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:32.074037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002dd69-ab65-4032-aa01-db03a2d57a3d admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:32.074037 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002dd69-ab65-4032-aa01-db03a2d57a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:32.074368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002dd69-ab65-4032-aa01-db03a2d57a3d admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:32.075046 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002dd69-ab65-4032-aa01-db03a2d57a3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:32.077137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002dd69-ab65-4032-aa01-db03a2d57a3d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:32.110379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1337/2667] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:31 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:32.114077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233e8d2-ec64-4932-84cf-f3df57bcd430 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:32.127651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233e8d2-ec64-4932-84cf-f3df57bcd430 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:32.132684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbe793-66f9-49ed-896f-482cbb77ef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:32.133479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbe793-66f9-49ed-896f-482cbb77ef6c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:32.133772 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbe793-66f9-49ed-896f-482cbb77ef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:32.134049 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbe793-66f9-49ed-896f-482cbb77ef6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:32.134881 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbe793-66f9-49ed-896f-482cbb77ef6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:32.136675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbe793-66f9-49ed-896f-482cbb77ef6c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:32.173016 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1331/2668] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:32.174294 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002dd69-ab65-4032-aa01-db03a2d57a3d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:32.189456 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:32.194874 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002dd69-ab65-4032-aa01-db03a2d57a3d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:32.203049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286aa50-c1b5-4421-b6f1-59711fd64797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:32.204257 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286aa50-c1b5-4421-b6f1-59711fd64797 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:32.204718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286aa50-c1b5-4421-b6f1-59711fd64797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:32.205281 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286aa50-c1b5-4421-b6f1-59711fd64797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:32.206176 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286aa50-c1b5-4421-b6f1-59711fd64797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:32.208387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286aa50-c1b5-4421-b6f1-59711fd64797 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:32.226501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1338/2669] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:32.227812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbe793-66f9-49ed-896f-482cbb77ef6c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:32.239246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbe793-66f9-49ed-896f-482cbb77ef6c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:32.250867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e984b-7648-4d27-a6a1-bcda7f757467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:32.251782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e984b-7648-4d27-a6a1-bcda7f757467 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:32.252066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e984b-7648-4d27-a6a1-bcda7f757467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:32.252341 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e984b-7648-4d27-a6a1-bcda7f757467 admin admin] PATH_INFO: `/v3/projects/3b726bfd22764577856c9dd9dedb1637/users/9e1308f3db3f4e11a098d1962f817c45/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:32.273309 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e984b-7648-4d27-a6a1-bcda7f757467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b726bfd22764577856c9dd9dedb1637, user_id=9e1308f3db3f4e11a098d1962f817c45, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:32.275986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e984b-7648-4d27-a6a1-bcda7f757467 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:32.284492 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:32.310167 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1332/2670] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:32 2022] PUT /identity/v3/projects/3b726bfd22764577856c9dd9dedb1637/users/9e1308f3db3f4e11a098d1962f817c45/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:32.311491 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67b1ee-9ecd-4d1e-9ab2-3c262be306ad None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:32.311984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67b1ee-9ecd-4d1e-9ab2-3c262be306ad None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:32.312427 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67b1ee-9ecd-4d1e-9ab2-3c262be306ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:32.361438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ed67b1ee-9ecd-4d1e-9ab2-3c262be306ad None None] MFA Rules not processed for user `9e1308f3db3f4e11a098d1962f817c45`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:32.362761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ed67b1ee-9ecd-4d1e-9ab2-3c262be306ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:32.458182 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e984b-7648-4d27-a6a1-bcda7f757467 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:32.464789 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1339/2671] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:32.551186 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e984b-7648-4d27-a6a1-bcda7f757467 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:32.556870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed7e00-6395-4308-b985-12511cb658fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:32.558491 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed7e00-6395-4308-b985-12511cb658fd admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:32.558964 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed7e00-6395-4308-b985-12511cb658fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:32.559340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed7e00-6395-4308-b985-12511cb658fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:32.560902 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed7e00-6395-4308-b985-12511cb658fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:32.565254 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed7e00-6395-4308-b985-12511cb658fd admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:32.599039 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1333/2672] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:32 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:32.602697 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67b1ee-9ecd-4d1e-9ab2-3c262be306ad None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:32.618075 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67b1ee-9ecd-4d1e-9ab2-3c262be306ad None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:32.697308 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093396eb-cc0f-48c1-b35e-2904e07ef132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:32.697994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093396eb-cc0f-48c1-b35e-2904e07ef132 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:32.698322 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093396eb-cc0f-48c1-b35e-2904e07ef132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:32.699095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093396eb-cc0f-48c1-b35e-2904e07ef132 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:32.702490 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093396eb-cc0f-48c1-b35e-2904e07ef132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:32.703641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093396eb-cc0f-48c1-b35e-2904e07ef132 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:32.735351 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1340/2673] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:32 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:32.736530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed7e00-6395-4308-b985-12511cb658fd admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:32.749014 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed7e00-6395-4308-b985-12511cb658fd admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:32.763500 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177861d7-fc80-46b8-99ea-ccd246464235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:32.764597 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177861d7-fc80-46b8-99ea-ccd246464235 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:32.765101 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177861d7-fc80-46b8-99ea-ccd246464235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:32.765601 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177861d7-fc80-46b8-99ea-ccd246464235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:32.766621 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177861d7-fc80-46b8-99ea-ccd246464235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:32.768462 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177861d7-fc80-46b8-99ea-ccd246464235 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:32.784331 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1334/2674] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:32.788357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093396eb-cc0f-48c1-b35e-2904e07ef132 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:32.804110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093396eb-cc0f-48c1-b35e-2904e07ef132 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:32.809377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f40083-5940-4037-b062-4b482954f398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:32.810507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f40083-5940-4037-b062-4b482954f398 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:32.810805 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f40083-5940-4037-b062-4b482954f398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:32.811148 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f40083-5940-4037-b062-4b482954f398 admin admin] PATH_INFO: `/v3/projects/a33b0f19906646afa1f9383a1be1b2f4/users/a4a0d6c15d2747f4ae3b20ec40a0c56e/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:32.835855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f40083-5940-4037-b062-4b482954f398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33b0f19906646afa1f9383a1be1b2f4, user_id=a4a0d6c15d2747f4ae3b20ec40a0c56e, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:32.838954 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f40083-5940-4037-b062-4b482954f398 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:32.862335 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1341/2675] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:32 2022] PUT /identity/v3/projects/a33b0f19906646afa1f9383a1be1b2f4/users/a4a0d6c15d2747f4ae3b20ec40a0c56e/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:32.866351 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177861d7-fc80-46b8-99ea-ccd246464235 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:32.880020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177861d7-fc80-46b8-99ea-ccd246464235 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:32.971251 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3e302-1468-4e57-9cfa-9d896bf9bd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:32.972043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3e302-1468-4e57-9cfa-9d896bf9bd78 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:32.972400 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3e302-1468-4e57-9cfa-9d896bf9bd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:32.972805 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3e302-1468-4e57-9cfa-9d896bf9bd78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:32.973758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3e302-1468-4e57-9cfa-9d896bf9bd78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:32.975867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3e302-1468-4e57-9cfa-9d896bf9bd78 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:32.992578 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f40083-5940-4037-b062-4b482954f398 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:33.000640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1335/2676] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:23:33.004628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f40083-5940-4037-b062-4b482954f398 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:33.009582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464f21e-8fb4-4572-809f-f84309b71ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:33.011340 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464f21e-8fb4-4572-809f-f84309b71ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:33.011810 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464f21e-8fb4-4572-809f-f84309b71ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:33.012298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464f21e-8fb4-4572-809f-f84309b71ebb admin admin] PATH_INFO: `/v3/projects/a33b0f19906646afa1f9383a1be1b2f4/users/a4a0d6c15d2747f4ae3b20ec40a0c56e/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:33.014479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464f21e-8fb4-4572-809f-f84309b71ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33b0f19906646afa1f9383a1be1b2f4, user_id=a4a0d6c15d2747f4ae3b20ec40a0c56e, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:33.017358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464f21e-8fb4-4572-809f-f84309b71ebb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:33.030567 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1342/2677] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:32 2022] PUT /identity/v3/projects/a33b0f19906646afa1f9383a1be1b2f4/users/a4a0d6c15d2747f4ae3b20ec40a0c56e/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:33.043053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67741cc4-5fd1-44ed-aae5-b4f4248f04d0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:33.043053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67741cc4-5fd1-44ed-aae5-b4f4248f04d0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:33.043053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67741cc4-5fd1-44ed-aae5-b4f4248f04d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:33.073743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-67741cc4-5fd1-44ed-aae5-b4f4248f04d0 None None] MFA Rules not processed for user `a4a0d6c15d2747f4ae3b20ec40a0c56e`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:33.075541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-67741cc4-5fd1-44ed-aae5-b4f4248f04d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:33.148664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:33.177344 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1336/2678] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:33.190318 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464f21e-8fb4-4572-809f-f84309b71ebb admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:33.192196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f464f21e-8fb4-4572-809f-f84309b71ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:33.262998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:33.288911 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464f21e-8fb4-4572-809f-f84309b71ebb admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:33.294153 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862e3f5-41fd-44aa-9b61-76a57c103414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:33.294988 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862e3f5-41fd-44aa-9b61-76a57c103414 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:33.295871 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862e3f5-41fd-44aa-9b61-76a57c103414 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:33.296265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862e3f5-41fd-44aa-9b61-76a57c103414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:33.311105 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862e3f5-41fd-44aa-9b61-76a57c103414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:33.312715 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862e3f5-41fd-44aa-9b61-76a57c103414 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:33.326866 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1343/2679] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:33.468483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67741cc4-5fd1-44ed-aae5-b4f4248f04d0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:33.482833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67741cc4-5fd1-44ed-aae5-b4f4248f04d0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:33.486702 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064315d7-f0a9-46b7-9183-39b95baff8d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:33.487962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064315d7-f0a9-46b7-9183-39b95baff8d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:33.488345 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064315d7-f0a9-46b7-9183-39b95baff8d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:33.488721 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064315d7-f0a9-46b7-9183-39b95baff8d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:33.573522 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064315d7-f0a9-46b7-9183-39b95baff8d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:33.575226 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064315d7-f0a9-46b7-9183-39b95baff8d7 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:33.586772 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1337/2680] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:36.494013 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862e3f5-41fd-44aa-9b61-76a57c103414 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:36.601259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862e3f5-41fd-44aa-9b61-76a57c103414 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:36.607897 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b041a-63ce-48cc-beba-f7876153cf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:36.609043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b041a-63ce-48cc-beba-f7876153cf8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:36.609639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b041a-63ce-48cc-beba-f7876153cf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:36.609926 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b041a-63ce-48cc-beba-f7876153cf8f admin admin] PATH_INFO: `/v3/users/9e1308f3db3f4e11a098d1962f817c45` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:36.611316 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b041a-63ce-48cc-beba-f7876153cf8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e1308f3db3f4e11a098d1962f817c45)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:36.613359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b041a-63ce-48cc-beba-f7876153cf8f admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:36.703995 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-659b041a-63ce-48cc-beba-f7876153cf8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e1308f3db3f4e11a098d1962f817c45'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:36.731458 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-659b041a-63ce-48cc-beba-f7876153cf8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e1308f3db3f4e11a098d1962f817c45'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:36.732589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-659b041a-63ce-48cc-beba-f7876153cf8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e1308f3db3f4e11a098d1962f817c45'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:36.733296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-659b041a-63ce-48cc-beba-f7876153cf8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e1308f3db3f4e11a098d1962f817c45'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:36.742911 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-659b041a-63ce-48cc-beba-f7876153cf8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e1308f3db3f4e11a098d1962f817c45'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:36.769530 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1344/2681] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:23:36 2022] DELETE /identity/v3/users/9e1308f3db3f4e11a098d1962f817c45 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:36.771296 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229f2f4-6c2f-4c0b-94dc-7f0642b4f63d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:36.772113 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229f2f4-6c2f-4c0b-94dc-7f0642b4f63d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:36.772553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229f2f4-6c2f-4c0b-94dc-7f0642b4f63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:36.797867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1229f2f4-6c2f-4c0b-94dc-7f0642b4f63d None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:36.799197 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1229f2f4-6c2f-4c0b-94dc-7f0642b4f63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:36.876460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1338/2682] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:23:36.888196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b041a-63ce-48cc-beba-f7876153cf8f admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:36.890381 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-659b041a-63ce-48cc-beba-f7876153cf8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:36.967119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b041a-63ce-48cc-beba-f7876153cf8f admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:36.971143 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e5905-6a0f-47d6-8061-269d930c4b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:36.971901 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e5905-6a0f-47d6-8061-269d930c4b46 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:36.972190 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e5905-6a0f-47d6-8061-269d930c4b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:36.972468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e5905-6a0f-47d6-8061-269d930c4b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:36.985887 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e5905-6a0f-47d6-8061-269d930c4b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:36.987493 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e5905-6a0f-47d6-8061-269d930c4b46 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:36.994525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:37.001454 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1345/2683] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:37.357896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229f2f4-6c2f-4c0b-94dc-7f0642b4f63d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:37.359740 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1229f2f4-6c2f-4c0b-94dc-7f0642b4f63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:37.382213 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229f2f4-6c2f-4c0b-94dc-7f0642b4f63d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:37.389333 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f98bc-3702-460a-a523-cc530de649e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:37.390416 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f98bc-3702-460a-a523-cc530de649e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:37.390854 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f98bc-3702-460a-a523-cc530de649e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:37.391241 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f98bc-3702-460a-a523-cc530de649e8 admin admin] PATH_INFO: `/v3/projects/3b726bfd22764577856c9dd9dedb1637` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:37.392798 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f98bc-3702-460a-a523-cc530de649e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b726bfd22764577856c9dd9dedb1637)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:37.395367 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f98bc-3702-460a-a523-cc530de649e8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:37.460620 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-340f98bc-3702-460a-a523-cc530de649e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b726bfd22764577856c9dd9dedb1637', 'request_id': 'req-340f98bc-3702-460a-a523-cc530de649e8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:37.468643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-340f98bc-3702-460a-a523-cc530de649e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b726bfd22764577856c9dd9dedb1637', 'request_id': 'req-340f98bc-3702-460a-a523-cc530de649e8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:37.481252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-340f98bc-3702-460a-a523-cc530de649e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b726bfd22764577856c9dd9dedb1637', 'request_id': 'req-340f98bc-3702-460a-a523-cc530de649e8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:37.499295 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-340f98bc-3702-460a-a523-cc530de649e8 admin admin] The token cache is being invalidate because project 3b726bfd22764577856c9dd9dedb1637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:37.499705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-340f98bc-3702-460a-a523-cc530de649e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:37.500496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-340f98bc-3702-460a-a523-cc530de649e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:37.502656 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1339/2684] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:37 2022] DELETE /identity/v3/projects/3b726bfd22764577856c9dd9dedb1637 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:37.506620 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e5905-6a0f-47d6-8061-269d930c4b46 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:37.519732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e5905-6a0f-47d6-8061-269d930c4b46 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:37.590163 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b240000-2ca6-43fa-b728-58b2613dad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:37.591542 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b240000-2ca6-43fa-b728-58b2613dad58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:37.592016 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b240000-2ca6-43fa-b728-58b2613dad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:37.592454 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b240000-2ca6-43fa-b728-58b2613dad58 admin admin] PATH_INFO: `/v3/users/a4a0d6c15d2747f4ae3b20ec40a0c56e` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:37.593928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b240000-2ca6-43fa-b728-58b2613dad58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a0d6c15d2747f4ae3b20ec40a0c56e)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:37.596119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b240000-2ca6-43fa-b728-58b2613dad58 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:37.660059 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4b240000-2ca6-43fa-b728-58b2613dad58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a0d6c15d2747f4ae3b20ec40a0c56e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:37.676566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4b240000-2ca6-43fa-b728-58b2613dad58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a0d6c15d2747f4ae3b20ec40a0c56e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:37.677533 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4b240000-2ca6-43fa-b728-58b2613dad58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a0d6c15d2747f4ae3b20ec40a0c56e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:37.678832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4b240000-2ca6-43fa-b728-58b2613dad58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a0d6c15d2747f4ae3b20ec40a0c56e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:37.690361 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-4b240000-2ca6-43fa-b728-58b2613dad58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a0d6c15d2747f4ae3b20ec40a0c56e'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:37.719653 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1346/2685] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:23:37 2022] DELETE /identity/v3/users/a4a0d6c15d2747f4ae3b20ec40a0c56e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:38.090201 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f98bc-3702-460a-a523-cc530de649e8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:38.091812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-340f98bc-3702-460a-a523-cc530de649e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:38.119620 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f98bc-3702-460a-a523-cc530de649e8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:38.149407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:38.230381 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806377b4-d00a-421d-9e18-3dce0b4c3684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:38.231810 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806377b4-d00a-421d-9e18-3dce0b4c3684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:38.232133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806377b4-d00a-421d-9e18-3dce0b4c3684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:38.232616 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806377b4-d00a-421d-9e18-3dce0b4c3684 admin admin] PATH_INFO: `/v3/projects/a33b0f19906646afa1f9383a1be1b2f4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:38.233929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806377b4-d00a-421d-9e18-3dce0b4c3684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a33b0f19906646afa1f9383a1be1b2f4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:38.236499 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806377b4-d00a-421d-9e18-3dce0b4c3684 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:38.301579 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-806377b4-d00a-421d-9e18-3dce0b4c3684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a33b0f19906646afa1f9383a1be1b2f4', 'request_id': 'req-806377b4-d00a-421d-9e18-3dce0b4c3684'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:38.314140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-806377b4-d00a-421d-9e18-3dce0b4c3684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a33b0f19906646afa1f9383a1be1b2f4', 'request_id': 'req-806377b4-d00a-421d-9e18-3dce0b4c3684'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:38.325299 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-806377b4-d00a-421d-9e18-3dce0b4c3684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a33b0f19906646afa1f9383a1be1b2f4', 'request_id': 'req-806377b4-d00a-421d-9e18-3dce0b4c3684'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:38.345055 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-806377b4-d00a-421d-9e18-3dce0b4c3684 admin admin] The token cache is being invalidate because project a33b0f19906646afa1f9383a1be1b2f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:38.345427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-806377b4-d00a-421d-9e18-3dce0b4c3684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:38.346170 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-806377b4-d00a-421d-9e18-3dce0b4c3684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:38.351826 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1340/2686] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:38 2022] DELETE /identity/v3/projects/a33b0f19906646afa1f9383a1be1b2f4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:38.352974 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5eca0c-50f0-4c13-93d5-4de9c0b0467f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:38.353326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5eca0c-50f0-4c13-93d5-4de9c0b0467f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:38.353616 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5eca0c-50f0-4c13-93d5-4de9c0b0467f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:38.391209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-6d5eca0c-50f0-4c13-93d5-4de9c0b0467f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:38.392224 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-6d5eca0c-50f0-4c13-93d5-4de9c0b0467f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:38.470656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1347/2687] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:23:38.478089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee8a7a-4ce4-45a1-91bf-6a8be87b2c50 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:38.478376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee8a7a-4ce4-45a1-91bf-6a8be87b2c50 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:38.478684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee8a7a-4ce4-45a1-91bf-6a8be87b2c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:38.500197 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-9fee8a7a-4ce4-45a1-91bf-6a8be87b2c50 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:38.501526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-9fee8a7a-4ce4-45a1-91bf-6a8be87b2c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:38.513495 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1341/2688] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:38.515484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5eca0c-50f0-4c13-93d5-4de9c0b0467f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:38.526282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5eca0c-50f0-4c13-93d5-4de9c0b0467f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:38.533021 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5463a8e-c701-46c6-bd55-c0e98268331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:38.533711 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5463a8e-c701-46c6-bd55-c0e98268331e admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:38.534000 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5463a8e-c701-46c6-bd55-c0e98268331e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:38.534280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5463a8e-c701-46c6-bd55-c0e98268331e admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:38.535095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5463a8e-c701-46c6-bd55-c0e98268331e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:23:38.535395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5463a8e-c701-46c6-bd55-c0e98268331e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:38.537283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5463a8e-c701-46c6-bd55-c0e98268331e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:38.553319 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1348/2689] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 16:23:38.559255 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee8a7a-4ce4-45a1-91bf-6a8be87b2c50 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:38.574480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee8a7a-4ce4-45a1-91bf-6a8be87b2c50 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:38.582093 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eda9fb-bf8d-48b7-920f-992e07affc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:38.582361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eda9fb-bf8d-48b7-920f-992e07affc03 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:38.582643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eda9fb-bf8d-48b7-920f-992e07affc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:38.582970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eda9fb-bf8d-48b7-920f-992e07affc03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:38.583736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eda9fb-bf8d-48b7-920f-992e07affc03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:38.585853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eda9fb-bf8d-48b7-920f-992e07affc03 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:38.624712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1342/2690] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:38 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:23:38.626136 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5463a8e-c701-46c6-bd55-c0e98268331e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:38.638397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5463a8e-c701-46c6-bd55-c0e98268331e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:38.643725 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:38.716188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4cdad-06ff-4b86-8a27-71b55e192683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:38.716882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4cdad-06ff-4b86-8a27-71b55e192683 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:38.717203 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4cdad-06ff-4b86-8a27-71b55e192683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:38.717484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4cdad-06ff-4b86-8a27-71b55e192683 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:38.718184 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4cdad-06ff-4b86-8a27-71b55e192683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:38.720236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4cdad-06ff-4b86-8a27-71b55e192683 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:38.744068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1349/2691] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:38 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:38.749100 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eda9fb-bf8d-48b7-920f-992e07affc03 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:38.766663 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eda9fb-bf8d-48b7-920f-992e07affc03 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:38.774968 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e45598-3989-4e71-9933-a332a343f387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:38.775865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e45598-3989-4e71-9933-a332a343f387 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:38.776305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e45598-3989-4e71-9933-a332a343f387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:38.776733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e45598-3989-4e71-9933-a332a343f387 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:38.777613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e45598-3989-4e71-9933-a332a343f387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:38.779654 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e45598-3989-4e71-9933-a332a343f387 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:38.797385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1343/2692] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:38.798685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4cdad-06ff-4b86-8a27-71b55e192683 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:38.813693 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4cdad-06ff-4b86-8a27-71b55e192683 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:38.819483 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5e143-4e68-4b85-89b8-541f0a2d0881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:38.820170 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5e143-4e68-4b85-89b8-541f0a2d0881 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:38.820459 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5e143-4e68-4b85-89b8-541f0a2d0881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:38.820742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5e143-4e68-4b85-89b8-541f0a2d0881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:38.821479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5e143-4e68-4b85-89b8-541f0a2d0881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:38.823181 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5e143-4e68-4b85-89b8-541f0a2d0881 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:38.837675 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1350/2693] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:38.842064 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e45598-3989-4e71-9933-a332a343f387 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:38.855724 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e45598-3989-4e71-9933-a332a343f387 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:38.861146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7084a4-beef-4344-b5db-be67af5e3409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:38.864131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7084a4-beef-4344-b5db-be67af5e3409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:38.864530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7084a4-beef-4344-b5db-be67af5e3409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:38.864924 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7084a4-beef-4344-b5db-be67af5e3409 admin admin] PATH_INFO: `/v3/projects/83018691547d4ae4bbd2051bebd3b584/users/7af3ebb332b34d82b6ecef7e8209f515/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:38.883856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7084a4-beef-4344-b5db-be67af5e3409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83018691547d4ae4bbd2051bebd3b584, user_id=7af3ebb332b34d82b6ecef7e8209f515, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:38.888347 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7084a4-beef-4344-b5db-be67af5e3409 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:38.908916 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1344/2694] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:38 2022] PUT /identity/v3/projects/83018691547d4ae4bbd2051bebd3b584/users/7af3ebb332b34d82b6ecef7e8209f515/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:38.920477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22838a21-06bb-43cf-915e-547abac75cf2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:38.920764 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22838a21-06bb-43cf-915e-547abac75cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:38.921068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22838a21-06bb-43cf-915e-547abac75cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:38.957102 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-22838a21-06bb-43cf-915e-547abac75cf2 None None] MFA Rules not processed for user `7af3ebb332b34d82b6ecef7e8209f515`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:38.958717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-22838a21-06bb-43cf-915e-547abac75cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:39.062130 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1351/2695] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:39.066657 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7084a4-beef-4344-b5db-be67af5e3409 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:39.127433 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:39.159858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7084a4-beef-4344-b5db-be67af5e3409 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:39.164865 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8834b63-16f5-4b2d-912d-d14887408f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:39.165523 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8834b63-16f5-4b2d-912d-d14887408f32 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:39.165809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8834b63-16f5-4b2d-912d-d14887408f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:39.166097 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8834b63-16f5-4b2d-912d-d14887408f32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:39.167478 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8834b63-16f5-4b2d-912d-d14887408f32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:39.170962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8834b63-16f5-4b2d-912d-d14887408f32 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:39.203120 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1345/2696] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:39 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:39.204332 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22838a21-06bb-43cf-915e-547abac75cf2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:39.216929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22838a21-06bb-43cf-915e-547abac75cf2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:39.288539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c7b9d-fd59-4f80-a0ee-fd694434aba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:39.289749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c7b9d-fd59-4f80-a0ee-fd694434aba1 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:39.290462 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c7b9d-fd59-4f80-a0ee-fd694434aba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:39.290981 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c7b9d-fd59-4f80-a0ee-fd694434aba1 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:39.292478 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c7b9d-fd59-4f80-a0ee-fd694434aba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:39.294694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c7b9d-fd59-4f80-a0ee-fd694434aba1 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:39.323593 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1352/2697] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:39 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:39.324869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8834b63-16f5-4b2d-912d-d14887408f32 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:39.335484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8834b63-16f5-4b2d-912d-d14887408f32 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:39.340968 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e5e1e-ff5a-46ae-a93b-935948d6c34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:39.341665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e5e1e-ff5a-46ae-a93b-935948d6c34b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:39.341950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e5e1e-ff5a-46ae-a93b-935948d6c34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:39.342205 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e5e1e-ff5a-46ae-a93b-935948d6c34b admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:39.343314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e5e1e-ff5a-46ae-a93b-935948d6c34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:39.344826 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e5e1e-ff5a-46ae-a93b-935948d6c34b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:39.356952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1346/2698] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:39.361111 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c7b9d-fd59-4f80-a0ee-fd694434aba1 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:39.369203 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:39.377551 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c7b9d-fd59-4f80-a0ee-fd694434aba1 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:39.386044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58457e94-a416-488b-a278-17fc029f4493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:39.387174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58457e94-a416-488b-a278-17fc029f4493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:39.387628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58457e94-a416-488b-a278-17fc029f4493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:39.387830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58457e94-a416-488b-a278-17fc029f4493 admin admin] PATH_INFO: `/v3/projects/ef0d2b35625c435f8700481d251eb467/users/f4d3c6dfd3bf42218800d701a095e6db/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:39.411810 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58457e94-a416-488b-a278-17fc029f4493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0d2b35625c435f8700481d251eb467, user_id=f4d3c6dfd3bf42218800d701a095e6db, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:39.415117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58457e94-a416-488b-a278-17fc029f4493 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:39.442729 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1353/2699] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:39 2022] PUT /identity/v3/projects/ef0d2b35625c435f8700481d251eb467/users/f4d3c6dfd3bf42218800d701a095e6db/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:39.446306 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e5e1e-ff5a-46ae-a93b-935948d6c34b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:39.466496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e5e1e-ff5a-46ae-a93b-935948d6c34b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:39.551455 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad89da8-be91-401c-b6e9-cd08627c08e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:39.552136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad89da8-be91-401c-b6e9-cd08627c08e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:39.552419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad89da8-be91-401c-b6e9-cd08627c08e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:39.552695 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad89da8-be91-401c-b6e9-cd08627c08e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:39.553429 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad89da8-be91-401c-b6e9-cd08627c08e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:39.555105 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad89da8-be91-401c-b6e9-cd08627c08e9 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:39.568086 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1347/2700] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:39.572320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58457e94-a416-488b-a278-17fc029f4493 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:39.586656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58457e94-a416-488b-a278-17fc029f4493 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:39.591793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708832b-522b-4709-b5ba-51426fa814ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:39.592707 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708832b-522b-4709-b5ba-51426fa814ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:39.592999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708832b-522b-4709-b5ba-51426fa814ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:39.593283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708832b-522b-4709-b5ba-51426fa814ed admin admin] PATH_INFO: `/v3/projects/ef0d2b35625c435f8700481d251eb467/users/f4d3c6dfd3bf42218800d701a095e6db/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:39.595366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708832b-522b-4709-b5ba-51426fa814ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0d2b35625c435f8700481d251eb467, user_id=f4d3c6dfd3bf42218800d701a095e6db, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:39.598201 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708832b-522b-4709-b5ba-51426fa814ed admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:39.610778 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1354/2701] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:39 2022] PUT /identity/v3/projects/ef0d2b35625c435f8700481d251eb467/users/f4d3c6dfd3bf42218800d701a095e6db/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:39.622705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c70b7-6ab3-49ea-84be-061312638ab5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:39.622999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c70b7-6ab3-49ea-84be-061312638ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:39.623301 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c70b7-6ab3-49ea-84be-061312638ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:39.660366 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-619c70b7-6ab3-49ea-84be-061312638ab5 None None] MFA Rules not processed for user `f4d3c6dfd3bf42218800d701a095e6db`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:39.661887 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-619c70b7-6ab3-49ea-84be-061312638ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:39.763858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1348/2702] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:39.777418 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708832b-522b-4709-b5ba-51426fa814ed admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:39.781334 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3708832b-522b-4709-b5ba-51426fa814ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:39.873832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708832b-522b-4709-b5ba-51426fa814ed admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:39.877791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba3677-0614-4139-8952-5e62acd18403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:39.878568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba3677-0614-4139-8952-5e62acd18403 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:39.878933 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba3677-0614-4139-8952-5e62acd18403 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:39.879279 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba3677-0614-4139-8952-5e62acd18403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:39.898260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba3677-0614-4139-8952-5e62acd18403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:39.900216 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba3677-0614-4139-8952-5e62acd18403 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:39.918232 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1355/2703] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:40.023746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c70b7-6ab3-49ea-84be-061312638ab5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:40.036099 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c70b7-6ab3-49ea-84be-061312638ab5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:40.040206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd347877-0758-4ec9-a29e-340f5890bf64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:40.040885 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd347877-0758-4ec9-a29e-340f5890bf64 service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:40.041163 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd347877-0758-4ec9-a29e-340f5890bf64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:40.041494 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd347877-0758-4ec9-a29e-340f5890bf64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:40.085457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:40.120890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd347877-0758-4ec9-a29e-340f5890bf64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:40.122629 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd347877-0758-4ec9-a29e-340f5890bf64 service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:40.133905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1349/2704] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:40.889419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f54dc-abfa-4834-93f0-c992590dd033 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:40.889957 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f54dc-abfa-4834-93f0-c992590dd033 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:40.890158 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f54dc-abfa-4834-93f0-c992590dd033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:40.909670 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ee6f54dc-abfa-4834-93f0-c992590dd033 None None] MFA Rules not processed for user `dcb117cb2fb5447ea2c56894869843f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:40.911283 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ee6f54dc-abfa-4834-93f0-c992590dd033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:40.980154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1356/2705] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:42.225637 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b842537-64da-496c-8abd-22c5d0c988e0 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:42.226109 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b842537-64da-496c-8abd-22c5d0c988e0 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:42.226207 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b842537-64da-496c-8abd-22c5d0c988e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:42.245808 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-0b842537-64da-496c-8abd-22c5d0c988e0 None None] MFA Rules not processed for user `d50fd94260f446e1add25376647b22ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:42.247149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0b842537-64da-496c-8abd-22c5d0c988e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:42.308894 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1350/2706] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:43.272194 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f31462-4f1b-49d4-8aee-81a61cec7b81 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:43.272677 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f31462-4f1b-49d4-8aee-81a61cec7b81 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:43.273247 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f31462-4f1b-49d4-8aee-81a61cec7b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:43.309664 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-88f31462-4f1b-49d4-8aee-81a61cec7b81 None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:43.311038 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-88f31462-4f1b-49d4-8aee-81a61cec7b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:43.423601 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1357/2707] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 16 16:23:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:43.439486 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b842537-64da-496c-8abd-22c5d0c988e0 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:43.441002 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-0b842537-64da-496c-8abd-22c5d0c988e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:43.558894 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b842537-64da-496c-8abd-22c5d0c988e0 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:43.565619 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282c756-80ae-4b77-9ae6-0eff6b557604 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:43.566710 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c756-80ae-4b77-9ae6-0eff6b557604 service swift] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:43.568053 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c756-80ae-4b77-9ae6-0eff6b557604 service swift] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:43.568731 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c756-80ae-4b77-9ae6-0eff6b557604 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:43.583275 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282c756-80ae-4b77-9ae6-0eff6b557604 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:43.585518 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282c756-80ae-4b77-9ae6-0eff6b557604 service swift] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:43.595567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1351/2708] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:23:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 16:23:45.556859 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f31462-4f1b-49d4-8aee-81a61cec7b81 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:45.595228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:45.655934 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f31462-4f1b-49d4-8aee-81a61cec7b81 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:45.667320 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3d295-2af3-4d50-b647-bec1c32fffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:45.670680 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3d295-2af3-4d50-b647-bec1c32fffe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:45.672003 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3d295-2af3-4d50-b647-bec1c32fffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:45.672380 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3d295-2af3-4d50-b647-bec1c32fffe3 admin admin] PATH_INFO: `/v3/users/7af3ebb332b34d82b6ecef7e8209f515` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:45.675368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3d295-2af3-4d50-b647-bec1c32fffe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af3ebb332b34d82b6ecef7e8209f515)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:45.677484 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3d295-2af3-4d50-b647-bec1c32fffe3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:45.757612 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-93b3d295-2af3-4d50-b647-bec1c32fffe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af3ebb332b34d82b6ecef7e8209f515'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:45.780473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-93b3d295-2af3-4d50-b647-bec1c32fffe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af3ebb332b34d82b6ecef7e8209f515'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:45.781673 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-93b3d295-2af3-4d50-b647-bec1c32fffe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af3ebb332b34d82b6ecef7e8209f515'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:45.783095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-93b3d295-2af3-4d50-b647-bec1c32fffe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af3ebb332b34d82b6ecef7e8209f515'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:45.795050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-93b3d295-2af3-4d50-b647-bec1c32fffe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af3ebb332b34d82b6ecef7e8209f515'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:45.810509 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1358/2709] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:23:45 2022] DELETE /identity/v3/users/7af3ebb332b34d82b6ecef7e8209f515 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:45.815045 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258a17b-e365-4c67-839b-43e20900e64f None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:45.815045 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258a17b-e365-4c67-839b-43e20900e64f None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:45.815514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258a17b-e365-4c67-839b-43e20900e64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:45.835301 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1258a17b-e365-4c67-839b-43e20900e64f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:45.836536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1258a17b-e365-4c67-839b-43e20900e64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:45.903727 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1352/2710] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:45.913777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3d295-2af3-4d50-b647-bec1c32fffe3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:45.915337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-93b3d295-2af3-4d50-b647-bec1c32fffe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:45.980507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3d295-2af3-4d50-b647-bec1c32fffe3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:45.984269 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ebbf1-901c-4f3a-b682-f0d69ed1ff1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:45.984941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ebbf1-901c-4f3a-b682-f0d69ed1ff1c service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:45.985231 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ebbf1-901c-4f3a-b682-f0d69ed1ff1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:45.985518 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ebbf1-901c-4f3a-b682-f0d69ed1ff1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:45.997237 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ebbf1-901c-4f3a-b682-f0d69ed1ff1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:45.998745 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ebbf1-901c-4f3a-b682-f0d69ed1ff1c service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:46.010657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1359/2711] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:46.326369 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258a17b-e365-4c67-839b-43e20900e64f None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:46.328177 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1258a17b-e365-4c67-839b-43e20900e64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:46.341671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258a17b-e365-4c67-839b-43e20900e64f None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:46.352376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:46.353420 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:46.354254 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:46.354664 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8 admin admin] PATH_INFO: `/v3/projects/83018691547d4ae4bbd2051bebd3b584` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:46.356018 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83018691547d4ae4bbd2051bebd3b584)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:46.358020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:46.361485 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=100 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:46.436795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83018691547d4ae4bbd2051bebd3b584', 'request_id': 'req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:46.442346 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83018691547d4ae4bbd2051bebd3b584', 'request_id': 'req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:46.450773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83018691547d4ae4bbd2051bebd3b584', 'request_id': 'req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:46.465201 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8 admin admin] The token cache is being invalidate because project 83018691547d4ae4bbd2051bebd3b584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:46.465677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:46.466415 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:46.468339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1353/2712] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:46 2022] DELETE /identity/v3/projects/83018691547d4ae4bbd2051bebd3b584 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:46.472302 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ebbf1-901c-4f3a-b682-f0d69ed1ff1c service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:46.483690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ebbf1-901c-4f3a-b682-f0d69ed1ff1c service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:46.526739 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:46.549206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c699b-f377-42e2-bbe5-821a520ac73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:46.550195 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c699b-f377-42e2-bbe5-821a520ac73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:46.550593 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c699b-f377-42e2-bbe5-821a520ac73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:46.550942 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c699b-f377-42e2-bbe5-821a520ac73e admin admin] PATH_INFO: `/v3/users/f4d3c6dfd3bf42218800d701a095e6db` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:46.552260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c699b-f377-42e2-bbe5-821a520ac73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d3c6dfd3bf42218800d701a095e6db)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:46.554269 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c699b-f377-42e2-bbe5-821a520ac73e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:46.637991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c98c699b-f377-42e2-bbe5-821a520ac73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d3c6dfd3bf42218800d701a095e6db'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:46.657393 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c98c699b-f377-42e2-bbe5-821a520ac73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d3c6dfd3bf42218800d701a095e6db'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:46.658217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c98c699b-f377-42e2-bbe5-821a520ac73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d3c6dfd3bf42218800d701a095e6db'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:46.659150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c98c699b-f377-42e2-bbe5-821a520ac73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d3c6dfd3bf42218800d701a095e6db'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:46.668381 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c98c699b-f377-42e2-bbe5-821a520ac73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d3c6dfd3bf42218800d701a095e6db'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:46.685251 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1360/2713] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:23:46 2022] DELETE /identity/v3/users/f4d3c6dfd3bf42218800d701a095e6db => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:47.035033 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:47.047239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:47.070220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d8cf1-a64c-4a7f-ac2e-a44f5ad04eb8 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:47.157153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c652e6-fed7-483e-8d8e-047fff5ab4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:47.158065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c652e6-fed7-483e-8d8e-047fff5ab4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:47.158395 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c652e6-fed7-483e-8d8e-047fff5ab4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:47.158794 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c652e6-fed7-483e-8d8e-047fff5ab4c8 admin admin] PATH_INFO: `/v3/projects/ef0d2b35625c435f8700481d251eb467` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:47.160000 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c652e6-fed7-483e-8d8e-047fff5ab4c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0d2b35625c435f8700481d251eb467)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:47.162206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c652e6-fed7-483e-8d8e-047fff5ab4c8 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:47.221952 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-85c652e6-fed7-483e-8d8e-047fff5ab4c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0d2b35625c435f8700481d251eb467', 'request_id': 'req-85c652e6-fed7-483e-8d8e-047fff5ab4c8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:47.230174 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-85c652e6-fed7-483e-8d8e-047fff5ab4c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0d2b35625c435f8700481d251eb467', 'request_id': 'req-85c652e6-fed7-483e-8d8e-047fff5ab4c8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:47.238004 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-85c652e6-fed7-483e-8d8e-047fff5ab4c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0d2b35625c435f8700481d251eb467', 'request_id': 'req-85c652e6-fed7-483e-8d8e-047fff5ab4c8'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:47.256425 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-85c652e6-fed7-483e-8d8e-047fff5ab4c8 admin admin] The token cache is being invalidate because project ef0d2b35625c435f8700481d251eb467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:47.256722 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-85c652e6-fed7-483e-8d8e-047fff5ab4c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:47.257476 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-85c652e6-fed7-483e-8d8e-047fff5ab4c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:47.259069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1354/2714] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:47 2022] DELETE /identity/v3/projects/ef0d2b35625c435f8700481d251eb467 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:47.266001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa6490-f538-4762-a77c-196680c74b75 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:47.266734 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa6490-f538-4762-a77c-196680c74b75 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:47.267103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa6490-f538-4762-a77c-196680c74b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:47.287655 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e5aa6490-f538-4762-a77c-196680c74b75 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:47.288891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e5aa6490-f538-4762-a77c-196680c74b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:47.353363 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1361/2715] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:47.361480 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559a5d8-c204-477a-a2ea-0a8cd2ebca60 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:47.361771 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559a5d8-c204-477a-a2ea-0a8cd2ebca60 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:47.362054 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559a5d8-c204-477a-a2ea-0a8cd2ebca60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:47.393037 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e559a5d8-c204-477a-a2ea-0a8cd2ebca60 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:47.394406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e559a5d8-c204-477a-a2ea-0a8cd2ebca60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:47.408162 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1355/2716] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:47.413432 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa6490-f538-4762-a77c-196680c74b75 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:47.424422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa6490-f538-4762-a77c-196680c74b75 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:47.429430 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47f84f-97c6-45d1-9746-e7f0cb1fe3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:47.430091 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47f84f-97c6-45d1-9746-e7f0cb1fe3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:47.430375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47f84f-97c6-45d1-9746-e7f0cb1fe3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:47.430691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47f84f-97c6-45d1-9746-e7f0cb1fe3f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:47.431419 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47f84f-97c6-45d1-9746-e7f0cb1fe3f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:23:47.432489 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47f84f-97c6-45d1-9746-e7f0cb1fe3f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:47.434294 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47f84f-97c6-45d1-9746-e7f0cb1fe3f0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:47.448103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1362/2717] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:23:47.452649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559a5d8-c204-477a-a2ea-0a8cd2ebca60 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:47.462206 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559a5d8-c204-477a-a2ea-0a8cd2ebca60 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:47.467661 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafafb01-7495-440b-947b-8df9e313c2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:47.468324 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafafb01-7495-440b-947b-8df9e313c2db admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:47.468644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafafb01-7495-440b-947b-8df9e313c2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:47.469069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafafb01-7495-440b-947b-8df9e313c2db admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:47.469892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafafb01-7495-440b-947b-8df9e313c2db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:47.472400 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafafb01-7495-440b-947b-8df9e313c2db admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:47.488466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:47.506789 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1356/2718] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:47 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:47.511723 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47f84f-97c6-45d1-9746-e7f0cb1fe3f0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:47.523258 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47f84f-97c6-45d1-9746-e7f0cb1fe3f0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:47.577054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:47.591124 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca39e1-2b5f-4cff-a48e-37476fed92a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:47.591829 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca39e1-2b5f-4cff-a48e-37476fed92a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:47.592095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca39e1-2b5f-4cff-a48e-37476fed92a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:47.592379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca39e1-2b5f-4cff-a48e-37476fed92a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:47.593068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca39e1-2b5f-4cff-a48e-37476fed92a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:47.595065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca39e1-2b5f-4cff-a48e-37476fed92a8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:47.621372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1363/2719] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:47 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:47.625650 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafafb01-7495-440b-947b-8df9e313c2db admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:47.644234 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafafb01-7495-440b-947b-8df9e313c2db admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:47.649814 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac726c5-96b9-424b-a5ce-71ac7f549a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:47.650927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac726c5-96b9-424b-a5ce-71ac7f549a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:47.651475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac726c5-96b9-424b-a5ce-71ac7f549a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:47.651832 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac726c5-96b9-424b-a5ce-71ac7f549a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:47.652577 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac726c5-96b9-424b-a5ce-71ac7f549a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:47.654261 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac726c5-96b9-424b-a5ce-71ac7f549a80 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:47.665733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1357/2720] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:47.670354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca39e1-2b5f-4cff-a48e-37476fed92a8 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:47.684260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca39e1-2b5f-4cff-a48e-37476fed92a8 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:47.690585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee60501-96fd-48bd-a606-a8214f52e138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:47.690967 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee60501-96fd-48bd-a606-a8214f52e138 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:47.691358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee60501-96fd-48bd-a606-a8214f52e138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:47.691754 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee60501-96fd-48bd-a606-a8214f52e138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:47.692991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee60501-96fd-48bd-a606-a8214f52e138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:47.694696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee60501-96fd-48bd-a606-a8214f52e138 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:47.726779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1364/2721] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:47.736853 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac726c5-96b9-424b-a5ce-71ac7f549a80 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:47.754221 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac726c5-96b9-424b-a5ce-71ac7f549a80 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:47.765766 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c827c-58b2-4e5f-bb33-f4d2b99cd706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:47.767013 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c827c-58b2-4e5f-bb33-f4d2b99cd706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:47.767618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c827c-58b2-4e5f-bb33-f4d2b99cd706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:47.768066 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c827c-58b2-4e5f-bb33-f4d2b99cd706 admin admin] PATH_INFO: `/v3/projects/4422e1709ea74f679de50d0125c00b67/users/484181862ac942d1b2b8c79e6ba6e578/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:47.792017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c827c-58b2-4e5f-bb33-f4d2b99cd706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4422e1709ea74f679de50d0125c00b67, user_id=484181862ac942d1b2b8c79e6ba6e578, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:47.795730 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c827c-58b2-4e5f-bb33-f4d2b99cd706 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:47.817213 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1358/2722] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:47 2022] PUT /identity/v3/projects/4422e1709ea74f679de50d0125c00b67/users/484181862ac942d1b2b8c79e6ba6e578/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:47.828583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9285649-541a-4e0b-abc6-a2721fc4236d None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:47.828876 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9285649-541a-4e0b-abc6-a2721fc4236d None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:47.829168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9285649-541a-4e0b-abc6-a2721fc4236d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:47.861264 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-c9285649-541a-4e0b-abc6-a2721fc4236d None None] MFA Rules not processed for user `484181862ac942d1b2b8c79e6ba6e578`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:47.862558 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c9285649-541a-4e0b-abc6-a2721fc4236d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:47.935771 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1365/2723] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:47.940432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c827c-58b2-4e5f-bb33-f4d2b99cd706 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:48.013327 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c827c-58b2-4e5f-bb33-f4d2b99cd706 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:48.020684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc91f1-edff-4399-aa5c-5356fae44219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:48.021625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc91f1-edff-4399-aa5c-5356fae44219 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:48.022009 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc91f1-edff-4399-aa5c-5356fae44219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:48.022466 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc91f1-edff-4399-aa5c-5356fae44219 admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:48.023271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc91f1-edff-4399-aa5c-5356fae44219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:48.025408 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc91f1-edff-4399-aa5c-5356fae44219 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:48.056090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1359/2724] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:47 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:48.060776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9285649-541a-4e0b-abc6-a2721fc4236d None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:48.073768 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9285649-541a-4e0b-abc6-a2721fc4236d None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:48.169272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875232da-2e24-4f5e-b574-a0b8d25b10a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:48.170058 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875232da-2e24-4f5e-b574-a0b8d25b10a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:48.170345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875232da-2e24-4f5e-b574-a0b8d25b10a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:48.170673 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875232da-2e24-4f5e-b574-a0b8d25b10a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:48.171585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875232da-2e24-4f5e-b574-a0b8d25b10a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:48.173866 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875232da-2e24-4f5e-b574-a0b8d25b10a8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:48.202672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1366/2725] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:48 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:48.211040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc91f1-edff-4399-aa5c-5356fae44219 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:48.226821 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc91f1-edff-4399-aa5c-5356fae44219 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:48.235890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab860b2a-ee4b-4410-a640-9294f9ee7861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:48.236670 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab860b2a-ee4b-4410-a640-9294f9ee7861 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:48.236963 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab860b2a-ee4b-4410-a640-9294f9ee7861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:48.237411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab860b2a-ee4b-4410-a640-9294f9ee7861 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:48.238386 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab860b2a-ee4b-4410-a640-9294f9ee7861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:48.240643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab860b2a-ee4b-4410-a640-9294f9ee7861 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:48.256001 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1360/2726] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:48.260857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875232da-2e24-4f5e-b574-a0b8d25b10a8 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:48.272118 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875232da-2e24-4f5e-b574-a0b8d25b10a8 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:48.283474 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1d087-f5c6-4a6e-a626-02590629b5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:48.284515 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1d087-f5c6-4a6e-a626-02590629b5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:48.284884 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1d087-f5c6-4a6e-a626-02590629b5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:48.285479 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1d087-f5c6-4a6e-a626-02590629b5bf admin admin] PATH_INFO: `/v3/projects/55a26e845ef24b9c87720e6d7fbde1d6/users/e1ff35620f654ac0a87bbe01f00e7b17/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:48.304818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1d087-f5c6-4a6e-a626-02590629b5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a26e845ef24b9c87720e6d7fbde1d6, user_id=e1ff35620f654ac0a87bbe01f00e7b17, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:48.308676 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1d087-f5c6-4a6e-a626-02590629b5bf admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:48.323976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1367/2727] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:48 2022] PUT /identity/v3/projects/55a26e845ef24b9c87720e6d7fbde1d6/users/e1ff35620f654ac0a87bbe01f00e7b17/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:48.327675 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab860b2a-ee4b-4410-a640-9294f9ee7861 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:48.344518 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab860b2a-ee4b-4410-a640-9294f9ee7861 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:48.416876 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b5eb5-91d3-44d1-8dac-01752057f1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:48.417813 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b5eb5-91d3-44d1-8dac-01752057f1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:48.420659 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b5eb5-91d3-44d1-8dac-01752057f1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:48.420659 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b5eb5-91d3-44d1-8dac-01752057f1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:48.420659 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b5eb5-91d3-44d1-8dac-01752057f1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:48.422458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b5eb5-91d3-44d1-8dac-01752057f1b0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:48.432829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1361/2728] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:48.437438 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1d087-f5c6-4a6e-a626-02590629b5bf admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:48.451408 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1d087-f5c6-4a6e-a626-02590629b5bf admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:48.456321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30988092-6421-4f20-b9fb-56c973953cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:48.457214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30988092-6421-4f20-b9fb-56c973953cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:48.457496 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30988092-6421-4f20-b9fb-56c973953cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:48.457772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30988092-6421-4f20-b9fb-56c973953cb9 admin admin] PATH_INFO: `/v3/projects/55a26e845ef24b9c87720e6d7fbde1d6/users/e1ff35620f654ac0a87bbe01f00e7b17/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:48.459756 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30988092-6421-4f20-b9fb-56c973953cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a26e845ef24b9c87720e6d7fbde1d6, user_id=e1ff35620f654ac0a87bbe01f00e7b17, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:48.462420 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30988092-6421-4f20-b9fb-56c973953cb9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:48.473535 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1368/2729] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:48 2022] PUT /identity/v3/projects/55a26e845ef24b9c87720e6d7fbde1d6/users/e1ff35620f654ac0a87bbe01f00e7b17/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:48.485572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2856d4-7d45-4219-865f-eb10b1640fe5 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:48.485857 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2856d4-7d45-4219-865f-eb10b1640fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:48.486329 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2856d4-7d45-4219-865f-eb10b1640fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:48.523073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-cc2856d4-7d45-4219-865f-eb10b1640fe5 None None] MFA Rules not processed for user `e1ff35620f654ac0a87bbe01f00e7b17`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:48.525023 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cc2856d4-7d45-4219-865f-eb10b1640fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:48.544479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:48.610354 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1362/2730] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:48.617762 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30988092-6421-4f20-b9fb-56c973953cb9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:48.620246 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-30988092-6421-4f20-b9fb-56c973953cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:48.631491 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:48.691132 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30988092-6421-4f20-b9fb-56c973953cb9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:48.695190 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6edba8-8494-40d1-81a9-6cd11928eb66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:48.695851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6edba8-8494-40d1-81a9-6cd11928eb66 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:48.696140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6edba8-8494-40d1-81a9-6cd11928eb66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:48.696422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6edba8-8494-40d1-81a9-6cd11928eb66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:48.711054 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6edba8-8494-40d1-81a9-6cd11928eb66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:48.712525 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6edba8-8494-40d1-81a9-6cd11928eb66 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:48.735069 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1369/2731] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:49.395381 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2856d4-7d45-4219-865f-eb10b1640fe5 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:49.498146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2856d4-7d45-4219-865f-eb10b1640fe5 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:49.511251 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c9d89-374a-4f74-b12c-f0233feb9c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:49.512159 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c9d89-374a-4f74-b12c-f0233feb9c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:49.512453 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c9d89-374a-4f74-b12c-f0233feb9c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:49.512736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c9d89-374a-4f74-b12c-f0233feb9c04 admin admin] PATH_INFO: `/v3/users/484181862ac942d1b2b8c79e6ba6e578` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:49.513972 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c9d89-374a-4f74-b12c-f0233feb9c04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=484181862ac942d1b2b8c79e6ba6e578)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:49.515940 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c9d89-374a-4f74-b12c-f0233feb9c04 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:49.573916 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-445c9d89-374a-4f74-b12c-f0233feb9c04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '484181862ac942d1b2b8c79e6ba6e578'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:49.575317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-445c9d89-374a-4f74-b12c-f0233feb9c04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '484181862ac942d1b2b8c79e6ba6e578'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:49.593923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-445c9d89-374a-4f74-b12c-f0233feb9c04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '484181862ac942d1b2b8c79e6ba6e578'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:49.594695 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-445c9d89-374a-4f74-b12c-f0233feb9c04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '484181862ac942d1b2b8c79e6ba6e578'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:49.601946 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-445c9d89-374a-4f74-b12c-f0233feb9c04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '484181862ac942d1b2b8c79e6ba6e578'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:49.627403 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1363/2732] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:23:49 2022] DELETE /identity/v3/users/484181862ac942d1b2b8c79e6ba6e578 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:49.629202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176819d-896d-4fc6-8466-ebda7350879c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:49.629507 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176819d-896d-4fc6-8466-ebda7350879c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:49.629851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176819d-896d-4fc6-8466-ebda7350879c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:49.652238 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-2176819d-896d-4fc6-8466-ebda7350879c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:49.653569 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2176819d-896d-4fc6-8466-ebda7350879c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:49.718705 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1370/2733] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:49.729592 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c9d89-374a-4f74-b12c-f0233feb9c04 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:49.731284 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-445c9d89-374a-4f74-b12c-f0233feb9c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:49.780975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:49.814736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c9d89-374a-4f74-b12c-f0233feb9c04 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:49.818719 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f8c91-f548-48a3-aa7d-90e9402045c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:49.819396 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f8c91-f548-48a3-aa7d-90e9402045c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:49.819680 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f8c91-f548-48a3-aa7d-90e9402045c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:49.819988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f8c91-f548-48a3-aa7d-90e9402045c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:49.831920 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f8c91-f548-48a3-aa7d-90e9402045c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:49.833408 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f8c91-f548-48a3-aa7d-90e9402045c5 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:49.846164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1364/2734] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:50.198576 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176819d-896d-4fc6-8466-ebda7350879c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:50.200048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2176819d-896d-4fc6-8466-ebda7350879c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:50.215881 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176819d-896d-4fc6-8466-ebda7350879c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:50.222240 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d694f25-e213-43c4-8aaf-76967882cc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:50.223616 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d694f25-e213-43c4-8aaf-76967882cc3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:50.223995 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d694f25-e213-43c4-8aaf-76967882cc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:50.224406 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d694f25-e213-43c4-8aaf-76967882cc3d admin admin] PATH_INFO: `/v3/projects/4422e1709ea74f679de50d0125c00b67` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:50.225721 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d694f25-e213-43c4-8aaf-76967882cc3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4422e1709ea74f679de50d0125c00b67)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:50.227766 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d694f25-e213-43c4-8aaf-76967882cc3d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:50.307178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7d694f25-e213-43c4-8aaf-76967882cc3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4422e1709ea74f679de50d0125c00b67', 'request_id': 'req-7d694f25-e213-43c4-8aaf-76967882cc3d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:50.313583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7d694f25-e213-43c4-8aaf-76967882cc3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4422e1709ea74f679de50d0125c00b67', 'request_id': 'req-7d694f25-e213-43c4-8aaf-76967882cc3d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:50.323724 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7d694f25-e213-43c4-8aaf-76967882cc3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4422e1709ea74f679de50d0125c00b67', 'request_id': 'req-7d694f25-e213-43c4-8aaf-76967882cc3d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:50.341234 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7d694f25-e213-43c4-8aaf-76967882cc3d admin admin] The token cache is being invalidate because project 4422e1709ea74f679de50d0125c00b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:50.341586 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7d694f25-e213-43c4-8aaf-76967882cc3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:50.342273 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7d694f25-e213-43c4-8aaf-76967882cc3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:50.344164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1371/2735] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:50 2022] DELETE /identity/v3/projects/4422e1709ea74f679de50d0125c00b67 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:50.352089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f8c91-f548-48a3-aa7d-90e9402045c5 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:50.364171 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f8c91-f548-48a3-aa7d-90e9402045c5 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:50.436513 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c2142-32d3-4058-a9c4-2cc02fb21d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:50.437531 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c2142-32d3-4058-a9c4-2cc02fb21d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:50.437817 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c2142-32d3-4058-a9c4-2cc02fb21d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:50.438153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c2142-32d3-4058-a9c4-2cc02fb21d0c admin admin] PATH_INFO: `/v3/users/e1ff35620f654ac0a87bbe01f00e7b17` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:50.440150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c2142-32d3-4058-a9c4-2cc02fb21d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ff35620f654ac0a87bbe01f00e7b17)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:50.442182 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c2142-32d3-4058-a9c4-2cc02fb21d0c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:50.498252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2d3c2142-32d3-4058-a9c4-2cc02fb21d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ff35620f654ac0a87bbe01f00e7b17'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:50.499145 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2d3c2142-32d3-4058-a9c4-2cc02fb21d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ff35620f654ac0a87bbe01f00e7b17'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:50.516340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2d3c2142-32d3-4058-a9c4-2cc02fb21d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ff35620f654ac0a87bbe01f00e7b17'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:50.517073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2d3c2142-32d3-4058-a9c4-2cc02fb21d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ff35620f654ac0a87bbe01f00e7b17'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:50.537040 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-2d3c2142-32d3-4058-a9c4-2cc02fb21d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ff35620f654ac0a87bbe01f00e7b17'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:50.553482 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1365/2736] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:23:50 2022] DELETE /identity/v3/users/e1ff35620f654ac0a87bbe01f00e7b17 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:50.946801 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d694f25-e213-43c4-8aaf-76967882cc3d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:50.950005 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-7d694f25-e213-43c4-8aaf-76967882cc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:50.971756 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d694f25-e213-43c4-8aaf-76967882cc3d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:51.038857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:51.086061 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295ea91-1d70-470f-acc9-2d769941147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:51.087135 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295ea91-1d70-470f-acc9-2d769941147d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:51.087539 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295ea91-1d70-470f-acc9-2d769941147d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:51.087911 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295ea91-1d70-470f-acc9-2d769941147d admin admin] PATH_INFO: `/v3/projects/55a26e845ef24b9c87720e6d7fbde1d6` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:51.089383 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295ea91-1d70-470f-acc9-2d769941147d admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a26e845ef24b9c87720e6d7fbde1d6)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:51.092306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295ea91-1d70-470f-acc9-2d769941147d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:51.155824 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c295ea91-1d70-470f-acc9-2d769941147d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a26e845ef24b9c87720e6d7fbde1d6', 'request_id': 'req-c295ea91-1d70-470f-acc9-2d769941147d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:51.164014 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c295ea91-1d70-470f-acc9-2d769941147d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a26e845ef24b9c87720e6d7fbde1d6', 'request_id': 'req-c295ea91-1d70-470f-acc9-2d769941147d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:51.173836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c295ea91-1d70-470f-acc9-2d769941147d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a26e845ef24b9c87720e6d7fbde1d6', 'request_id': 'req-c295ea91-1d70-470f-acc9-2d769941147d'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:51.196418 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c295ea91-1d70-470f-acc9-2d769941147d admin admin] The token cache is being invalidate because project 55a26e845ef24b9c87720e6d7fbde1d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:51.196889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c295ea91-1d70-470f-acc9-2d769941147d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:51.199814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-c295ea91-1d70-470f-acc9-2d769941147d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:51.211203 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1372/2737] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:50 2022] DELETE /identity/v3/projects/55a26e845ef24b9c87720e6d7fbde1d6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:51.214758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a420e3-9a2a-4017-bf82-6577988ce06b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:51.215149 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a420e3-9a2a-4017-bf82-6577988ce06b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:51.215544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a420e3-9a2a-4017-bf82-6577988ce06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:51.245797 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-24a420e3-9a2a-4017-bf82-6577988ce06b None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:51.247678 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-24a420e3-9a2a-4017-bf82-6577988ce06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:51.342160 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:51.358069 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1366/2738] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:51.367448 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2548450-d61f-4d1b-9442-3441591b581f None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:51.367672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2548450-d61f-4d1b-9442-3441591b581f None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:51.367779 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2548450-d61f-4d1b-9442-3441591b581f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:51.388150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a2548450-d61f-4d1b-9442-3441591b581f None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:51.389535 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a2548450-d61f-4d1b-9442-3441591b581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:51.397989 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1373/2739] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:51.402411 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a420e3-9a2a-4017-bf82-6577988ce06b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:51.412368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a420e3-9a2a-4017-bf82-6577988ce06b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:51.418223 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f9247-8f3c-4f2b-8928-0c016ab252cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:51.418913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f9247-8f3c-4f2b-8928-0c016ab252cc admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:51.419368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f9247-8f3c-4f2b-8928-0c016ab252cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:51.419650 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f9247-8f3c-4f2b-8928-0c016ab252cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:51.420542 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f9247-8f3c-4f2b-8928-0c016ab252cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:23:51.420944 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f9247-8f3c-4f2b-8928-0c016ab252cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:51.422894 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f9247-8f3c-4f2b-8928-0c016ab252cc admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:51.437291 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1367/2740] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:23:51.441816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2548450-d61f-4d1b-9442-3441591b581f None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:51.451191 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2548450-d61f-4d1b-9442-3441591b581f None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:51.455975 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7a39f-e9fb-47e7-91d2-0a2cb3610604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:51.456633 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7a39f-e9fb-47e7-91d2-0a2cb3610604 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:51.456920 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7a39f-e9fb-47e7-91d2-0a2cb3610604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:51.457202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7a39f-e9fb-47e7-91d2-0a2cb3610604 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:51.457895 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7a39f-e9fb-47e7-91d2-0a2cb3610604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:51.459830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7a39f-e9fb-47e7-91d2-0a2cb3610604 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:51.486541 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1374/2741] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:51 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:51.490897 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f9247-8f3c-4f2b-8928-0c016ab252cc admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:51.503483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f9247-8f3c-4f2b-8928-0c016ab252cc admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:51.562867 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c390b7-1efa-408c-a8e6-449b1545915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:51.563534 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c390b7-1efa-408c-a8e6-449b1545915b admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:51.563816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c390b7-1efa-408c-a8e6-449b1545915b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:51.564090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c390b7-1efa-408c-a8e6-449b1545915b admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:51.564781 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c390b7-1efa-408c-a8e6-449b1545915b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:51.566856 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c390b7-1efa-408c-a8e6-449b1545915b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:51.586356 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1368/2742] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:51 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:51.590580 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7a39f-e9fb-47e7-91d2-0a2cb3610604 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:51.600783 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7a39f-e9fb-47e7-91d2-0a2cb3610604 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:51.606782 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad86574-536f-4c89-8041-6c171b8b77ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:51.607446 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad86574-536f-4c89-8041-6c171b8b77ab admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:51.607730 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad86574-536f-4c89-8041-6c171b8b77ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:51.608006 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad86574-536f-4c89-8041-6c171b8b77ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:51.608729 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad86574-536f-4c89-8041-6c171b8b77ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:51.610307 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad86574-536f-4c89-8041-6c171b8b77ab admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:51.621263 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1375/2743] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 16:23:51.625348 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c390b7-1efa-408c-a8e6-449b1545915b admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:51.637029 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c390b7-1efa-408c-a8e6-449b1545915b admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:51.641858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d90e4-2f85-47cb-b234-c34bb60881a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:51.642618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d90e4-2f85-47cb-b234-c34bb60881a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:51.642904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d90e4-2f85-47cb-b234-c34bb60881a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:51.643181 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d90e4-2f85-47cb-b234-c34bb60881a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:51.643904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d90e4-2f85-47cb-b234-c34bb60881a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:51.645603 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d90e4-2f85-47cb-b234-c34bb60881a7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:51.656074 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1369/2744] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:51.660516 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad86574-536f-4c89-8041-6c171b8b77ab admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:51.670981 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad86574-536f-4c89-8041-6c171b8b77ab admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:51.675553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8bde3-cad4-4a1d-8689-7fae5d260265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:51.676428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8bde3-cad4-4a1d-8689-7fae5d260265 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:51.676710 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8bde3-cad4-4a1d-8689-7fae5d260265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:51.676987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8bde3-cad4-4a1d-8689-7fae5d260265 admin admin] PATH_INFO: `/v3/projects/2183986cfebf4d74a82e26f242b14c2f/users/cc93e4df441a4157aa5982a91233e062/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:51.693063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8bde3-cad4-4a1d-8689-7fae5d260265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2183986cfebf4d74a82e26f242b14c2f, user_id=cc93e4df441a4157aa5982a91233e062, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:51.695753 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8bde3-cad4-4a1d-8689-7fae5d260265 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:51.708660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1376/2745] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:51 2022] PUT /identity/v3/projects/2183986cfebf4d74a82e26f242b14c2f/users/cc93e4df441a4157aa5982a91233e062/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:51.720431 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad6bc2-4388-4584-b0d7-635b4bce4d70 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:51.720726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad6bc2-4388-4584-b0d7-635b4bce4d70 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:51.721007 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad6bc2-4388-4584-b0d7-635b4bce4d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:51.748410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a9ad6bc2-4388-4584-b0d7-635b4bce4d70 None None] MFA Rules not processed for user `cc93e4df441a4157aa5982a91233e062`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:51.749618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a9ad6bc2-4388-4584-b0d7-635b4bce4d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:51.819592 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1370/2746] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:51.830815 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8bde3-cad4-4a1d-8689-7fae5d260265 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:51.833090 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5fa8bde3-cad4-4a1d-8689-7fae5d260265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:51.897767 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8bde3-cad4-4a1d-8689-7fae5d260265 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:51.902836 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4796ddf-a681-4f0e-9c83-7072de2bb6a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:51.904063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4796ddf-a681-4f0e-9c83-7072de2bb6a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:51.904063 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4796ddf-a681-4f0e-9c83-7072de2bb6a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:51.904333 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4796ddf-a681-4f0e-9c83-7072de2bb6a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:51.925930 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4796ddf-a681-4f0e-9c83-7072de2bb6a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:51.928053 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4796ddf-a681-4f0e-9c83-7072de2bb6a9 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:51.940910 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1377/2747] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:51.961479 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad6bc2-4388-4584-b0d7-635b4bce4d70 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:52.016259 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:52.032665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad6bc2-4388-4584-b0d7-635b4bce4d70 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:52.038976 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a57670-9672-4de2-ba89-34932a70c856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:52.042138 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a57670-9672-4de2-ba89-34932a70c856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:52.042475 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a57670-9672-4de2-ba89-34932a70c856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:52.042737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a57670-9672-4de2-ba89-34932a70c856 admin admin] PATH_INFO: `/v3/users/cc93e4df441a4157aa5982a91233e062` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:52.043987 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a57670-9672-4de2-ba89-34932a70c856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc93e4df441a4157aa5982a91233e062)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:52.045924 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a57670-9672-4de2-ba89-34932a70c856 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:52.095247 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-83a57670-9672-4de2-ba89-34932a70c856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc93e4df441a4157aa5982a91233e062'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:52.095904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-83a57670-9672-4de2-ba89-34932a70c856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc93e4df441a4157aa5982a91233e062'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:52.108548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-83a57670-9672-4de2-ba89-34932a70c856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc93e4df441a4157aa5982a91233e062'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:52.109246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-83a57670-9672-4de2-ba89-34932a70c856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc93e4df441a4157aa5982a91233e062'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:52.116320 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-83a57670-9672-4de2-ba89-34932a70c856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc93e4df441a4157aa5982a91233e062'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:52.131088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1371/2748] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:23:51 2022] DELETE /identity/v3/users/cc93e4df441a4157aa5982a91233e062 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:52.137772 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c8c10-991a-4b69-8efd-cf51643097dc None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:52.138601 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c8c10-991a-4b69-8efd-cf51643097dc None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:52.139015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c8c10-991a-4b69-8efd-cf51643097dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:52.148351 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:52.166814 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5f1c8c10-991a-4b69-8efd-cf51643097dc None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:52.169265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5f1c8c10-991a-4b69-8efd-cf51643097dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:52.239104 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1378/2749] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:52.249769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a57670-9672-4de2-ba89-34932a70c856 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:52.251412 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-83a57670-9672-4de2-ba89-34932a70c856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:52.333962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a57670-9672-4de2-ba89-34932a70c856 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:52.338844 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b9c72-49ff-4e73-b61f-e6e2516c8e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:52.339905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b9c72-49ff-4e73-b61f-e6e2516c8e8e service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:52.340257 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b9c72-49ff-4e73-b61f-e6e2516c8e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:52.340547 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b9c72-49ff-4e73-b61f-e6e2516c8e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:52.354390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b9c72-49ff-4e73-b61f-e6e2516c8e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:52.356578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b9c72-49ff-4e73-b61f-e6e2516c8e8e service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:52.374877 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1372/2750] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:52.757216 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c8c10-991a-4b69-8efd-cf51643097dc None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:52.759187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5f1c8c10-991a-4b69-8efd-cf51643097dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:52.793826 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c8c10-991a-4b69-8efd-cf51643097dc None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:52.802673 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca303b8-5032-4ac8-b7e9-5530e6074f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:52.803992 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca303b8-5032-4ac8-b7e9-5530e6074f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:52.804399 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca303b8-5032-4ac8-b7e9-5530e6074f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:52.804780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca303b8-5032-4ac8-b7e9-5530e6074f32 admin admin] PATH_INFO: `/v3/projects/2183986cfebf4d74a82e26f242b14c2f` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:52.808034 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca303b8-5032-4ac8-b7e9-5530e6074f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2183986cfebf4d74a82e26f242b14c2f)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:52.822830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca303b8-5032-4ac8-b7e9-5530e6074f32 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:52.908227 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-eca303b8-5032-4ac8-b7e9-5530e6074f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2183986cfebf4d74a82e26f242b14c2f', 'request_id': 'req-eca303b8-5032-4ac8-b7e9-5530e6074f32'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:52.915156 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-eca303b8-5032-4ac8-b7e9-5530e6074f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2183986cfebf4d74a82e26f242b14c2f', 'request_id': 'req-eca303b8-5032-4ac8-b7e9-5530e6074f32'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:52.926403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-eca303b8-5032-4ac8-b7e9-5530e6074f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2183986cfebf4d74a82e26f242b14c2f', 'request_id': 'req-eca303b8-5032-4ac8-b7e9-5530e6074f32'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:52.940261 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-eca303b8-5032-4ac8-b7e9-5530e6074f32 admin admin] The token cache is being invalidate because project 2183986cfebf4d74a82e26f242b14c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:52.940696 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-eca303b8-5032-4ac8-b7e9-5530e6074f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:52.941466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-eca303b8-5032-4ac8-b7e9-5530e6074f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:52.943192 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1379/2751] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:52 2022] DELETE /identity/v3/projects/2183986cfebf4d74a82e26f242b14c2f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:52.948590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fc947-4b84-4603-bd93-b8fe6d9c4393 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:52.949178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fc947-4b84-4603-bd93-b8fe6d9c4393 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:52.949178 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fc947-4b84-4603-bd93-b8fe6d9c4393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:52.993113 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-f22fc947-4b84-4603-bd93-b8fe6d9c4393 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:52.994576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-f22fc947-4b84-4603-bd93-b8fe6d9c4393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:53.086492 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1373/2752] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:53.097569 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b94dc-2ea1-44cc-b32c-ee9f5f09ee64 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:53.097949 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b94dc-2ea1-44cc-b32c-ee9f5f09ee64 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:53.098582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b94dc-2ea1-44cc-b32c-ee9f5f09ee64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:53.122531 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-e62b94dc-2ea1-44cc-b32c-ee9f5f09ee64 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:53.123915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e62b94dc-2ea1-44cc-b32c-ee9f5f09ee64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:53.139890 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1380/2753] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:53.141121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fc947-4b84-4603-bd93-b8fe6d9c4393 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:53.164929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fc947-4b84-4603-bd93-b8fe6d9c4393 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:53.170338 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e04094-0e7e-470d-94b3-0553723c6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:53.171235 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e04094-0e7e-470d-94b3-0553723c6504 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:53.171661 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e04094-0e7e-470d-94b3-0553723c6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:53.172010 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e04094-0e7e-470d-94b3-0553723c6504 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:53.173256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e04094-0e7e-470d-94b3-0553723c6504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:23:53.173256 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e04094-0e7e-470d-94b3-0553723c6504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:53.175752 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e04094-0e7e-470d-94b3-0553723c6504 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:53.185260 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:53.189716 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1374/2754] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:23:53.193301 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b94dc-2ea1-44cc-b32c-ee9f5f09ee64 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:53.203536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b94dc-2ea1-44cc-b32c-ee9f5f09ee64 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:53.208267 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9f566-a961-4ccc-9a3d-436f7d59636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:53.208936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9f566-a961-4ccc-9a3d-436f7d59636c admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:53.209226 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9f566-a961-4ccc-9a3d-436f7d59636c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:53.209513 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9f566-a961-4ccc-9a3d-436f7d59636c admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:53.210350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9f566-a961-4ccc-9a3d-436f7d59636c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:53.213718 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9f566-a961-4ccc-9a3d-436f7d59636c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:53.242452 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1381/2755] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:53 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:53.247391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e04094-0e7e-470d-94b3-0553723c6504 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:53.257598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e04094-0e7e-470d-94b3-0553723c6504 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:53.318460 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d3f18-53c5-4886-8506-577deeda73d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:53.319158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d3f18-53c5-4886-8506-577deeda73d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:53.319447 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d3f18-53c5-4886-8506-577deeda73d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:53.319723 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d3f18-53c5-4886-8506-577deeda73d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:53.320428 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d3f18-53c5-4886-8506-577deeda73d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:53.323017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d3f18-53c5-4886-8506-577deeda73d7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:53.348625 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1375/2756] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:53 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:53.348856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9f566-a961-4ccc-9a3d-436f7d59636c admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:53.362999 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9f566-a961-4ccc-9a3d-436f7d59636c admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:53.369849 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddcf6f-1756-46e2-9882-e427d0c35b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:53.371205 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddcf6f-1756-46e2-9882-e427d0c35b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:53.371500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddcf6f-1756-46e2-9882-e427d0c35b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:53.371786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddcf6f-1756-46e2-9882-e427d0c35b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:53.372546 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddcf6f-1756-46e2-9882-e427d0c35b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:53.374457 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddcf6f-1756-46e2-9882-e427d0c35b9a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:53.387050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1382/2757] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:53.391277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d3f18-53c5-4886-8506-577deeda73d7 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:53.403736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d3f18-53c5-4886-8506-577deeda73d7 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:53.409700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe03b64-f48d-4e72-8ec8-d511443bf29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:53.410708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe03b64-f48d-4e72-8ec8-d511443bf29d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:53.411077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe03b64-f48d-4e72-8ec8-d511443bf29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:53.411271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe03b64-f48d-4e72-8ec8-d511443bf29d admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:53.412121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe03b64-f48d-4e72-8ec8-d511443bf29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:53.413772 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe03b64-f48d-4e72-8ec8-d511443bf29d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:53.426403 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1376/2758] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:53.430923 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddcf6f-1756-46e2-9882-e427d0c35b9a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:53.443829 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddcf6f-1756-46e2-9882-e427d0c35b9a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:53.450936 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662de56-d285-4a07-ae28-f77f6fad21eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:53.452435 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662de56-d285-4a07-ae28-f77f6fad21eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:53.452730 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662de56-d285-4a07-ae28-f77f6fad21eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:53.453019 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662de56-d285-4a07-ae28-f77f6fad21eb admin admin] PATH_INFO: `/v3/projects/d30f9cd205774f5cbfdea5db025e0879/users/2e0977f1f0ed4909bc9c11795a44ce00/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:53.474907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662de56-d285-4a07-ae28-f77f6fad21eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30f9cd205774f5cbfdea5db025e0879, user_id=2e0977f1f0ed4909bc9c11795a44ce00, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:53.479149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662de56-d285-4a07-ae28-f77f6fad21eb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:53.497522 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1383/2759] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:53 2022] PUT /identity/v3/projects/d30f9cd205774f5cbfdea5db025e0879/users/2e0977f1f0ed4909bc9c11795a44ce00/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:23:53.508240 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d645b-9b00-4b86-b01a-c6e484c3c443 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:53.508535 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d645b-9b00-4b86-b01a-c6e484c3c443 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:53.508825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d645b-9b00-4b86-b01a-c6e484c3c443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:53.540059 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-b99d645b-9b00-4b86-b01a-c6e484c3c443 None None] MFA Rules not processed for user `2e0977f1f0ed4909bc9c11795a44ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:53.542819 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b99d645b-9b00-4b86-b01a-c6e484c3c443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:53.625999 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1377/2760] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:23:53.639286 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662de56-d285-4a07-ae28-f77f6fad21eb admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:53.641008 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-4662de56-d285-4a07-ae28-f77f6fad21eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:53.683746 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:53.721621 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662de56-d285-4a07-ae28-f77f6fad21eb admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:53.725680 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72f24b-6623-4510-96bb-79c27f1e7b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:53.727138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72f24b-6623-4510-96bb-79c27f1e7b5a service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:53.727610 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72f24b-6623-4510-96bb-79c27f1e7b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:53.727910 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72f24b-6623-4510-96bb-79c27f1e7b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:53.739049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72f24b-6623-4510-96bb-79c27f1e7b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:53.740749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72f24b-6623-4510-96bb-79c27f1e7b5a service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:53.752499 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1384/2761] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:53.790116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d645b-9b00-4b86-b01a-c6e484c3c443 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:53.872584 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d645b-9b00-4b86-b01a-c6e484c3c443 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:53.877244 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ed986-b286-449d-9dd5-5c169c0f7672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:53.878139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ed986-b286-449d-9dd5-5c169c0f7672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:53.878444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ed986-b286-449d-9dd5-5c169c0f7672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:53.878741 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ed986-b286-449d-9dd5-5c169c0f7672 admin admin] PATH_INFO: `/v3/users/2e0977f1f0ed4909bc9c11795a44ce00` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:53.879965 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ed986-b286-449d-9dd5-5c169c0f7672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e0977f1f0ed4909bc9c11795a44ce00)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:53.881902 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ed986-b286-449d-9dd5-5c169c0f7672 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:53.894221 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:53.936150 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-089ed986-b286-449d-9dd5-5c169c0f7672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e0977f1f0ed4909bc9c11795a44ce00'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:53.936913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-089ed986-b286-449d-9dd5-5c169c0f7672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e0977f1f0ed4909bc9c11795a44ce00'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:53.950725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-089ed986-b286-449d-9dd5-5c169c0f7672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e0977f1f0ed4909bc9c11795a44ce00'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:53.951438 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-089ed986-b286-449d-9dd5-5c169c0f7672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e0977f1f0ed4909bc9c11795a44ce00'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:53.958699 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-089ed986-b286-449d-9dd5-5c169c0f7672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e0977f1f0ed4909bc9c11795a44ce00'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:53.972340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1378/2762] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:23:53 2022] DELETE /identity/v3/users/2e0977f1f0ed4909bc9c11795a44ce00 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:53.976899 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848594e-f427-4c26-8462-d29bbf0710e5 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:53.977192 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848594e-f427-4c26-8462-d29bbf0710e5 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:53.977502 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848594e-f427-4c26-8462-d29bbf0710e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:53.994787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-f848594e-f427-4c26-8462-d29bbf0710e5 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:53.995990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f848594e-f427-4c26-8462-d29bbf0710e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:54.057905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1385/2763] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:54.067474 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ed986-b286-449d-9dd5-5c169c0f7672 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:54.068900 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-089ed986-b286-449d-9dd5-5c169c0f7672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:54.126403 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ed986-b286-449d-9dd5-5c169c0f7672 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:54.130198 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661f745-aafc-44c3-9dc0-ed07e8581b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:54.130884 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661f745-aafc-44c3-9dc0-ed07e8581b34 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:54.131173 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661f745-aafc-44c3-9dc0-ed07e8581b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:54.131451 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661f745-aafc-44c3-9dc0-ed07e8581b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:54.141904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661f745-aafc-44c3-9dc0-ed07e8581b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:54.143318 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661f745-aafc-44c3-9dc0-ed07e8581b34 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:54.153714 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1379/2764] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:23:54.513119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848594e-f427-4c26-8462-d29bbf0710e5 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:54.514897 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-f848594e-f427-4c26-8462-d29bbf0710e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:54.532040 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848594e-f427-4c26-8462-d29bbf0710e5 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:54.537453 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a94e7-6e00-4672-8d35-3d4565fe1513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:54.538398 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a94e7-6e00-4672-8d35-3d4565fe1513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:54.538777 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a94e7-6e00-4672-8d35-3d4565fe1513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:54.539201 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a94e7-6e00-4672-8d35-3d4565fe1513 admin admin] PATH_INFO: `/v3/projects/d30f9cd205774f5cbfdea5db025e0879` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:54.540477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a94e7-6e00-4672-8d35-3d4565fe1513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30f9cd205774f5cbfdea5db025e0879)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:54.545303 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a94e7-6e00-4672-8d35-3d4565fe1513 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:54.599205 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-310a94e7-6e00-4672-8d35-3d4565fe1513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30f9cd205774f5cbfdea5db025e0879', 'request_id': 'req-310a94e7-6e00-4672-8d35-3d4565fe1513'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:54.607899 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-310a94e7-6e00-4672-8d35-3d4565fe1513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30f9cd205774f5cbfdea5db025e0879', 'request_id': 'req-310a94e7-6e00-4672-8d35-3d4565fe1513'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:54.617060 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-310a94e7-6e00-4672-8d35-3d4565fe1513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30f9cd205774f5cbfdea5db025e0879', 'request_id': 'req-310a94e7-6e00-4672-8d35-3d4565fe1513'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:54.630468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-310a94e7-6e00-4672-8d35-3d4565fe1513 admin admin] The token cache is being invalidate because project d30f9cd205774f5cbfdea5db025e0879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:23:54.630857 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-310a94e7-6e00-4672-8d35-3d4565fe1513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:54.631717 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-310a94e7-6e00-4672-8d35-3d4565fe1513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:23:54.633994 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1386/2765] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:23:54 2022] DELETE /identity/v3/projects/d30f9cd205774f5cbfdea5db025e0879 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:54.640237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f9646-1b35-486c-b910-306d19710ac4 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:54.640527 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f9646-1b35-486c-b910-306d19710ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:54.640816 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f9646-1b35-486c-b910-306d19710ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:54.662923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-337f9646-1b35-486c-b910-306d19710ac4 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:54.664996 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-337f9646-1b35-486c-b910-306d19710ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:54.743407 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1380/2766] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:23:54.754168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5206b9-770c-4b2c-a2b2-a189c4bf9789 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:54.754597 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5206b9-770c-4b2c-a2b2-a189c4bf9789 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:54.756066 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5206b9-770c-4b2c-a2b2-a189c4bf9789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:54.780835 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-fc5206b9-770c-4b2c-a2b2-a189c4bf9789 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:54.782053 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-fc5206b9-770c-4b2c-a2b2-a189c4bf9789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:54.790397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1387/2767] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:54.795164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f9646-1b35-486c-b910-306d19710ac4 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:54.805591 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f9646-1b35-486c-b910-306d19710ac4 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:54.811517 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2efdb-9371-4dc3-973e-03c7b359d904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:54.812272 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2efdb-9371-4dc3-973e-03c7b359d904 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:54.812643 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2efdb-9371-4dc3-973e-03c7b359d904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:54.812985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2efdb-9371-4dc3-973e-03c7b359d904 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:54.813722 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2efdb-9371-4dc3-973e-03c7b359d904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:23:54.814026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2efdb-9371-4dc3-973e-03c7b359d904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:54.815679 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2efdb-9371-4dc3-973e-03c7b359d904 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:54.828980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1381/2768] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:23:54.833358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5206b9-770c-4b2c-a2b2-a189c4bf9789 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:54.843508 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5206b9-770c-4b2c-a2b2-a189c4bf9789 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:54.848171 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e517f0c-e232-480f-9293-9cbb053ff82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:54.848972 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e517f0c-e232-480f-9293-9cbb053ff82b admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:54.849260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e517f0c-e232-480f-9293-9cbb053ff82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:54.849537 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e517f0c-e232-480f-9293-9cbb053ff82b admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:54.850277 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e517f0c-e232-480f-9293-9cbb053ff82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:54.852211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e517f0c-e232-480f-9293-9cbb053ff82b admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:54.880958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1388/2769] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:23:54 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:23:54.885912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2efdb-9371-4dc3-973e-03c7b359d904 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:54.895907 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2efdb-9371-4dc3-973e-03c7b359d904 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:54.908904 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:54.960915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995f247-beb4-4337-a175-55799bb62f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:54.961749 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995f247-beb4-4337-a175-55799bb62f52 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:54.962056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995f247-beb4-4337-a175-55799bb62f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:54.962318 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995f247-beb4-4337-a175-55799bb62f52 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:54.963772 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995f247-beb4-4337-a175-55799bb62f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:54.965714 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995f247-beb4-4337-a175-55799bb62f52 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:54.989953 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1382/2770] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:23:54 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:23:54.991372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e517f0c-e232-480f-9293-9cbb053ff82b admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:55.003519 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e517f0c-e232-480f-9293-9cbb053ff82b admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:55.009266 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1eec15-b509-4777-b3e4-141ae0071890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:55.010740 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1eec15-b509-4777-b3e4-141ae0071890 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:55.011029 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1eec15-b509-4777-b3e4-141ae0071890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:55.011311 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1eec15-b509-4777-b3e4-141ae0071890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:55.012044 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1eec15-b509-4777-b3e4-141ae0071890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:55.013649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1eec15-b509-4777-b3e4-141ae0071890 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:55.024427 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1389/2771] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:55.028778 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995f247-beb4-4337-a175-55799bb62f52 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:55.039305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995f247-beb4-4337-a175-55799bb62f52 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:55.044483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4284be2-d07c-466f-8a92-714dc08b98f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:55.045158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4284be2-d07c-466f-8a92-714dc08b98f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:55.045473 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4284be2-d07c-466f-8a92-714dc08b98f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:55.045752 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4284be2-d07c-466f-8a92-714dc08b98f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:55.046544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4284be2-d07c-466f-8a92-714dc08b98f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:55.048155 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4284be2-d07c-466f-8a92-714dc08b98f2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:55.060484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1383/2772] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:23:55.064732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1eec15-b509-4777-b3e4-141ae0071890 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:55.075997 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1eec15-b509-4777-b3e4-141ae0071890 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:55.081817 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ccdf1-bc8d-4496-ae0b-44724f6f9c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:55.082891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ccdf1-bc8d-4496-ae0b-44724f6f9c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:55.083217 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ccdf1-bc8d-4496-ae0b-44724f6f9c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:55.083548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ccdf1-bc8d-4496-ae0b-44724f6f9c7e admin admin] PATH_INFO: `/v3/projects/1383049abed24d958a65dd7bd6ae6ded/users/4a770514147e48098554cd072af5dd30/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:55.094684 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:23:55.103893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ccdf1-bc8d-4496-ae0b-44724f6f9c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1383049abed24d958a65dd7bd6ae6ded, user_id=4a770514147e48098554cd072af5dd30, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:55.107309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ccdf1-bc8d-4496-ae0b-44724f6f9c7e admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:55.122950 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1390/2773] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:23:55 2022] PUT /identity/v3/projects/1383049abed24d958a65dd7bd6ae6ded/users/4a770514147e48098554cd072af5dd30/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:23:55.191938 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c56678-8fe1-4d18-a4ae-c2182490224d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:55.192140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c56678-8fe1-4d18-a4ae-c2182490224d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:55.192384 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c56678-8fe1-4d18-a4ae-c2182490224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:55.223672 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-82c56678-8fe1-4d18-a4ae-c2182490224d None None] MFA Rules not processed for user `4a770514147e48098554cd072af5dd30`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:23:55.224938 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-82c56678-8fe1-4d18-a4ae-c2182490224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:55.310893 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1384/2774] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:23:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:23:55.323390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ccdf1-bc8d-4496-ae0b-44724f6f9c7e admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:23:55.325236 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-c51ccdf1-bc8d-4496-ae0b-44724f6f9c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:23:55.402485 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ccdf1-bc8d-4496-ae0b-44724f6f9c7e admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:23:55.406672 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad52dab-82a3-45d2-a30b-6a4e3c881bb7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59174974208c469b8bb44d94d0e55427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:23:55.407473 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad52dab-82a3-45d2-a30b-6a4e3c881bb7 service glance] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:23:55.407983 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad52dab-82a3-45d2-a30b-6a4e3c881bb7 service glance] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:23:55.408365 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad52dab-82a3-45d2-a30b-6a4e3c881bb7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:23:55.418917 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad52dab-82a3-45d2-a30b-6a4e3c881bb7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:23:55.420498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad52dab-82a3-45d2-a30b-6a4e3c881bb7 service glance] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:23:55.431780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1391/2775] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:23:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:24:04.926626 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c56678-8fe1-4d18-a4ae-c2182490224d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:24:04.928518 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-82c56678-8fe1-4d18-a4ae-c2182490224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:24:05.029214 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c56678-8fe1-4d18-a4ae-c2182490224d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:24:05.038802 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c5ff2-90b8-4ff8-8f96-9d06a14aa917 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:24:05.040254 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c5ff2-90b8-4ff8-8f96-9d06a14aa917 service nova] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:24:05.040890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c5ff2-90b8-4ff8-8f96-9d06a14aa917 service nova] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:24:05.042101 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c5ff2-90b8-4ff8-8f96-9d06a14aa917 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:24:05.045276 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-023c5ff2-90b8-4ff8-8f96-9d06a14aa917 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:24:05.060915 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c5ff2-90b8-4ff8-8f96-9d06a14aa917 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:24:05.062572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c5ff2-90b8-4ff8-8f96-9d06a14aa917 service nova] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:24:05.074630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1385/2776] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:24:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:24:05.426062 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:06.099564 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad52dab-82a3-45d2-a30b-6a4e3c881bb7 service glance] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:24:06.101167 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-2ad52dab-82a3-45d2-a30b-6a4e3c881bb7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:24:06.167678 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad52dab-82a3-45d2-a30b-6a4e3c881bb7 service glance] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:24:06.175041 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487eb31-f300-4c7c-b29d-227cb42fff3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:24:06.175755 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487eb31-f300-4c7c-b29d-227cb42fff3f service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:24:06.176043 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487eb31-f300-4c7c-b29d-227cb42fff3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:24:06.176327 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487eb31-f300-4c7c-b29d-227cb42fff3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:24:06.178180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0487eb31-f300-4c7c-b29d-227cb42fff3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:24:06.259343 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487eb31-f300-4c7c-b29d-227cb42fff3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:24:06.261939 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487eb31-f300-4c7c-b29d-227cb42fff3f service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:24:06.273145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1392/2777] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:24:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:24:15.069015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:16.268140 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=50 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:17.197072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c5ff2-90b8-4ff8-8f96-9d06a14aa917 service nova] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:24:17.198905 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-023c5ff2-90b8-4ff8-8f96-9d06a14aa917 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:24:17.211734 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c5ff2-90b8-4ff8-8f96-9d06a14aa917 service nova] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:24:17.216290 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaac33-6a11-4552-9525-2533eebc4709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:24:17.217036 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaac33-6a11-4552-9525-2533eebc4709 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:24:17.217387 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaac33-6a11-4552-9525-2533eebc4709 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:24:17.217736 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaac33-6a11-4552-9525-2533eebc4709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:24:17.219676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-badaac33-6a11-4552-9525-2533eebc4709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:24:17.230617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badaac33-6a11-4552-9525-2533eebc4709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:24:17.232201 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badaac33-6a11-4552-9525-2533eebc4709 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:24:17.240720 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1386/2778] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:24:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:24:17.317741 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487eb31-f300-4c7c-b29d-227cb42fff3f service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:24:17.329321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487eb31-f300-4c7c-b29d-227cb42fff3f service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:24:17.334001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d30690-599a-40b1-9074-102b5faf7816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:24:17.334698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d30690-599a-40b1-9074-102b5faf7816 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:24:17.334984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d30690-599a-40b1-9074-102b5faf7816 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:24:17.335265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d30690-599a-40b1-9074-102b5faf7816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:24:17.337109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-36d30690-599a-40b1-9074-102b5faf7816 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:24:17.351599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d30690-599a-40b1-9074-102b5faf7816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:24:17.353019 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d30690-599a-40b1-9074-102b5faf7816 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:24:17.364677 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1393/2779] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:24:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:24:21.357656 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaac33-6a11-4552-9525-2533eebc4709 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:24:21.422090 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaac33-6a11-4552-9525-2533eebc4709 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:24:21.426655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce469a22-b017-4ee4-ad4d-f46557aedcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:24:21.427524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce469a22-b017-4ee4-ad4d-f46557aedcd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:24:21.427809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce469a22-b017-4ee4-ad4d-f46557aedcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:24:21.428088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce469a22-b017-4ee4-ad4d-f46557aedcd2 admin admin] PATH_INFO: `/v3/users/4a770514147e48098554cd072af5dd30` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:24:21.429266 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce469a22-b017-4ee4-ad4d-f46557aedcd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a770514147e48098554cd072af5dd30)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:24:21.431219 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce469a22-b017-4ee4-ad4d-f46557aedcd2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:24:21.477718 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ce469a22-b017-4ee4-ad4d-f46557aedcd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a770514147e48098554cd072af5dd30'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:24:21.478683 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ce469a22-b017-4ee4-ad4d-f46557aedcd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a770514147e48098554cd072af5dd30'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:24:21.490404 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ce469a22-b017-4ee4-ad4d-f46557aedcd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a770514147e48098554cd072af5dd30'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:24:21.491261 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ce469a22-b017-4ee4-ad4d-f46557aedcd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a770514147e48098554cd072af5dd30'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:24:21.498274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ce469a22-b017-4ee4-ad4d-f46557aedcd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a770514147e48098554cd072af5dd30'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:24:21.512572 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1387/2780] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:24:21 2022] DELETE /identity/v3/users/4a770514147e48098554cd072af5dd30 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:24:21.517209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e2514-4f42-45e6-9c63-b9c02f842693 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:24:21.517742 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e2514-4f42-45e6-9c63-b9c02f842693 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:24:21.517845 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e2514-4f42-45e6-9c63-b9c02f842693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:24:21.535689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-790e2514-4f42-45e6-9c63-b9c02f842693 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:24:21.536937 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-790e2514-4f42-45e6-9c63-b9c02f842693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:24:21.596095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1394/2781] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:24:21.605991 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce469a22-b017-4ee4-ad4d-f46557aedcd2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:24:21.607559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ce469a22-b017-4ee4-ad4d-f46557aedcd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:24:21.666740 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce469a22-b017-4ee4-ad4d-f46557aedcd2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:24:21.670537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90726acc-01c5-4b26-8f65-e34b3e11b568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:24:21.671183 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90726acc-01c5-4b26-8f65-e34b3e11b568 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:24:21.671465 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90726acc-01c5-4b26-8f65-e34b3e11b568 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:24:21.671738 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90726acc-01c5-4b26-8f65-e34b3e11b568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:24:21.680814 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90726acc-01c5-4b26-8f65-e34b3e11b568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:24:21.683470 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90726acc-01c5-4b26-8f65-e34b3e11b568 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:24:21.693322 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1388/2782] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:24:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:24:22.032289 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e2514-4f42-45e6-9c63-b9c02f842693 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:24:22.035799 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-790e2514-4f42-45e6-9c63-b9c02f842693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:24:22.052461 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e2514-4f42-45e6-9c63-b9c02f842693 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:24:22.075421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f5cae-b3bc-41f4-97fb-f4933f999027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:24:22.077864 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f5cae-b3bc-41f4-97fb-f4933f999027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:24:22.078583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f5cae-b3bc-41f4-97fb-f4933f999027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:24:22.078952 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f5cae-b3bc-41f4-97fb-f4933f999027 admin admin] PATH_INFO: `/v3/projects/1383049abed24d958a65dd7bd6ae6ded` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:24:22.081186 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f5cae-b3bc-41f4-97fb-f4933f999027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1383049abed24d958a65dd7bd6ae6ded)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:24:22.084962 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f5cae-b3bc-41f4-97fb-f4933f999027 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:24:22.134798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-aa4f5cae-b3bc-41f4-97fb-f4933f999027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1383049abed24d958a65dd7bd6ae6ded', 'request_id': 'req-aa4f5cae-b3bc-41f4-97fb-f4933f999027'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:24:22.140212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-aa4f5cae-b3bc-41f4-97fb-f4933f999027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1383049abed24d958a65dd7bd6ae6ded', 'request_id': 'req-aa4f5cae-b3bc-41f4-97fb-f4933f999027'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:24:22.148056 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-aa4f5cae-b3bc-41f4-97fb-f4933f999027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1383049abed24d958a65dd7bd6ae6ded', 'request_id': 'req-aa4f5cae-b3bc-41f4-97fb-f4933f999027'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:24:22.160595 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-aa4f5cae-b3bc-41f4-97fb-f4933f999027 admin admin] The token cache is being invalidate because project 1383049abed24d958a65dd7bd6ae6ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:24:22.160884 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-aa4f5cae-b3bc-41f4-97fb-f4933f999027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:24:22.161550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-aa4f5cae-b3bc-41f4-97fb-f4933f999027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:24:22.163117 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1395/2783] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:24:22 2022] DELETE /identity/v3/projects/1383049abed24d958a65dd7bd6ae6ded => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:24:31.688973 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:32.157144 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:24:52.930580 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90726acc-01c5-4b26-8f65-e34b3e11b568 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:24:52.932759 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-90726acc-01c5-4b26-8f65-e34b3e11b568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:24:53.026845 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90726acc-01c5-4b26-8f65-e34b3e11b568 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:24:53.095140 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2c575-dc17-4585-907d-95299344d93d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e8222d303aa487ca2b5c5bed6124f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:24:53.095803 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2c575-dc17-4585-907d-95299344d93d service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:24:53.096092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2c575-dc17-4585-907d-95299344d93d service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:24:53.096427 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2c575-dc17-4585-907d-95299344d93d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:24:53.098258 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d9b2c575-dc17-4585-907d-95299344d93d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:24:53.111473 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2c575-dc17-4585-907d-95299344d93d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:24:53.113116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2c575-dc17-4585-907d-95299344d93d service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:24:53.123644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1389/2784] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:24:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:25:02.602095 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3ac5d-0f3c-4da1-87f4-e18edcfb4be6 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:25:02.602685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3ac5d-0f3c-4da1-87f4-e18edcfb4be6 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:25:02.602685 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3ac5d-0f3c-4da1-87f4-e18edcfb4be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:25:02.622389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-8bb3ac5d-0f3c-4da1-87f4-e18edcfb4be6 None None] MFA Rules not processed for user `d50fd94260f446e1add25376647b22ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:25:02.623644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8bb3ac5d-0f3c-4da1-87f4-e18edcfb4be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:25:02.681800 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1396/2785] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:25:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:25:03.119940 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=58 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:12.675036 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=25 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:47.287520 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bd80a-1872-4fb6-bbb5-4b67980d38e3 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:25:47.288527 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bd80a-1872-4fb6-bbb5-4b67980d38e3 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:25:47.288812 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bd80a-1872-4fb6-bbb5-4b67980d38e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:25:47.306993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-592bd80a-1872-4fb6-bbb5-4b67980d38e3 None None] MFA Rules not processed for user `36f7c6f172424967bb7749180711db07`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:25:47.308215 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-592bd80a-1872-4fb6-bbb5-4b67980d38e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:25:47.368756 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1390/2786] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jun 16 16:25:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:25:47.411639 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3ac5d-0f3c-4da1-87f4-e18edcfb4be6 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:25:47.413189 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8bb3ac5d-0f3c-4da1-87f4-e18edcfb4be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:25:47.484058 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3ac5d-0f3c-4da1-87f4-e18edcfb4be6 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:25:47.489103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447fd89-37bf-4736-a251-1600f6ab2cda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8527cbb8efe43d7bb297d779929a50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:25:47.489761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447fd89-37bf-4736-a251-1600f6ab2cda service swift] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:25:47.490048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447fd89-37bf-4736-a251-1600f6ab2cda service swift] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:25:47.490332 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447fd89-37bf-4736-a251-1600f6ab2cda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:25:47.499048 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447fd89-37bf-4736-a251-1600f6ab2cda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:25:47.500647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447fd89-37bf-4736-a251-1600f6ab2cda service swift] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:25:47.508850 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1397/2787] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 16 16:25:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 16:25:55.148265 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bd80a-1872-4fb6-bbb5-4b67980d38e3 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:25:55.151208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-592bd80a-1872-4fb6-bbb5-4b67980d38e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:25:55.186769 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bd80a-1872-4fb6-bbb5-4b67980d38e3 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:25:55.195300 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045f0ab-830a-4765-acb1-94f8d8157dbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e8222d303aa487ca2b5c5bed6124f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:25:55.196799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045f0ab-830a-4765-acb1-94f8d8157dbd service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:25:55.197349 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045f0ab-830a-4765-acb1-94f8d8157dbd service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:25:55.197829 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045f0ab-830a-4765-acb1-94f8d8157dbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:25:55.200077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-d045f0ab-830a-4765-acb1-94f8d8157dbd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:25:55.225830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447fd89-37bf-4736-a251-1600f6ab2cda service swift] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:25:55.227375 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a447fd89-37bf-4736-a251-1600f6ab2cda service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:25:55.227921 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045f0ab-830a-4765-acb1-94f8d8157dbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:25:55.229630 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045f0ab-830a-4765-acb1-94f8d8157dbd service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:25:55.260565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1391/2788] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:25:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:25:55.319288 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447fd89-37bf-4736-a251-1600f6ab2cda service swift] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:25:55.325749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22313d-5c14-41cc-8ba3-6399160b07da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:25:55.326937 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22313d-5c14-41cc-8ba3-6399160b07da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:25:55.327443 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22313d-5c14-41cc-8ba3-6399160b07da admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:25:55.327928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22313d-5c14-41cc-8ba3-6399160b07da admin admin] PATH_INFO: `/v3/users/dcb117cb2fb5447ea2c56894869843f0` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:25:55.329300 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22313d-5c14-41cc-8ba3-6399160b07da admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb117cb2fb5447ea2c56894869843f0)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:25:55.331415 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22313d-5c14-41cc-8ba3-6399160b07da admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:25:55.420950 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9a22313d-5c14-41cc-8ba3-6399160b07da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb117cb2fb5447ea2c56894869843f0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:55.437582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9a22313d-5c14-41cc-8ba3-6399160b07da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb117cb2fb5447ea2c56894869843f0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:55.438416 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9a22313d-5c14-41cc-8ba3-6399160b07da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb117cb2fb5447ea2c56894869843f0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:55.439211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9a22313d-5c14-41cc-8ba3-6399160b07da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb117cb2fb5447ea2c56894869843f0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:55.450575 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-9a22313d-5c14-41cc-8ba3-6399160b07da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb117cb2fb5447ea2c56894869843f0'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:55.471408 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1398/2789] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:25:55 2022] DELETE /identity/v3/users/dcb117cb2fb5447ea2c56894869843f0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:25:55.679109 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045f0ab-830a-4765-acb1-94f8d8157dbd service placement] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:25:55.700421 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045f0ab-830a-4765-acb1-94f8d8157dbd service placement] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:25:55.774748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e5b8b-b686-4dd2-877a-b9e249451eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:25:55.775548 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e5b8b-b686-4dd2-877a-b9e249451eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:25:55.775834 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e5b8b-b686-4dd2-877a-b9e249451eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:25:55.776113 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e5b8b-b686-4dd2-877a-b9e249451eda admin admin] PATH_INFO: `/v3/projects/de0cc62c02cc411fb4e690f57044f910` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:25:55.777307 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e5b8b-b686-4dd2-877a-b9e249451eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0cc62c02cc411fb4e690f57044f910)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:25:55.779821 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e5b8b-b686-4dd2-877a-b9e249451eda admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:25:55.855636 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-060e5b8b-b686-4dd2-877a-b9e249451eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0cc62c02cc411fb4e690f57044f910', 'request_id': 'req-060e5b8b-b686-4dd2-877a-b9e249451eda'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:55.866235 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-060e5b8b-b686-4dd2-877a-b9e249451eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0cc62c02cc411fb4e690f57044f910', 'request_id': 'req-060e5b8b-b686-4dd2-877a-b9e249451eda'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:55.883962 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-060e5b8b-b686-4dd2-877a-b9e249451eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0cc62c02cc411fb4e690f57044f910', 'request_id': 'req-060e5b8b-b686-4dd2-877a-b9e249451eda'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:55.905863 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-060e5b8b-b686-4dd2-877a-b9e249451eda admin admin] The token cache is being invalidate because project de0cc62c02cc411fb4e690f57044f910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:25:55.906267 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-060e5b8b-b686-4dd2-877a-b9e249451eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:55.907502 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-060e5b8b-b686-4dd2-877a-b9e249451eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:55.911062 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1392/2790] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:25:55 2022] DELETE /identity/v3/projects/de0cc62c02cc411fb4e690f57044f910 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:25:55.916421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22313d-5c14-41cc-8ba3-6399160b07da admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:25:55.918009 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-9a22313d-5c14-41cc-8ba3-6399160b07da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:25:55.935278 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22313d-5c14-41cc-8ba3-6399160b07da admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:25:55.942315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:56.014351 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f677d9a-10e8-41f1-9e6c-ed1aebfd2111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:25:56.015286 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f677d9a-10e8-41f1-9e6c-ed1aebfd2111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:25:56.015566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f677d9a-10e8-41f1-9e6c-ed1aebfd2111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:25:56.016385 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f677d9a-10e8-41f1-9e6c-ed1aebfd2111 admin admin] PATH_INFO: `/v3/users/fa7dece2be1c451aaf5639a8070c77c7` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:25:56.017791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f677d9a-10e8-41f1-9e6c-ed1aebfd2111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7dece2be1c451aaf5639a8070c77c7)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:25:56.020395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f677d9a-10e8-41f1-9e6c-ed1aebfd2111 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:25:56.071258 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3f677d9a-10e8-41f1-9e6c-ed1aebfd2111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7dece2be1c451aaf5639a8070c77c7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:56.084559 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3f677d9a-10e8-41f1-9e6c-ed1aebfd2111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7dece2be1c451aaf5639a8070c77c7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:56.085271 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3f677d9a-10e8-41f1-9e6c-ed1aebfd2111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7dece2be1c451aaf5639a8070c77c7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:56.086493 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3f677d9a-10e8-41f1-9e6c-ed1aebfd2111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7dece2be1c451aaf5639a8070c77c7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:56.094909 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-3f677d9a-10e8-41f1-9e6c-ed1aebfd2111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7dece2be1c451aaf5639a8070c77c7'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:56.107929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1399/2791] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:25:55 2022] DELETE /identity/v3/users/fa7dece2be1c451aaf5639a8070c77c7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:25:56.303542 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e5b8b-b686-4dd2-877a-b9e249451eda admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:25:56.305602 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-060e5b8b-b686-4dd2-877a-b9e249451eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:25:56.342265 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e5b8b-b686-4dd2-877a-b9e249451eda admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:25:56.379252 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:56.434303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:25:56.436484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:25:56.436995 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:25:56.437279 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2 admin admin] PATH_INFO: `/v3/projects/6c2fcd2a88404d45a021d31452ea2adf` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:25:56.439431 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2fcd2a88404d45a021d31452ea2adf)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:25:56.441612 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:25:56.507370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2fcd2a88404d45a021d31452ea2adf', 'request_id': 'req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:56.513753 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2fcd2a88404d45a021d31452ea2adf', 'request_id': 'req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:56.525980 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2fcd2a88404d45a021d31452ea2adf', 'request_id': 'req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:56.540684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2 admin admin] The token cache is being invalidate because project 6c2fcd2a88404d45a021d31452ea2adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:25:56.541208 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:56.542180 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:56.544035 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1393/2792] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:25:56 2022] DELETE /identity/v3/projects/6c2fcd2a88404d45a021d31452ea2adf => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:25:58.546726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f677d9a-10e8-41f1-9e6c-ed1aebfd2111 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:25:58.548188 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-3f677d9a-10e8-41f1-9e6c-ed1aebfd2111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:25:58.567420 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f677d9a-10e8-41f1-9e6c-ed1aebfd2111 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:25:58.624548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4de2b9-0bb9-4d62-a5d8-b33cd6797fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:25:58.625427 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4de2b9-0bb9-4d62-a5d8-b33cd6797fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:25:58.625710 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4de2b9-0bb9-4d62-a5d8-b33cd6797fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:25:58.625987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4de2b9-0bb9-4d62-a5d8-b33cd6797fe0 admin admin] PATH_INFO: `/v3/users/3ea287d757294275aaae0632a115a6bd` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:25:58.627197 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4de2b9-0bb9-4d62-a5d8-b33cd6797fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea287d757294275aaae0632a115a6bd)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:25:58.629149 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4de2b9-0bb9-4d62-a5d8-b33cd6797fe0 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:25:58.665030 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:58.683638 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ac4de2b9-0bb9-4d62-a5d8-b33cd6797fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea287d757294275aaae0632a115a6bd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:58.696366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ac4de2b9-0bb9-4d62-a5d8-b33cd6797fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea287d757294275aaae0632a115a6bd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:58.697113 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ac4de2b9-0bb9-4d62-a5d8-b33cd6797fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea287d757294275aaae0632a115a6bd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:58.697731 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ac4de2b9-0bb9-4d62-a5d8-b33cd6797fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea287d757294275aaae0632a115a6bd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:58.706905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ac4de2b9-0bb9-4d62-a5d8-b33cd6797fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea287d757294275aaae0632a115a6bd'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:58.720585 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1400/2793] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:25:58 2022] DELETE /identity/v3/users/3ea287d757294275aaae0632a115a6bd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:25:58.897189 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:25:58.899107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:25:58.915031 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace808d0-0cd8-45ef-a7c8-8b86bf0e70d2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:25:58.977653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0ddce-988e-49f6-8625-67eec1a61868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:25:58.978677 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0ddce-988e-49f6-8625-67eec1a61868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:25:58.979067 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0ddce-988e-49f6-8625-67eec1a61868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:25:58.979418 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0ddce-988e-49f6-8625-67eec1a61868 admin admin] PATH_INFO: `/v3/projects/ba7435427acc49fb9b6fa2fe233b183d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:25:58.980676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0ddce-988e-49f6-8625-67eec1a61868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba7435427acc49fb9b6fa2fe233b183d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:25:58.982793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0ddce-988e-49f6-8625-67eec1a61868 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:25:59.033061 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b4e0ddce-988e-49f6-8625-67eec1a61868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba7435427acc49fb9b6fa2fe233b183d', 'request_id': 'req-b4e0ddce-988e-49f6-8625-67eec1a61868'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:59.037106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:25:59.040191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b4e0ddce-988e-49f6-8625-67eec1a61868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba7435427acc49fb9b6fa2fe233b183d', 'request_id': 'req-b4e0ddce-988e-49f6-8625-67eec1a61868'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:59.049088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b4e0ddce-988e-49f6-8625-67eec1a61868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba7435427acc49fb9b6fa2fe233b183d', 'request_id': 'req-b4e0ddce-988e-49f6-8625-67eec1a61868'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:59.061539 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b4e0ddce-988e-49f6-8625-67eec1a61868 admin admin] The token cache is being invalidate because project ba7435427acc49fb9b6fa2fe233b183d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:25:59.061750 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b4e0ddce-988e-49f6-8625-67eec1a61868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:59.062390 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-b4e0ddce-988e-49f6-8625-67eec1a61868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:59.064211 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1394/2794] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:25:58 2022] DELETE /identity/v3/projects/ba7435427acc49fb9b6fa2fe233b183d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:25:59.067915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4de2b9-0bb9-4d62-a5d8-b33cd6797fe0 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:25:59.069408 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ac4de2b9-0bb9-4d62-a5d8-b33cd6797fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:25:59.084421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4de2b9-0bb9-4d62-a5d8-b33cd6797fe0 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:25:59.144143 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dccab3-e805-4025-9727-1dbe5da26318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:25:59.145053 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dccab3-e805-4025-9727-1dbe5da26318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:25:59.145331 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dccab3-e805-4025-9727-1dbe5da26318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:25:59.145609 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dccab3-e805-4025-9727-1dbe5da26318 admin admin] PATH_INFO: `/v3/users/f25733c56344454d9df7f7b726083102` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:25:59.146818 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dccab3-e805-4025-9727-1dbe5da26318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25733c56344454d9df7f7b726083102)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:25:59.148851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dccab3-e805-4025-9727-1dbe5da26318 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:25:59.202196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-11dccab3-e805-4025-9727-1dbe5da26318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25733c56344454d9df7f7b726083102'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:59.216130 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-11dccab3-e805-4025-9727-1dbe5da26318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25733c56344454d9df7f7b726083102'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:59.217286 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-11dccab3-e805-4025-9727-1dbe5da26318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25733c56344454d9df7f7b726083102'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:59.217803 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-11dccab3-e805-4025-9727-1dbe5da26318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25733c56344454d9df7f7b726083102'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:59.225871 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-11dccab3-e805-4025-9727-1dbe5da26318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25733c56344454d9df7f7b726083102'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:59.239024 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1401/2795] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:25:59 2022] DELETE /identity/v3/users/f25733c56344454d9df7f7b726083102 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:25:59.578727 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0ddce-988e-49f6-8625-67eec1a61868 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:25:59.580416 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-b4e0ddce-988e-49f6-8625-67eec1a61868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:25:59.595116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0ddce-988e-49f6-8625-67eec1a61868 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:25:59.680315 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781be0b2-be8e-4e19-83f6-213bd371b237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:25:59.681196 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be0b2-be8e-4e19-83f6-213bd371b237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:25:59.681486 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be0b2-be8e-4e19-83f6-213bd371b237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:25:59.681768 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be0b2-be8e-4e19-83f6-213bd371b237 admin admin] PATH_INFO: `/v3/projects/474ae3dc586d401797f0d84130e599d9` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:25:59.683789 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781be0b2-be8e-4e19-83f6-213bd371b237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=474ae3dc586d401797f0d84130e599d9)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:25:59.686632 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781be0b2-be8e-4e19-83f6-213bd371b237 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:25:59.736857 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-781be0b2-be8e-4e19-83f6-213bd371b237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474ae3dc586d401797f0d84130e599d9', 'request_id': 'req-781be0b2-be8e-4e19-83f6-213bd371b237'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:59.742564 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-781be0b2-be8e-4e19-83f6-213bd371b237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474ae3dc586d401797f0d84130e599d9', 'request_id': 'req-781be0b2-be8e-4e19-83f6-213bd371b237'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:59.752125 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-781be0b2-be8e-4e19-83f6-213bd371b237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474ae3dc586d401797f0d84130e599d9', 'request_id': 'req-781be0b2-be8e-4e19-83f6-213bd371b237'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:59.767809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-781be0b2-be8e-4e19-83f6-213bd371b237 admin admin] The token cache is being invalidate because project 474ae3dc586d401797f0d84130e599d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:25:59.769393 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-781be0b2-be8e-4e19-83f6-213bd371b237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:59.770515 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-781be0b2-be8e-4e19-83f6-213bd371b237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:25:59.772043 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1395/2796] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:25:59 2022] DELETE /identity/v3/projects/474ae3dc586d401797f0d84130e599d9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:26:02.605148 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f15e7-3f57-4cc6-bc45-467e8beac805 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:26:02.605629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f15e7-3f57-4cc6-bc45-467e8beac805 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:26:02.605758 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f15e7-3f57-4cc6-bc45-467e8beac805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:26:02.623415 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a91f15e7-3f57-4cc6-bc45-467e8beac805 None None] MFA Rules not processed for user `d50fd94260f446e1add25376647b22ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:26:02.624550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a91f15e7-3f57-4cc6-bc45-467e8beac805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:26:02.646380 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:26:02.687214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1402/2797] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:26:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:26:09.762064 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=9,keystone:SELECT=56,keystone:INSERT=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:26:12.679864 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=13 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:26:51.369368 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781be0b2-be8e-4e19-83f6-213bd371b237 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:26:51.370814 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-781be0b2-be8e-4e19-83f6-213bd371b237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:26:51.432970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781be0b2-be8e-4e19-83f6-213bd371b237 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:26:51.436531 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b425fdb-2edc-44d5-9dd6-bb43eff204da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:26:51.437175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b425fdb-2edc-44d5-9dd6-bb43eff204da service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:26:51.437457 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b425fdb-2edc-44d5-9dd6-bb43eff204da service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:26:51.437733 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b425fdb-2edc-44d5-9dd6-bb43eff204da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:26:51.439655 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4b425fdb-2edc-44d5-9dd6-bb43eff204da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:26:51.510650 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b425fdb-2edc-44d5-9dd6-bb43eff204da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:26:51.512094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b425fdb-2edc-44d5-9dd6-bb43eff204da service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:26:51.523894 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1396/2798] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:26:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:26:54.116397 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f15e7-3f57-4cc6-bc45-467e8beac805 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:26:54.125819 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f15e7-3f57-4cc6-bc45-467e8beac805 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:26:54.129358 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840a01d-1fae-413c-bfea-ab6d3c24f545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:26:54.129993 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840a01d-1fae-413c-bfea-ab6d3c24f545 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:26:54.130275 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840a01d-1fae-413c-bfea-ab6d3c24f545 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:26:54.130584 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840a01d-1fae-413c-bfea-ab6d3c24f545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:26:54.132337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-e840a01d-1fae-413c-bfea-ab6d3c24f545 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:26:54.145258 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840a01d-1fae-413c-bfea-ab6d3c24f545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:26:54.147477 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840a01d-1fae-413c-bfea-ab6d3c24f545 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:26:54.158589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1403/2799] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:26:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:27:01.518202 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=54 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:04.153451 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=6 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:06.493916 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b425fdb-2edc-44d5-9dd6-bb43eff204da service cinder] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:06.495476 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-4b425fdb-2edc-44d5-9dd6-bb43eff204da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:06.566708 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b425fdb-2edc-44d5-9dd6-bb43eff204da service cinder] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:06.572230 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3c688-9d7a-4d42-875b-c1d246363651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:06.573127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3c688-9d7a-4d42-875b-c1d246363651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:06.573410 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3c688-9d7a-4d42-875b-c1d246363651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:06.573687 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3c688-9d7a-4d42-875b-c1d246363651 admin admin] PATH_INFO: `/v3/users/d50fd94260f446e1add25376647b22ab` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:06.575006 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3c688-9d7a-4d42-875b-c1d246363651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50fd94260f446e1add25376647b22ab)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:06.577059 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3c688-9d7a-4d42-875b-c1d246363651 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:06.626393 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a9b3c688-9d7a-4d42-875b-c1d246363651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50fd94260f446e1add25376647b22ab'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:06.627095 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a9b3c688-9d7a-4d42-875b-c1d246363651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50fd94260f446e1add25376647b22ab'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:06.639938 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a9b3c688-9d7a-4d42-875b-c1d246363651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50fd94260f446e1add25376647b22ab'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:06.640558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a9b3c688-9d7a-4d42-875b-c1d246363651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50fd94260f446e1add25376647b22ab'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:06.647793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a9b3c688-9d7a-4d42-875b-c1d246363651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50fd94260f446e1add25376647b22ab'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:06.667087 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1397/2800] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:27:06 2022] DELETE /identity/v3/users/d50fd94260f446e1add25376647b22ab => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:06.847380 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840a01d-1fae-413c-bfea-ab6d3c24f545 service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:06.858749 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840a01d-1fae-413c-bfea-ab6d3c24f545 service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:06.915309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3a348-88ed-452b-a718-c8e02591f1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:06.916099 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3a348-88ed-452b-a718-c8e02591f1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:06.916379 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3a348-88ed-452b-a718-c8e02591f1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:06.916657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3a348-88ed-452b-a718-c8e02591f1ec admin admin] PATH_INFO: `/v3/projects/9ed316beab9f499baf80ab42a00586aa` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:06.917825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3a348-88ed-452b-a718-c8e02591f1ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed316beab9f499baf80ab42a00586aa)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:06.919726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3a348-88ed-452b-a718-c8e02591f1ec admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:06.969315 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e2a3a348-88ed-452b-a718-c8e02591f1ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed316beab9f499baf80ab42a00586aa', 'request_id': 'req-e2a3a348-88ed-452b-a718-c8e02591f1ec'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:06.974811 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e2a3a348-88ed-452b-a718-c8e02591f1ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed316beab9f499baf80ab42a00586aa', 'request_id': 'req-e2a3a348-88ed-452b-a718-c8e02591f1ec'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:06.983124 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e2a3a348-88ed-452b-a718-c8e02591f1ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed316beab9f499baf80ab42a00586aa', 'request_id': 'req-e2a3a348-88ed-452b-a718-c8e02591f1ec'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:06.995012 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e2a3a348-88ed-452b-a718-c8e02591f1ec admin admin] The token cache is being invalidate because project 9ed316beab9f499baf80ab42a00586aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:27:06.995303 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e2a3a348-88ed-452b-a718-c8e02591f1ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:06.995951 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-e2a3a348-88ed-452b-a718-c8e02591f1ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:06.997524 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1404/2801] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:27:06 2022] DELETE /identity/v3/projects/9ed316beab9f499baf80ab42a00586aa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:07.002741 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9e464-e3f5-4aca-8df5-0e06c78aacc9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:07.003059 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9e464-e3f5-4aca-8df5-0e06c78aacc9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:07.003338 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9e464-e3f5-4aca-8df5-0e06c78aacc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:07.025492 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-46d9e464-e3f5-4aca-8df5-0e06c78aacc9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:07.026758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-46d9e464-e3f5-4aca-8df5-0e06c78aacc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:07.088809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1398/2802] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:07.096570 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43b64f-6d88-4c8c-b79d-1527af5dff06 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:07.096867 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43b64f-6d88-4c8c-b79d-1527af5dff06 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:07.097154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43b64f-6d88-4c8c-b79d-1527af5dff06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:07.115669 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-5e43b64f-6d88-4c8c-b79d-1527af5dff06 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:07.117489 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-5e43b64f-6d88-4c8c-b79d-1527af5dff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:07.125498 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1405/2803] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:07.129759 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9e464-e3f5-4aca-8df5-0e06c78aacc9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:07.140272 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9e464-e3f5-4aca-8df5-0e06c78aacc9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:07.144846 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac965af-5d6b-4f91-85b5-a041d35a4b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:07.145510 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac965af-5d6b-4f91-85b5-a041d35a4b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:07.145796 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac965af-5d6b-4f91-85b5-a041d35a4b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:07.146077 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac965af-5d6b-4f91-85b5-a041d35a4b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:07.146864 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac965af-5d6b-4f91-85b5-a041d35a4b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:27:07.147237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac965af-5d6b-4f91-85b5-a041d35a4b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:07.149531 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac965af-5d6b-4f91-85b5-a041d35a4b1f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:07.161401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1399/2804] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:27:07.166168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43b64f-6d88-4c8c-b79d-1527af5dff06 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:07.175625 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43b64f-6d88-4c8c-b79d-1527af5dff06 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:07.180663 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba42070-0c9d-4e2a-891a-ee1042b07bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:07.181350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba42070-0c9d-4e2a-891a-ee1042b07bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:07.181636 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba42070-0c9d-4e2a-891a-ee1042b07bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:07.181915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba42070-0c9d-4e2a-891a-ee1042b07bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:07.182650 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba42070-0c9d-4e2a-891a-ee1042b07bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:07.184561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba42070-0c9d-4e2a-891a-ee1042b07bf7 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:07.211162 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1406/2805] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:27:07 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:27:07.215541 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac965af-5d6b-4f91-85b5-a041d35a4b1f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:07.225514 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac965af-5d6b-4f91-85b5-a041d35a4b1f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:07.229123 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:07.286825 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b5707-681d-49cf-aa3e-ccadceacc019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:07.287506 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5707-681d-49cf-aa3e-ccadceacc019 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:07.287795 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5707-681d-49cf-aa3e-ccadceacc019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:07.288078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5707-681d-49cf-aa3e-ccadceacc019 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:07.288806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b5707-681d-49cf-aa3e-ccadceacc019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:07.290791 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b5707-681d-49cf-aa3e-ccadceacc019 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:07.313379 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1400/2806] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:27:07 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:27:07.318553 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba42070-0c9d-4e2a-891a-ee1042b07bf7 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:07.329737 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba42070-0c9d-4e2a-891a-ee1042b07bf7 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:07.334687 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bd43e-6203-4415-99f1-957e8feb3539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:07.336514 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bd43e-6203-4415-99f1-957e8feb3539 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:07.336810 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bd43e-6203-4415-99f1-957e8feb3539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:07.337096 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bd43e-6203-4415-99f1-957e8feb3539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:07.337835 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bd43e-6203-4415-99f1-957e8feb3539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:07.339695 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bd43e-6203-4415-99f1-957e8feb3539 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:07.350915 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1407/2807] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:07.355012 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b5707-681d-49cf-aa3e-ccadceacc019 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:07.365388 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b5707-681d-49cf-aa3e-ccadceacc019 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:07.371317 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52269363-9b1e-4280-8566-e83c23b31653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:07.372020 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269363-9b1e-4280-8566-e83c23b31653 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:07.372305 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269363-9b1e-4280-8566-e83c23b31653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:07.372580 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269363-9b1e-4280-8566-e83c23b31653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:07.373583 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52269363-9b1e-4280-8566-e83c23b31653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:07.375025 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52269363-9b1e-4280-8566-e83c23b31653 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:07.386337 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1401/2808] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:07.390516 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bd43e-6203-4415-99f1-957e8feb3539 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:07.400646 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bd43e-6203-4415-99f1-957e8feb3539 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:07.405228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50a5a7-2028-4eb9-ac8d-8d1afebd7477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:07.406108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50a5a7-2028-4eb9-ac8d-8d1afebd7477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:07.406395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50a5a7-2028-4eb9-ac8d-8d1afebd7477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:07.406711 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50a5a7-2028-4eb9-ac8d-8d1afebd7477 admin admin] PATH_INFO: `/v3/projects/27945db055034db08a786a3fd5f44209/users/00b2f5bf98b24cf6a477911db203d4e2/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:07.421228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50a5a7-2028-4eb9-ac8d-8d1afebd7477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27945db055034db08a786a3fd5f44209, user_id=00b2f5bf98b24cf6a477911db203d4e2, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:07.423907 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50a5a7-2028-4eb9-ac8d-8d1afebd7477 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:07.437941 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1408/2809] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:27:07 2022] PUT /identity/v3/projects/27945db055034db08a786a3fd5f44209/users/00b2f5bf98b24cf6a477911db203d4e2/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:07.448693 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a651a7-ed5a-4781-a703-88d7d9618918 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:07.448986 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a651a7-ed5a-4781-a703-88d7d9618918 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:07.449289 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a651a7-ed5a-4781-a703-88d7d9618918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:07.476800 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-75a651a7-ed5a-4781-a703-88d7d9618918 None None] MFA Rules not processed for user `00b2f5bf98b24cf6a477911db203d4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:07.478017 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-75a651a7-ed5a-4781-a703-88d7d9618918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:07.542116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1402/2810] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:07.553496 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50a5a7-2028-4eb9-ac8d-8d1afebd7477 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:07.555801 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-eb50a5a7-2028-4eb9-ac8d-8d1afebd7477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:07.587028 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:07.630855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50a5a7-2028-4eb9-ac8d-8d1afebd7477 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:07.637196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef227a1-7980-493e-b19d-39b27997666f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795c029cb14b42b5b0f3987e218d4239', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:07.637854 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef227a1-7980-493e-b19d-39b27997666f service nova] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:07.638142 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef227a1-7980-493e-b19d-39b27997666f service nova] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:07.638442 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef227a1-7980-493e-b19d-39b27997666f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:07.646403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef227a1-7980-493e-b19d-39b27997666f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:07.648110 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef227a1-7980-493e-b19d-39b27997666f service nova] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:07.657582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1409/2811] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:27:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:27:07.875757 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a651a7-ed5a-4781-a703-88d7d9618918 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:07.947671 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a651a7-ed5a-4781-a703-88d7d9618918 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:07.952194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70458a7b-39c6-4886-8f56-bc7ed92eb0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:07.953072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70458a7b-39c6-4886-8f56-bc7ed92eb0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:07.953385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70458a7b-39c6-4886-8f56-bc7ed92eb0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:07.953665 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70458a7b-39c6-4886-8f56-bc7ed92eb0b0 admin admin] PATH_INFO: `/v3/users/00b2f5bf98b24cf6a477911db203d4e2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:07.954982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70458a7b-39c6-4886-8f56-bc7ed92eb0b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00b2f5bf98b24cf6a477911db203d4e2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:07.956918 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70458a7b-39c6-4886-8f56-bc7ed92eb0b0 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:07.973249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:08.005638 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-70458a7b-39c6-4886-8f56-bc7ed92eb0b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00b2f5bf98b24cf6a477911db203d4e2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:08.006280 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-70458a7b-39c6-4886-8f56-bc7ed92eb0b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00b2f5bf98b24cf6a477911db203d4e2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:08.018458 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-70458a7b-39c6-4886-8f56-bc7ed92eb0b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00b2f5bf98b24cf6a477911db203d4e2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:08.019089 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-70458a7b-39c6-4886-8f56-bc7ed92eb0b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00b2f5bf98b24cf6a477911db203d4e2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:08.026116 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-70458a7b-39c6-4886-8f56-bc7ed92eb0b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00b2f5bf98b24cf6a477911db203d4e2'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:08.039498 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1403/2812] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:27:07 2022] DELETE /identity/v3/users/00b2f5bf98b24cf6a477911db203d4e2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:27:08.044192 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a89043-801e-4621-a12b-bffdad505208 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:08.044688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a89043-801e-4621-a12b-bffdad505208 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:08.044854 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a89043-801e-4621-a12b-bffdad505208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:08.062549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-d0a89043-801e-4621-a12b-bffdad505208 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:08.063752 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d0a89043-801e-4621-a12b-bffdad505208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:08.123345 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1410/2813] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:08.132988 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70458a7b-39c6-4886-8f56-bc7ed92eb0b0 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:08.134397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-70458a7b-39c6-4886-8f56-bc7ed92eb0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:08.193948 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70458a7b-39c6-4886-8f56-bc7ed92eb0b0 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:08.198325 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ae0aa-3d35-42d0-9e11-4cadeac6d4fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:08.198946 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ae0aa-3d35-42d0-9e11-4cadeac6d4fd service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:08.199235 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ae0aa-3d35-42d0-9e11-4cadeac6d4fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:08.199512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ae0aa-3d35-42d0-9e11-4cadeac6d4fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:08.208483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ae0aa-3d35-42d0-9e11-4cadeac6d4fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:08.209919 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ae0aa-3d35-42d0-9e11-4cadeac6d4fd service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:08.220302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1404/2814] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:27:08.489174 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a89043-801e-4621-a12b-bffdad505208 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:08.490652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-d0a89043-801e-4621-a12b-bffdad505208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:08.502899 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a89043-801e-4621-a12b-bffdad505208 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:08.508199 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61780b3c-79bc-4677-9246-04d0a4acac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:08.509130 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61780b3c-79bc-4677-9246-04d0a4acac73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:08.509418 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61780b3c-79bc-4677-9246-04d0a4acac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:08.509703 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61780b3c-79bc-4677-9246-04d0a4acac73 admin admin] PATH_INFO: `/v3/projects/27945db055034db08a786a3fd5f44209` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:08.510966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61780b3c-79bc-4677-9246-04d0a4acac73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27945db055034db08a786a3fd5f44209)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:08.512896 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61780b3c-79bc-4677-9246-04d0a4acac73 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:08.562007 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-61780b3c-79bc-4677-9246-04d0a4acac73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27945db055034db08a786a3fd5f44209', 'request_id': 'req-61780b3c-79bc-4677-9246-04d0a4acac73'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:08.567495 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-61780b3c-79bc-4677-9246-04d0a4acac73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27945db055034db08a786a3fd5f44209', 'request_id': 'req-61780b3c-79bc-4677-9246-04d0a4acac73'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:08.575644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-61780b3c-79bc-4677-9246-04d0a4acac73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27945db055034db08a786a3fd5f44209', 'request_id': 'req-61780b3c-79bc-4677-9246-04d0a4acac73'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:08.587729 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-61780b3c-79bc-4677-9246-04d0a4acac73 admin admin] The token cache is being invalidate because project 27945db055034db08a786a3fd5f44209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:27:08.588031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-61780b3c-79bc-4677-9246-04d0a4acac73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:08.588652 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-61780b3c-79bc-4677-9246-04d0a4acac73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:08.590201 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1411/2815] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:27:08 2022] DELETE /identity/v3/projects/27945db055034db08a786a3fd5f44209 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:08.595045 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c1718-648d-440d-b90e-7902b763d5a9 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:08.595544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c1718-648d-440d-b90e-7902b763d5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:08.595661 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c1718-648d-440d-b90e-7902b763d5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:08.612914 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-143c1718-648d-440d-b90e-7902b763d5a9 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:08.614117 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-143c1718-648d-440d-b90e-7902b763d5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:08.676461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1405/2816] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:08.685254 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f33df-9aa4-47cc-be09-6277a95e5840 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:08.685556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f33df-9aa4-47cc-be09-6277a95e5840 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:08.685846 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f33df-9aa4-47cc-be09-6277a95e5840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:08.705993 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-505f33df-9aa4-47cc-be09-6277a95e5840 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:08.707249 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-505f33df-9aa4-47cc-be09-6277a95e5840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:08.716388 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1412/2817] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:08.720594 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c1718-648d-440d-b90e-7902b763d5a9 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:08.730673 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c1718-648d-440d-b90e-7902b763d5a9 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:08.735554 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc932-993e-4894-9e07-130fc4600615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:08.736153 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc932-993e-4894-9e07-130fc4600615 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:08.736437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc932-993e-4894-9e07-130fc4600615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:08.736718 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc932-993e-4894-9e07-130fc4600615 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:08.737443 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cc932-993e-4894-9e07-130fc4600615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:27:08.737748 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cc932-993e-4894-9e07-130fc4600615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:08.739406 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cc932-993e-4894-9e07-130fc4600615 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:08.751072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1406/2818] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:27:08.755218 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f33df-9aa4-47cc-be09-6277a95e5840 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:08.765343 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f33df-9aa4-47cc-be09-6277a95e5840 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:08.770050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc605e78-e3cd-4243-8526-b12741387f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:08.770807 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc605e78-e3cd-4243-8526-b12741387f5a admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:08.771092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc605e78-e3cd-4243-8526-b12741387f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:08.771368 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc605e78-e3cd-4243-8526-b12741387f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:08.772049 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc605e78-e3cd-4243-8526-b12741387f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:08.774662 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc605e78-e3cd-4243-8526-b12741387f5a admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:08.800057 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1413/2819] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:27:08 2022] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:27:08.804998 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc932-993e-4894-9e07-130fc4600615 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:08.815047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc932-993e-4894-9e07-130fc4600615 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:08.837292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:08.875987 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25250042-31e2-4756-83ea-2e4f207a62a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:08.876660 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25250042-31e2-4756-83ea-2e4f207a62a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:08.876947 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25250042-31e2-4756-83ea-2e4f207a62a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:08.877248 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25250042-31e2-4756-83ea-2e4f207a62a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:08.877957 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25250042-31e2-4756-83ea-2e4f207a62a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:08.880003 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25250042-31e2-4756-83ea-2e4f207a62a2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:08.900085 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1407/2820] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:27:08 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:27:08.904371 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc605e78-e3cd-4243-8526-b12741387f5a admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:08.914761 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc605e78-e3cd-4243-8526-b12741387f5a admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:08.919429 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82845cf6-6b41-4e74-9fbe-b4380d1bbc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:08.920079 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82845cf6-6b41-4e74-9fbe-b4380d1bbc77 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:08.920372 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82845cf6-6b41-4e74-9fbe-b4380d1bbc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:08.920654 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82845cf6-6b41-4e74-9fbe-b4380d1bbc77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:08.921377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82845cf6-6b41-4e74-9fbe-b4380d1bbc77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:08.923020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82845cf6-6b41-4e74-9fbe-b4380d1bbc77 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:08.924299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:08.935822 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1414/2821] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:08.939928 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25250042-31e2-4756-83ea-2e4f207a62a2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:08.951365 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25250042-31e2-4756-83ea-2e4f207a62a2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:08.955987 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c3687-4989-4ed2-b519-25eb74005d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:08.956651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c3687-4989-4ed2-b519-25eb74005d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:08.956943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c3687-4989-4ed2-b519-25eb74005d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:08.957222 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c3687-4989-4ed2-b519-25eb74005d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:08.957947 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c3687-4989-4ed2-b519-25eb74005d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:08.959590 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c3687-4989-4ed2-b519-25eb74005d6f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:08.970021 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1408/2822] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:08.974216 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82845cf6-6b41-4e74-9fbe-b4380d1bbc77 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:08.984776 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82845cf6-6b41-4e74-9fbe-b4380d1bbc77 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:08.989356 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da6fec-9cea-4f0c-bf1f-c25d1c4c8eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:08.990187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da6fec-9cea-4f0c-bf1f-c25d1c4c8eec admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:08.990509 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da6fec-9cea-4f0c-bf1f-c25d1c4c8eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:08.990796 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da6fec-9cea-4f0c-bf1f-c25d1c4c8eec admin admin] PATH_INFO: `/v3/projects/77127d4333a34d7e9ea1dcae5bf18d8d/users/355efa29ad3e413bae9b57a95affb945/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:09.006252 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da6fec-9cea-4f0c-bf1f-c25d1c4c8eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=77127d4333a34d7e9ea1dcae5bf18d8d, user_id=355efa29ad3e413bae9b57a95affb945, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:09.009855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da6fec-9cea-4f0c-bf1f-c25d1c4c8eec admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:09.023209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1415/2823] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:27:08 2022] PUT /identity/v3/projects/77127d4333a34d7e9ea1dcae5bf18d8d/users/355efa29ad3e413bae9b57a95affb945/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:09.034244 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f80a1-cbbb-4fe3-ad5f-51f01754aa23 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:09.034574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f80a1-cbbb-4fe3-ad5f-51f01754aa23 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:09.034859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f80a1-cbbb-4fe3-ad5f-51f01754aa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:09.061870 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-5a2f80a1-cbbb-4fe3-ad5f-51f01754aa23 None None] MFA Rules not processed for user `355efa29ad3e413bae9b57a95affb945`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:09.063127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-5a2f80a1-cbbb-4fe3-ad5f-51f01754aa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:09.126787 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1409/2824] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:09.131437 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da6fec-9cea-4f0c-bf1f-c25d1c4c8eec admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:09.194452 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da6fec-9cea-4f0c-bf1f-c25d1c4c8eec admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:09.199821 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39dc83-fe2a-487c-987f-2e84b57bb616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:09.200485 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39dc83-fe2a-487c-987f-2e84b57bb616 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:09.200773 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39dc83-fe2a-487c-987f-2e84b57bb616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:09.201059 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39dc83-fe2a-487c-987f-2e84b57bb616 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:09.201741 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39dc83-fe2a-487c-987f-2e84b57bb616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:09.203689 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39dc83-fe2a-487c-987f-2e84b57bb616 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:09.229091 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1416/2825] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:27:09 2022] POST /identity/v3/projects => generated 405 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:27:09.232971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f80a1-cbbb-4fe3-ad5f-51f01754aa23 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:09.244444 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f80a1-cbbb-4fe3-ad5f-51f01754aa23 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:09.302370 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5614902-a813-4d46-8336-dded7e9b1a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:09.303076 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5614902-a813-4d46-8336-dded7e9b1a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:09.303363 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5614902-a813-4d46-8336-dded7e9b1a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:09.303646 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5614902-a813-4d46-8336-dded7e9b1a27 admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:09.305468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5614902-a813-4d46-8336-dded7e9b1a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:09.307423 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5614902-a813-4d46-8336-dded7e9b1a27 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:09.328912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1410/2826] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:27:09 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:27:09.332998 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39dc83-fe2a-487c-987f-2e84b57bb616 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:09.344065 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39dc83-fe2a-487c-987f-2e84b57bb616 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:09.349348 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13924a-f9c8-49d9-9143-eb085ae9ad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:09.350034 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13924a-f9c8-49d9-9143-eb085ae9ad4d admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:09.350323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13924a-f9c8-49d9-9143-eb085ae9ad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:09.350644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13924a-f9c8-49d9-9143-eb085ae9ad4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:09.351387 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13924a-f9c8-49d9-9143-eb085ae9ad4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:09.353072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13924a-f9c8-49d9-9143-eb085ae9ad4d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:09.364133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1417/2827] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:09.368890 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5614902-a813-4d46-8336-dded7e9b1a27 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:09.380923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5614902-a813-4d46-8336-dded7e9b1a27 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:09.386969 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0786fc4-8cee-4951-89a0-9b10838f3fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:09.387857 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0786fc4-8cee-4951-89a0-9b10838f3fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:09.388146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0786fc4-8cee-4951-89a0-9b10838f3fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:09.388429 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0786fc4-8cee-4951-89a0-9b10838f3fd2 admin admin] PATH_INFO: `/v3/projects/3264ec3b9d0a4ef082ef23c9ad05e32d/users/8bdfc20b58de4dd8bd2f48e947b0c894/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:09.404245 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0786fc4-8cee-4951-89a0-9b10838f3fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3264ec3b9d0a4ef082ef23c9ad05e32d, user_id=8bdfc20b58de4dd8bd2f48e947b0c894, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:09.407016 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0786fc4-8cee-4951-89a0-9b10838f3fd2 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:09.416237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:09.423175 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1411/2828] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:27:09 2022] PUT /identity/v3/projects/3264ec3b9d0a4ef082ef23c9ad05e32d/users/8bdfc20b58de4dd8bd2f48e947b0c894/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:27:09.427249 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13924a-f9c8-49d9-9143-eb085ae9ad4d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:09.438015 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13924a-f9c8-49d9-9143-eb085ae9ad4d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:09.495306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea09aa-eb79-4e3a-86f8-cdf2260630a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:09.495899 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea09aa-eb79-4e3a-86f8-cdf2260630a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:09.496187 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea09aa-eb79-4e3a-86f8-cdf2260630a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:09.496492 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea09aa-eb79-4e3a-86f8-cdf2260630a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:09.497219 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea09aa-eb79-4e3a-86f8-cdf2260630a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:09.498873 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea09aa-eb79-4e3a-86f8-cdf2260630a8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:09.510165 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1418/2829] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:09.514303 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0786fc4-8cee-4951-89a0-9b10838f3fd2 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:09.525177 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0786fc4-8cee-4951-89a0-9b10838f3fd2 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:09.529782 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c48ff-58a0-4b72-b9bc-6d39e461e041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:09.530687 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c48ff-58a0-4b72-b9bc-6d39e461e041 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:09.530975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c48ff-58a0-4b72-b9bc-6d39e461e041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:09.531250 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c48ff-58a0-4b72-b9bc-6d39e461e041 admin admin] PATH_INFO: `/v3/projects/3264ec3b9d0a4ef082ef23c9ad05e32d/users/8bdfc20b58de4dd8bd2f48e947b0c894/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:09.533462 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c48ff-58a0-4b72-b9bc-6d39e461e041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3264ec3b9d0a4ef082ef23c9ad05e32d, user_id=8bdfc20b58de4dd8bd2f48e947b0c894, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:09.536163 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c48ff-58a0-4b72-b9bc-6d39e461e041 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:09.546644 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1412/2830] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:27:09 2022] PUT /identity/v3/projects/3264ec3b9d0a4ef082ef23c9ad05e32d/users/8bdfc20b58de4dd8bd2f48e947b0c894/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:09.556583 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752beee1-5ef8-4553-80d0-880ebfa80d59 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:09.556880 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752beee1-5ef8-4553-80d0-880ebfa80d59 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:09.557164 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752beee1-5ef8-4553-80d0-880ebfa80d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:09.585103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-752beee1-5ef8-4553-80d0-880ebfa80d59 None None] MFA Rules not processed for user `8bdfc20b58de4dd8bd2f48e947b0c894`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:09.587014 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-752beee1-5ef8-4553-80d0-880ebfa80d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:09.617130 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:09.656592 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1419/2831] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:09 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:09.668684 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c48ff-58a0-4b72-b9bc-6d39e461e041 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:09.670383 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-cd7c48ff-58a0-4b72-b9bc-6d39e461e041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:09.733793 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c48ff-58a0-4b72-b9bc-6d39e461e041 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:09.737456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81f98e-d7f5-4232-8014-461f9c0cae7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:09.738107 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81f98e-d7f5-4232-8014-461f9c0cae7a service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:09.738393 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81f98e-d7f5-4232-8014-461f9c0cae7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:09.738706 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81f98e-d7f5-4232-8014-461f9c0cae7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:09.747975 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81f98e-d7f5-4232-8014-461f9c0cae7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:09.749350 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81f98e-d7f5-4232-8014-461f9c0cae7a service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:09.759530 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1413/2832] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:27:09 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:27:09.902667 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752beee1-5ef8-4553-80d0-880ebfa80d59 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:09.967966 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752beee1-5ef8-4553-80d0-880ebfa80d59 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:09.972444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff473d5c-cb09-4c88-aea6-9cb3a7d136e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:09.973318 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473d5c-cb09-4c88-aea6-9cb3a7d136e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:09.973599 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473d5c-cb09-4c88-aea6-9cb3a7d136e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:09.973877 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473d5c-cb09-4c88-aea6-9cb3a7d136e5 admin admin] PATH_INFO: `/v3/users/355efa29ad3e413bae9b57a95affb945` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:09.975053 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff473d5c-cb09-4c88-aea6-9cb3a7d136e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=355efa29ad3e413bae9b57a95affb945)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:09.977605 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff473d5c-cb09-4c88-aea6-9cb3a7d136e5 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:10.023556 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ff473d5c-cb09-4c88-aea6-9cb3a7d136e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '355efa29ad3e413bae9b57a95affb945'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:10.056253 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ff473d5c-cb09-4c88-aea6-9cb3a7d136e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '355efa29ad3e413bae9b57a95affb945'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:10.057017 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ff473d5c-cb09-4c88-aea6-9cb3a7d136e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '355efa29ad3e413bae9b57a95affb945'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:10.057675 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ff473d5c-cb09-4c88-aea6-9cb3a7d136e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '355efa29ad3e413bae9b57a95affb945'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:10.068524 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ff473d5c-cb09-4c88-aea6-9cb3a7d136e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '355efa29ad3e413bae9b57a95affb945'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:10.083825 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1420/2833] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:27:09 2022] DELETE /identity/v3/users/355efa29ad3e413bae9b57a95affb945 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:10.089058 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b955a-20ba-4fc4-83d8-a9b78afcc862 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:10.089350 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b955a-20ba-4fc4-83d8-a9b78afcc862 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:10.089631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b955a-20ba-4fc4-83d8-a9b78afcc862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:10.108135 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-313b955a-20ba-4fc4-83d8-a9b78afcc862 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:10.109339 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-313b955a-20ba-4fc4-83d8-a9b78afcc862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:10.171450 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1414/2834] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:10.181306 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff473d5c-cb09-4c88-aea6-9cb3a7d136e5 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:10.182798 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ff473d5c-cb09-4c88-aea6-9cb3a7d136e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:10.235211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:10.241395 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff473d5c-cb09-4c88-aea6-9cb3a7d136e5 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:10.245797 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ae2b0-7961-4971-af18-f1111b581d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:10.246471 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ae2b0-7961-4971-af18-f1111b581d92 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:10.246756 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ae2b0-7961-4971-af18-f1111b581d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:10.247147 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ae2b0-7961-4971-af18-f1111b581d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:10.256229 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ae2b0-7961-4971-af18-f1111b581d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:10.258382 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ae2b0-7961-4971-af18-f1111b581d92 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:10.267840 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1421/2835] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:27:10.561104 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b955a-20ba-4fc4-83d8-a9b78afcc862 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:10.562765 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-313b955a-20ba-4fc4-83d8-a9b78afcc862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:10.575578 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b955a-20ba-4fc4-83d8-a9b78afcc862 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:10.581031 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dc7bc-7c6e-4022-8b4b-57293b46a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:10.582047 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dc7bc-7c6e-4022-8b4b-57293b46a606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:10.582456 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dc7bc-7c6e-4022-8b4b-57293b46a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:10.582809 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dc7bc-7c6e-4022-8b4b-57293b46a606 admin admin] PATH_INFO: `/v3/projects/77127d4333a34d7e9ea1dcae5bf18d8d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:10.584072 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dc7bc-7c6e-4022-8b4b-57293b46a606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77127d4333a34d7e9ea1dcae5bf18d8d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:10.587204 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dc7bc-7c6e-4022-8b4b-57293b46a606 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:10.635127 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-974dc7bc-7c6e-4022-8b4b-57293b46a606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77127d4333a34d7e9ea1dcae5bf18d8d', 'request_id': 'req-974dc7bc-7c6e-4022-8b4b-57293b46a606'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:10.640569 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-974dc7bc-7c6e-4022-8b4b-57293b46a606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77127d4333a34d7e9ea1dcae5bf18d8d', 'request_id': 'req-974dc7bc-7c6e-4022-8b4b-57293b46a606'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:10.649209 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-974dc7bc-7c6e-4022-8b4b-57293b46a606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77127d4333a34d7e9ea1dcae5bf18d8d', 'request_id': 'req-974dc7bc-7c6e-4022-8b4b-57293b46a606'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:10.661720 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-974dc7bc-7c6e-4022-8b4b-57293b46a606 admin admin] The token cache is being invalidate because project 77127d4333a34d7e9ea1dcae5bf18d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:27:10.662013 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-974dc7bc-7c6e-4022-8b4b-57293b46a606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:10.662697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-974dc7bc-7c6e-4022-8b4b-57293b46a606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:10.665553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1415/2836] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:27:10 2022] DELETE /identity/v3/projects/77127d4333a34d7e9ea1dcae5bf18d8d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:10.669537 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ae2b0-7961-4971-af18-f1111b581d92 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:10.679211 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ae2b0-7961-4971-af18-f1111b581d92 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:10.736298 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112825c5-7c41-46af-9cd3-923f434ea892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:10.737182 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112825c5-7c41-46af-9cd3-923f434ea892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:10.737466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112825c5-7c41-46af-9cd3-923f434ea892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:10.737747 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112825c5-7c41-46af-9cd3-923f434ea892 admin admin] PATH_INFO: `/v3/users/8bdfc20b58de4dd8bd2f48e947b0c894` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:10.738964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112825c5-7c41-46af-9cd3-923f434ea892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bdfc20b58de4dd8bd2f48e947b0c894)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:10.740889 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112825c5-7c41-46af-9cd3-923f434ea892 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:10.789694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-112825c5-7c41-46af-9cd3-923f434ea892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bdfc20b58de4dd8bd2f48e947b0c894'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:10.801460 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-112825c5-7c41-46af-9cd3-923f434ea892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bdfc20b58de4dd8bd2f48e947b0c894'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:10.802112 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-112825c5-7c41-46af-9cd3-923f434ea892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bdfc20b58de4dd8bd2f48e947b0c894'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:10.802736 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-112825c5-7c41-46af-9cd3-923f434ea892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bdfc20b58de4dd8bd2f48e947b0c894'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:10.810726 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-112825c5-7c41-46af-9cd3-923f434ea892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bdfc20b58de4dd8bd2f48e947b0c894'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:10.823827 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1422/2837] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:27:10 2022] DELETE /identity/v3/users/8bdfc20b58de4dd8bd2f48e947b0c894 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:11.105314 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dc7bc-7c6e-4022-8b4b-57293b46a606 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:11.106896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-974dc7bc-7c6e-4022-8b4b-57293b46a606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:11.121221 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dc7bc-7c6e-4022-8b4b-57293b46a606 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:11.130220 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:11.183676 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71f662-c31c-4cbe-a0e3-8c78d99960e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:11.184540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71f662-c31c-4cbe-a0e3-8c78d99960e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:11.184830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71f662-c31c-4cbe-a0e3-8c78d99960e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:11.185106 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71f662-c31c-4cbe-a0e3-8c78d99960e4 admin admin] PATH_INFO: `/v3/projects/3264ec3b9d0a4ef082ef23c9ad05e32d` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:11.186284 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71f662-c31c-4cbe-a0e3-8c78d99960e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3264ec3b9d0a4ef082ef23c9ad05e32d)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:11.188225 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71f662-c31c-4cbe-a0e3-8c78d99960e4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:11.234092 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a71f662-c31c-4cbe-a0e3-8c78d99960e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3264ec3b9d0a4ef082ef23c9ad05e32d', 'request_id': 'req-0a71f662-c31c-4cbe-a0e3-8c78d99960e4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:11.239562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a71f662-c31c-4cbe-a0e3-8c78d99960e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3264ec3b9d0a4ef082ef23c9ad05e32d', 'request_id': 'req-0a71f662-c31c-4cbe-a0e3-8c78d99960e4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:11.247746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a71f662-c31c-4cbe-a0e3-8c78d99960e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3264ec3b9d0a4ef082ef23c9ad05e32d', 'request_id': 'req-0a71f662-c31c-4cbe-a0e3-8c78d99960e4'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:11.259525 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a71f662-c31c-4cbe-a0e3-8c78d99960e4 admin admin] The token cache is being invalidate because project 3264ec3b9d0a4ef082ef23c9ad05e32d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:27:11.259813 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a71f662-c31c-4cbe-a0e3-8c78d99960e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:11.260477 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-0a71f662-c31c-4cbe-a0e3-8c78d99960e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:11.262095 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1416/2838] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:27:11 2022] DELETE /identity/v3/projects/3264ec3b9d0a4ef082ef23c9ad05e32d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 16:27:11.267001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11a5bb-b7b1-437b-8d09-c41d186b26ed None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:11.267502 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11a5bb-b7b1-437b-8d09-c41d186b26ed None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:11.267673 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11a5bb-b7b1-437b-8d09-c41d186b26ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:11.286535 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-ee11a5bb-b7b1-437b-8d09-c41d186b26ed None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:11.287792 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ee11a5bb-b7b1-437b-8d09-c41d186b26ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:11.348598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1423/2839] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:11.357746 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb83cf-8965-48db-95fa-374140d98700 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:11.358132 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb83cf-8965-48db-95fa-374140d98700 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:11.359078 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb83cf-8965-48db-95fa-374140d98700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:11.382101 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3ffb83cf-8965-48db-95fa-374140d98700 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:11.383944 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3ffb83cf-8965-48db-95fa-374140d98700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:11.392011 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1417/2840] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:11.396223 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11a5bb-b7b1-437b-8d09-c41d186b26ed None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:11.406350 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11a5bb-b7b1-437b-8d09-c41d186b26ed None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:11.411264 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c7fb2-8804-4fc7-8d78-2b2135e0ff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:11.411927 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c7fb2-8804-4fc7-8d78-2b2135e0ff63 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:11.412214 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c7fb2-8804-4fc7-8d78-2b2135e0ff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:11.412497 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c7fb2-8804-4fc7-8d78-2b2135e0ff63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:11.413223 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c7fb2-8804-4fc7-8d78-2b2135e0ff63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:27:11.413561 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c7fb2-8804-4fc7-8d78-2b2135e0ff63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:11.415362 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c7fb2-8804-4fc7-8d78-2b2135e0ff63 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:11.417830 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:11.429926 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1424/2841] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:27:11.433701 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb83cf-8965-48db-95fa-374140d98700 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:11.443049 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb83cf-8965-48db-95fa-374140d98700 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:11.448405 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e24875-8899-4bac-bdad-887e79a7325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:11.449052 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e24875-8899-4bac-bdad-887e79a7325d admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:11.449336 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e24875-8899-4bac-bdad-887e79a7325d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:11.449613 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e24875-8899-4bac-bdad-887e79a7325d admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:11.450336 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e24875-8899-4bac-bdad-887e79a7325d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:11.452263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e24875-8899-4bac-bdad-887e79a7325d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:11.488927 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1418/2842] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:27:11 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:27:11.493714 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c7fb2-8804-4fc7-8d78-2b2135e0ff63 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:11.503976 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c7fb2-8804-4fc7-8d78-2b2135e0ff63 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:11.561268 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecdcb4-466f-4be3-b538-7e46c4a84774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:11.561969 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecdcb4-466f-4be3-b538-7e46c4a84774 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:11.562260 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecdcb4-466f-4be3-b538-7e46c4a84774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:11.562580 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecdcb4-466f-4be3-b538-7e46c4a84774 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:11.563280 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecdcb4-466f-4be3-b538-7e46c4a84774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:11.565192 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecdcb4-466f-4be3-b538-7e46c4a84774 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:11.584990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1425/2843] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:27:11 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:27:11.589689 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e24875-8899-4bac-bdad-887e79a7325d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:11.599970 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e24875-8899-4bac-bdad-887e79a7325d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:11.605343 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98dc72-8922-413e-87cc-0dd6be57b0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:11.606016 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98dc72-8922-413e-87cc-0dd6be57b0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:11.606302 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98dc72-8922-413e-87cc-0dd6be57b0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:11.606611 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98dc72-8922-413e-87cc-0dd6be57b0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:11.607343 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98dc72-8922-413e-87cc-0dd6be57b0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:11.608945 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98dc72-8922-413e-87cc-0dd6be57b0a4 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:11.620264 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1419/2844] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:11.624299 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecdcb4-466f-4be3-b538-7e46c4a84774 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:11.634658 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecdcb4-466f-4be3-b538-7e46c4a84774 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:11.639313 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee77fb7-4020-4cf0-92eb-2c3fd4703101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:11.639982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee77fb7-4020-4cf0-92eb-2c3fd4703101 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:11.640269 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee77fb7-4020-4cf0-92eb-2c3fd4703101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:11.640550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee77fb7-4020-4cf0-92eb-2c3fd4703101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:11.641272 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee77fb7-4020-4cf0-92eb-2c3fd4703101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:11.642922 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee77fb7-4020-4cf0-92eb-2c3fd4703101 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:11.653326 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1426/2845] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:11.657408 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98dc72-8922-413e-87cc-0dd6be57b0a4 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:11.668425 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98dc72-8922-413e-87cc-0dd6be57b0a4 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:11.673551 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ae31f-7334-42f1-860c-c4b52907bf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:11.674443 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ae31f-7334-42f1-860c-c4b52907bf74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:11.674737 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ae31f-7334-42f1-860c-c4b52907bf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:11.675015 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ae31f-7334-42f1-860c-c4b52907bf74 admin admin] PATH_INFO: `/v3/projects/76b99a579d4049328a23599090aca948/users/76a9e11d91d64df8990d6cba592d69c2/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:11.690752 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ae31f-7334-42f1-860c-c4b52907bf74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b99a579d4049328a23599090aca948, user_id=76a9e11d91d64df8990d6cba592d69c2, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:11.693483 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ae31f-7334-42f1-860c-c4b52907bf74 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:11.707645 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1420/2846] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:27:11 2022] PUT /identity/v3/projects/76b99a579d4049328a23599090aca948/users/76a9e11d91d64df8990d6cba592d69c2/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:11.718204 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f57a68-cd61-4eb1-a732-d12318253c15 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:11.718517 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f57a68-cd61-4eb1-a732-d12318253c15 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:11.718811 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f57a68-cd61-4eb1-a732-d12318253c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:11.746891 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-91f57a68-cd61-4eb1-a732-d12318253c15 None None] MFA Rules not processed for user `76a9e11d91d64df8990d6cba592d69c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:11.748105 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-91f57a68-cd61-4eb1-a732-d12318253c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:11.815290 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1427/2847] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:11.819859 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ae31f-7334-42f1-860c-c4b52907bf74 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:11.861340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:11.884549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ae31f-7334-42f1-860c-c4b52907bf74 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:11.889431 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386dea6-28e3-43ce-b36b-636a1e50ff1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:11.890124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386dea6-28e3-43ce-b36b-636a1e50ff1c admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:11.890405 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386dea6-28e3-43ce-b36b-636a1e50ff1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:11.890706 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386dea6-28e3-43ce-b36b-636a1e50ff1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:11.891385 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386dea6-28e3-43ce-b36b-636a1e50ff1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:11.893277 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386dea6-28e3-43ce-b36b-636a1e50ff1c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:11.919191 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1421/2848] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:27:11 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:27:11.923317 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f57a68-cd61-4eb1-a732-d12318253c15 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:11.934181 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f57a68-cd61-4eb1-a732-d12318253c15 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:11.996468 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022b757-08d8-4d6f-bbea-0e93cc9e02d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:11.997145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022b757-08d8-4d6f-bbea-0e93cc9e02d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:11.997428 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022b757-08d8-4d6f-bbea-0e93cc9e02d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:11.997706 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022b757-08d8-4d6f-bbea-0e93cc9e02d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:11.998381 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022b757-08d8-4d6f-bbea-0e93cc9e02d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:12.000339 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022b757-08d8-4d6f-bbea-0e93cc9e02d8 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:12.009584 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:12.021912 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1428/2849] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:27:11 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:27:12.026652 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386dea6-28e3-43ce-b36b-636a1e50ff1c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:12.037152 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386dea6-28e3-43ce-b36b-636a1e50ff1c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:12.042923 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c893d4-2930-4844-91f6-251e3e2fde7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:12.043591 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c893d4-2930-4844-91f6-251e3e2fde7c admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:12.043876 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c893d4-2930-4844-91f6-251e3e2fde7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:12.044151 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c893d4-2930-4844-91f6-251e3e2fde7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:12.044876 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c893d4-2930-4844-91f6-251e3e2fde7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:12.046491 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c893d4-2930-4844-91f6-251e3e2fde7c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:12.057281 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1422/2850] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:12.061424 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022b757-08d8-4d6f-bbea-0e93cc9e02d8 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:12.071932 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022b757-08d8-4d6f-bbea-0e93cc9e02d8 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:12.076641 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35b796-729d-4f0f-b453-a6ac8564c0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:12.077568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35b796-729d-4f0f-b453-a6ac8564c0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:12.077856 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35b796-729d-4f0f-b453-a6ac8564c0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:12.078137 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35b796-729d-4f0f-b453-a6ac8564c0ee admin admin] PATH_INFO: `/v3/projects/cea6b589aced487bad743a23e94532fb/users/63086e2ed3f64fcca83f4b1e8a88a3fa/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:12.093649 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35b796-729d-4f0f-b453-a6ac8564c0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea6b589aced487bad743a23e94532fb, user_id=63086e2ed3f64fcca83f4b1e8a88a3fa, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:12.096390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35b796-729d-4f0f-b453-a6ac8564c0ee admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:12.109656 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1429/2851] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:27:12 2022] PUT /identity/v3/projects/cea6b589aced487bad743a23e94532fb/users/63086e2ed3f64fcca83f4b1e8a88a3fa/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:12.113697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c893d4-2930-4844-91f6-251e3e2fde7c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:12.124651 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c893d4-2930-4844-91f6-251e3e2fde7c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:12.182950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e76e27-277b-44fc-8851-0b22949f89c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:12.183617 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e76e27-277b-44fc-8851-0b22949f89c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:12.183896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e76e27-277b-44fc-8851-0b22949f89c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:12.184168 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e76e27-277b-44fc-8851-0b22949f89c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:12.184889 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e76e27-277b-44fc-8851-0b22949f89c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:12.186574 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e76e27-277b-44fc-8851-0b22949f89c7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:12.196397 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1423/2852] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:12.200528 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35b796-729d-4f0f-b453-a6ac8564c0ee admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:12.211526 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35b796-729d-4f0f-b453-a6ac8564c0ee admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:12.216178 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fa20d-2a6e-4592-bf40-7f79aa177223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:12.217067 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fa20d-2a6e-4592-bf40-7f79aa177223 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:12.217354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fa20d-2a6e-4592-bf40-7f79aa177223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:12.217775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fa20d-2a6e-4592-bf40-7f79aa177223 admin admin] PATH_INFO: `/v3/projects/cea6b589aced487bad743a23e94532fb/users/63086e2ed3f64fcca83f4b1e8a88a3fa/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:12.219771 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fa20d-2a6e-4592-bf40-7f79aa177223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea6b589aced487bad743a23e94532fb, user_id=63086e2ed3f64fcca83f4b1e8a88a3fa, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:12.222548 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fa20d-2a6e-4592-bf40-7f79aa177223 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:12.233512 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1430/2853] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:27:12 2022] PUT /identity/v3/projects/cea6b589aced487bad743a23e94532fb/users/63086e2ed3f64fcca83f4b1e8a88a3fa/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:12.245212 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c656dc1-99da-4350-9471-070e8c87de0d None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:12.245419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c656dc1-99da-4350-9471-070e8c87de0d None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:12.245686 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c656dc1-99da-4350-9471-070e8c87de0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:12.272558 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-1c656dc1-99da-4350-9471-070e8c87de0d None None] MFA Rules not processed for user `63086e2ed3f64fcca83f4b1e8a88a3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:12.274627 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1c656dc1-99da-4350-9471-070e8c87de0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:12.344353 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1424/2854] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:12 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:12.355589 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fa20d-2a6e-4592-bf40-7f79aa177223 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:12.357332 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-749fa20d-2a6e-4592-bf40-7f79aa177223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:12.415355 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fa20d-2a6e-4592-bf40-7f79aa177223 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:12.419001 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedec9f-cf94-4635-88bb-84146290751d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:12.419645 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedec9f-cf94-4635-88bb-84146290751d service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:12.419927 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedec9f-cf94-4635-88bb-84146290751d service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:12.420206 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedec9f-cf94-4635-88bb-84146290751d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:12.428991 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedec9f-cf94-4635-88bb-84146290751d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:12.430541 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedec9f-cf94-4635-88bb-84146290751d service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:12.440107 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1431/2855] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:27:12 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:27:12.482713 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c656dc1-99da-4350-9471-070e8c87de0d None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:12.484082 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1c656dc1-99da-4350-9471-070e8c87de0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:12.496031 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c656dc1-99da-4350-9471-070e8c87de0d None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:12.500023 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ea42c-32fd-48f3-a823-dfde0b8445ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:12.500662 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ea42c-32fd-48f3-a823-dfde0b8445ab service cinder] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:12.500942 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ea42c-32fd-48f3-a823-dfde0b8445ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:12.501216 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ea42c-32fd-48f3-a823-dfde0b8445ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:12.531943 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:12.559419 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ea42c-32fd-48f3-a823-dfde0b8445ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:12.560932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ea42c-32fd-48f3-a823-dfde0b8445ab service cinder] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:12.570279 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1425/2856] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:27:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:27:15.858182 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedec9f-cf94-4635-88bb-84146290751d service cinder] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:15.923212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedec9f-cf94-4635-88bb-84146290751d service cinder] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:15.927787 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acd65d-fa2b-4803-95f7-63e85781661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:15.928688 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acd65d-fa2b-4803-95f7-63e85781661d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:15.929582 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acd65d-fa2b-4803-95f7-63e85781661d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:15.930180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acd65d-fa2b-4803-95f7-63e85781661d admin admin] PATH_INFO: `/v3/users/76a9e11d91d64df8990d6cba592d69c2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:15.931092 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acd65d-fa2b-4803-95f7-63e85781661d admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a9e11d91d64df8990d6cba592d69c2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:15.933042 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acd65d-fa2b-4803-95f7-63e85781661d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:15.980296 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b0acd65d-fa2b-4803-95f7-63e85781661d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a9e11d91d64df8990d6cba592d69c2'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:15.990393 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:15.993832 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b0acd65d-fa2b-4803-95f7-63e85781661d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a9e11d91d64df8990d6cba592d69c2'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:15.995097 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b0acd65d-fa2b-4803-95f7-63e85781661d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a9e11d91d64df8990d6cba592d69c2'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:15.995735 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b0acd65d-fa2b-4803-95f7-63e85781661d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a9e11d91d64df8990d6cba592d69c2'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:16.003967 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-b0acd65d-fa2b-4803-95f7-63e85781661d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a9e11d91d64df8990d6cba592d69c2'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:16.018418 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1432/2857] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:27:15 2022] DELETE /identity/v3/users/76a9e11d91d64df8990d6cba592d69c2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:16.022985 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e245e-7b5c-4f4b-9f9c-977409a1600c None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:16.023468 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e245e-7b5c-4f4b-9f9c-977409a1600c None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:16.023598 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e245e-7b5c-4f4b-9f9c-977409a1600c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:16.040971 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-e24e245e-7b5c-4f4b-9f9c-977409a1600c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:16.042177 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e24e245e-7b5c-4f4b-9f9c-977409a1600c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:16.101576 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1426/2858] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:16.111254 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acd65d-fa2b-4803-95f7-63e85781661d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:16.112665 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-b0acd65d-fa2b-4803-95f7-63e85781661d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:16.173199 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acd65d-fa2b-4803-95f7-63e85781661d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:16.176942 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420adc6-6345-4dfe-85cd-c2f959835954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:16.177598 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420adc6-6345-4dfe-85cd-c2f959835954 service neutron] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:16.177888 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420adc6-6345-4dfe-85cd-c2f959835954 service neutron] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:16.178176 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420adc6-6345-4dfe-85cd-c2f959835954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:16.187960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420adc6-6345-4dfe-85cd-c2f959835954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:16.189389 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420adc6-6345-4dfe-85cd-c2f959835954 service neutron] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:16.199698 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1433/2859] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:27:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:27:16.468871 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e245e-7b5c-4f4b-9f9c-977409a1600c None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:16.470649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-e24e245e-7b5c-4f4b-9f9c-977409a1600c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:16.483697 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e245e-7b5c-4f4b-9f9c-977409a1600c None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:16.488340 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2367c-287d-4519-bfc3-3b8e003ef78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:16.489274 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2367c-287d-4519-bfc3-3b8e003ef78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:16.489649 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2367c-287d-4519-bfc3-3b8e003ef78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:16.489932 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2367c-287d-4519-bfc3-3b8e003ef78c admin admin] PATH_INFO: `/v3/projects/76b99a579d4049328a23599090aca948` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:16.491136 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2367c-287d-4519-bfc3-3b8e003ef78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b99a579d4049328a23599090aca948)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:16.493325 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2367c-287d-4519-bfc3-3b8e003ef78c admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:16.541567 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aae2367c-287d-4519-bfc3-3b8e003ef78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b99a579d4049328a23599090aca948', 'request_id': 'req-aae2367c-287d-4519-bfc3-3b8e003ef78c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:16.547057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aae2367c-287d-4519-bfc3-3b8e003ef78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b99a579d4049328a23599090aca948', 'request_id': 'req-aae2367c-287d-4519-bfc3-3b8e003ef78c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:16.554536 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aae2367c-287d-4519-bfc3-3b8e003ef78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b99a579d4049328a23599090aca948', 'request_id': 'req-aae2367c-287d-4519-bfc3-3b8e003ef78c'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:16.565743 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aae2367c-287d-4519-bfc3-3b8e003ef78c admin admin] The token cache is being invalidate because project 76b99a579d4049328a23599090aca948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:27:16.566034 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aae2367c-287d-4519-bfc3-3b8e003ef78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:16.566705 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-aae2367c-287d-4519-bfc3-3b8e003ef78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:16.568249 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1427/2860] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:27:16 2022] DELETE /identity/v3/projects/76b99a579d4049328a23599090aca948 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:16.572422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420adc6-6345-4dfe-85cd-c2f959835954 service neutron] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:16.582011 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420adc6-6345-4dfe-85cd-c2f959835954 service neutron] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:16.640882 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74d3ed-f46a-4beb-aa66-88fed7d32088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:16.641684 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74d3ed-f46a-4beb-aa66-88fed7d32088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:16.641971 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74d3ed-f46a-4beb-aa66-88fed7d32088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:16.642276 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74d3ed-f46a-4beb-aa66-88fed7d32088 admin admin] PATH_INFO: `/v3/users/63086e2ed3f64fcca83f4b1e8a88a3fa` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:16.643505 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74d3ed-f46a-4beb-aa66-88fed7d32088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63086e2ed3f64fcca83f4b1e8a88a3fa)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:16.645476 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74d3ed-f46a-4beb-aa66-88fed7d32088 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:16.693784 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7f74d3ed-f46a-4beb-aa66-88fed7d32088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63086e2ed3f64fcca83f4b1e8a88a3fa'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:16.705793 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7f74d3ed-f46a-4beb-aa66-88fed7d32088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63086e2ed3f64fcca83f4b1e8a88a3fa'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:16.706493 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7f74d3ed-f46a-4beb-aa66-88fed7d32088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63086e2ed3f64fcca83f4b1e8a88a3fa'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:16.707109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7f74d3ed-f46a-4beb-aa66-88fed7d32088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63086e2ed3f64fcca83f4b1e8a88a3fa'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:16.714866 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-7f74d3ed-f46a-4beb-aa66-88fed7d32088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63086e2ed3f64fcca83f4b1e8a88a3fa'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:16.724209 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:16.729421 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1434/2861] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:27:16 2022] DELETE /identity/v3/users/63086e2ed3f64fcca83f4b1e8a88a3fa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:16.999968 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2367c-287d-4519-bfc3-3b8e003ef78c admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:17.001575 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-aae2367c-287d-4519-bfc3-3b8e003ef78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:17.020422 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2367c-287d-4519-bfc3-3b8e003ef78c admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:17.073361 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:17.081146 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480eda9f-6c45-467b-af19-8d51cf1ef04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:17.082139 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480eda9f-6c45-467b-af19-8d51cf1ef04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:17.082635 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480eda9f-6c45-467b-af19-8d51cf1ef04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:17.082933 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480eda9f-6c45-467b-af19-8d51cf1ef04e admin admin] PATH_INFO: `/v3/projects/cea6b589aced487bad743a23e94532fb` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:17.084228 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480eda9f-6c45-467b-af19-8d51cf1ef04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea6b589aced487bad743a23e94532fb)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:17.086806 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480eda9f-6c45-467b-af19-8d51cf1ef04e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:17.133152 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-480eda9f-6c45-467b-af19-8d51cf1ef04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea6b589aced487bad743a23e94532fb', 'request_id': 'req-480eda9f-6c45-467b-af19-8d51cf1ef04e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:17.139158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-480eda9f-6c45-467b-af19-8d51cf1ef04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea6b589aced487bad743a23e94532fb', 'request_id': 'req-480eda9f-6c45-467b-af19-8d51cf1ef04e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:17.146799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-480eda9f-6c45-467b-af19-8d51cf1ef04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea6b589aced487bad743a23e94532fb', 'request_id': 'req-480eda9f-6c45-467b-af19-8d51cf1ef04e'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:17.160700 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-480eda9f-6c45-467b-af19-8d51cf1ef04e admin admin] The token cache is being invalidate because project cea6b589aced487bad743a23e94532fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80323) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:27:17.160989 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-480eda9f-6c45-467b-af19-8d51cf1ef04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:17.161663 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-480eda9f-6c45-467b-af19-8d51cf1ef04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:17.163527 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1428/2862] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:27:16 2022] DELETE /identity/v3/projects/cea6b589aced487bad743a23e94532fb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:17.170982 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53acf8d-5d19-4cce-9714-ac0c5f7fdf45 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:17.171509 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53acf8d-5d19-4cce-9714-ac0c5f7fdf45 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:17.171657 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53acf8d-5d19-4cce-9714-ac0c5f7fdf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:17.191297 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-a53acf8d-5d19-4cce-9714-ac0c5f7fdf45 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:17.192444 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-a53acf8d-5d19-4cce-9714-ac0c5f7fdf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:17.253323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1435/2863] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:17.261858 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f872b-6fc3-4f12-a06a-aca0c2545141 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:17.262174 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f872b-6fc3-4f12-a06a-aca0c2545141 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:17.262490 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f872b-6fc3-4f12-a06a-aca0c2545141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:17.281239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-a65f872b-6fc3-4f12-a06a-aca0c2545141 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:17.282474 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a65f872b-6fc3-4f12-a06a-aca0c2545141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:17.291396 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1429/2864] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:17.295721 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53acf8d-5d19-4cce-9714-ac0c5f7fdf45 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:17.306550 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53acf8d-5d19-4cce-9714-ac0c5f7fdf45 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:17.311154 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c31ab6-77f0-4260-ae1f-ae2eef146b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:17.311852 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c31ab6-77f0-4260-ae1f-ae2eef146b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:17.312139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c31ab6-77f0-4260-ae1f-ae2eef146b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:17.312422 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c31ab6-77f0-4260-ae1f-ae2eef146b48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:17.313177 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c31ab6-77f0-4260-ae1f-ae2eef146b48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80324) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:27:17.313488 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c31ab6-77f0-4260-ae1f-ae2eef146b48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:17.315133 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c31ab6-77f0-4260-ae1f-ae2eef146b48 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:17.327928 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1436/2865] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:27:17.332350 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f872b-6fc3-4f12-a06a-aca0c2545141 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:17.341830 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f872b-6fc3-4f12-a06a-aca0c2545141 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:17.347023 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43e9c9-d0c9-4eb5-9625-2cfa143a27ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:17.347725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e9c9-d0c9-4eb5-9625-2cfa143a27ce admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:17.348013 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e9c9-d0c9-4eb5-9625-2cfa143a27ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:17.348292 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e9c9-d0c9-4eb5-9625-2cfa143a27ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:17.349042 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43e9c9-d0c9-4eb5-9625-2cfa143a27ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:17.350992 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43e9c9-d0c9-4eb5-9625-2cfa143a27ce admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:17.377512 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1430/2866] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:27:17 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:27:17.381393 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c31ab6-77f0-4260-ae1f-ae2eef146b48 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:17.395629 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c31ab6-77f0-4260-ae1f-ae2eef146b48 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:17.454733 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ce794-a3b9-4d98-98cf-80d893a1646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:17.455357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ce794-a3b9-4d98-98cf-80d893a1646d admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:17.455647 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ce794-a3b9-4d98-98cf-80d893a1646d admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:17.455929 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ce794-a3b9-4d98-98cf-80d893a1646d admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:17.456626 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ce794-a3b9-4d98-98cf-80d893a1646d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:17.458774 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ce794-a3b9-4d98-98cf-80d893a1646d admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:17.478139 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1437/2867] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:27:17 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:27:17.482237 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43e9c9-d0c9-4eb5-9625-2cfa143a27ce admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:17.493377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43e9c9-d0c9-4eb5-9625-2cfa143a27ce admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:17.498057 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237632ea-251b-4e08-8ab5-6374c9919530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:17.498774 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237632ea-251b-4e08-8ab5-6374c9919530 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:17.499065 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237632ea-251b-4e08-8ab5-6374c9919530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:17.499376 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237632ea-251b-4e08-8ab5-6374c9919530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:17.500112 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237632ea-251b-4e08-8ab5-6374c9919530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:17.501712 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237632ea-251b-4e08-8ab5-6374c9919530 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:17.512293 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1431/2868] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:17.516354 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ce794-a3b9-4d98-98cf-80d893a1646d admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:17.526536 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ce794-a3b9-4d98-98cf-80d893a1646d admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:17.531158 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd59e7-adad-4e22-9ca5-a19673a2b85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:17.531820 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd59e7-adad-4e22-9ca5-a19673a2b85c admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:17.532108 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd59e7-adad-4e22-9ca5-a19673a2b85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:17.532392 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd59e7-adad-4e22-9ca5-a19673a2b85c admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:17.533122 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd59e7-adad-4e22-9ca5-a19673a2b85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:17.535020 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd59e7-adad-4e22-9ca5-a19673a2b85c admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:17.545640 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1438/2869] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:17.549670 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237632ea-251b-4e08-8ab5-6374c9919530 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:17.560874 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237632ea-251b-4e08-8ab5-6374c9919530 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:17.565912 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd0a96-d6d7-4747-93c1-6a09926ebc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:17.566832 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd0a96-d6d7-4747-93c1-6a09926ebc18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:17.567118 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd0a96-d6d7-4747-93c1-6a09926ebc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:17.567394 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd0a96-d6d7-4747-93c1-6a09926ebc18 admin admin] PATH_INFO: `/v3/projects/4c37c56fa62b47ce9a0e78f5541d0e8a/users/d043793d1d4040fd86f5e6f7dbb43ac0/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:17.582263 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd0a96-d6d7-4747-93c1-6a09926ebc18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c37c56fa62b47ce9a0e78f5541d0e8a, user_id=d043793d1d4040fd86f5e6f7dbb43ac0, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:17.584954 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd0a96-d6d7-4747-93c1-6a09926ebc18 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:17.599010 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1432/2870] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:27:17 2022] PUT /identity/v3/projects/4c37c56fa62b47ce9a0e78f5541d0e8a/users/d043793d1d4040fd86f5e6f7dbb43ac0/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:17.610035 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e165e60-2849-452d-964e-6286b2b603a3 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:17.610357 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e165e60-2849-452d-964e-6286b2b603a3 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:17.610690 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e165e60-2849-452d-964e-6286b2b603a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:17.637786 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-0e165e60-2849-452d-964e-6286b2b603a3 None None] MFA Rules not processed for user `d043793d1d4040fd86f5e6f7dbb43ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:17.639051 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-0e165e60-2849-452d-964e-6286b2b603a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:17.695607 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:17.709180 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1439/2871] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:17.711715 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd0a96-d6d7-4747-93c1-6a09926ebc18 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:17.783110 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd0a96-d6d7-4747-93c1-6a09926ebc18 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:17.788907 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640ff02-3f27-4cd1-a691-a5a06ca7b63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:17.789562 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640ff02-3f27-4cd1-a691-a5a06ca7b63e admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:17.789845 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640ff02-3f27-4cd1-a691-a5a06ca7b63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:17.790121 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640ff02-3f27-4cd1-a691-a5a06ca7b63e admin admin] PATH_INFO: `/v3/projects` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:17.790848 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640ff02-3f27-4cd1-a691-a5a06ca7b63e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:17.792749 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640ff02-3f27-4cd1-a691-a5a06ca7b63e admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:17.819286 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1433/2872] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:27:17 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:27:17.823390 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e165e60-2849-452d-964e-6286b2b603a3 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:17.834337 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e165e60-2849-452d-964e-6286b2b603a3 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:17.892291 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81da4f7-651a-4d5b-844d-5c4689c5ec05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:17.893002 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81da4f7-651a-4d5b-844d-5c4689c5ec05 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:17.893290 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81da4f7-651a-4d5b-844d-5c4689c5ec05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:17.893565 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81da4f7-651a-4d5b-844d-5c4689c5ec05 admin admin] PATH_INFO: `/v3/users` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:17.894288 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81da4f7-651a-4d5b-844d-5c4689c5ec05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:17.896228 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81da4f7-651a-4d5b-844d-5c4689c5ec05 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:17.916940 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1440/2873] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:27:17 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:27:17.921048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640ff02-3f27-4cd1-a691-a5a06ca7b63e admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:17.932434 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640ff02-3f27-4cd1-a691-a5a06ca7b63e admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:17.937219 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b9726-703f-4545-990c-392dfe5ad83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:17.937879 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b9726-703f-4545-990c-392dfe5ad83d admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:17.938164 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b9726-703f-4545-990c-392dfe5ad83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:17.938716 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b9726-703f-4545-990c-392dfe5ad83d admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:17.939359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b9726-703f-4545-990c-392dfe5ad83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:17.940950 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b9726-703f-4545-990c-392dfe5ad83d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:17.942223 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:17.953940 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1434/2874] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:17.958122 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81da4f7-651a-4d5b-844d-5c4689c5ec05 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:17.969107 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81da4f7-651a-4d5b-844d-5c4689c5ec05 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:17.974294 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12311d6-ca09-41ac-bc37-df0db3224c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:17.975215 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12311d6-ca09-41ac-bc37-df0db3224c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:17.975500 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12311d6-ca09-41ac-bc37-df0db3224c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:17.975775 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12311d6-ca09-41ac-bc37-df0db3224c88 admin admin] PATH_INFO: `/v3/projects/02a73da814f5467384c8bb36f4220b7a/users/29567ccf12be4b3e917aa1edc8b54e79/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:17.991046 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12311d6-ca09-41ac-bc37-df0db3224c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a73da814f5467384c8bb36f4220b7a, user_id=29567ccf12be4b3e917aa1edc8b54e79, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:17.993984 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12311d6-ca09-41ac-bc37-df0db3224c88 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:18.006958 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1441/2875] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:27:17 2022] PUT /identity/v3/projects/02a73da814f5467384c8bb36f4220b7a/users/29567ccf12be4b3e917aa1edc8b54e79/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:18.011159 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b9726-703f-4545-990c-392dfe5ad83d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:18.021944 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b9726-703f-4545-990c-392dfe5ad83d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:18.084316 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb18c7-7479-4ced-9073-f6906b4f035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:18.084979 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb18c7-7479-4ced-9073-f6906b4f035b admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:18.085824 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb18c7-7479-4ced-9073-f6906b4f035b admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:18.086359 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb18c7-7479-4ced-9073-f6906b4f035b admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:18.087131 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb18c7-7479-4ced-9073-f6906b4f035b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:18.088738 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb18c7-7479-4ced-9073-f6906b4f035b admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:18.098668 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1435/2876] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:18.103780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12311d6-ca09-41ac-bc37-df0db3224c88 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:18.114125 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12311d6-ca09-41ac-bc37-df0db3224c88 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:18.119309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12c993-e19e-4256-884f-a23d04ec74bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:18.120196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12c993-e19e-4256-884f-a23d04ec74bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:18.120486 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12c993-e19e-4256-884f-a23d04ec74bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:18.120771 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12c993-e19e-4256-884f-a23d04ec74bb admin admin] PATH_INFO: `/v3/projects/02a73da814f5467384c8bb36f4220b7a/users/29567ccf12be4b3e917aa1edc8b54e79/roles/f45a54997fdf4bb2a778ae7e16070ec2` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:18.122780 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12c993-e19e-4256-884f-a23d04ec74bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a73da814f5467384c8bb36f4220b7a, user_id=29567ccf12be4b3e917aa1edc8b54e79, role_id=f45a54997fdf4bb2a778ae7e16070ec2)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:18.125523 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12c993-e19e-4256-884f-a23d04ec74bb admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:18.136568 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1442/2877] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:27:18 2022] PUT /identity/v3/projects/02a73da814f5467384c8bb36f4220b7a/users/29567ccf12be4b3e917aa1edc8b54e79/roles/f45a54997fdf4bb2a778ae7e16070ec2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:18.203409 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437563-ebbb-441e-b642-bb94753e5f90 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:18.203695 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437563-ebbb-441e-b642-bb94753e5f90 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:18.203984 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437563-ebbb-441e-b642-bb94753e5f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:18.232854 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-66437563-ebbb-441e-b642-bb94753e5f90 None None] MFA Rules not processed for user `29567ccf12be4b3e917aa1edc8b54e79`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:18.234073 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-66437563-ebbb-441e-b642-bb94753e5f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:18.303156 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1436/2878] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:18.314964 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12c993-e19e-4256-884f-a23d04ec74bb admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:18.316691 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-cc12c993-e19e-4256-884f-a23d04ec74bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:18.375414 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12c993-e19e-4256-884f-a23d04ec74bb admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:18.379221 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698461c9-94a0-4be0-98e9-335ac9cb6224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e8905bab4c47f9a5fb374ef0377983', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:18.379874 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698461c9-94a0-4be0-98e9-335ac9cb6224 service cinder] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:18.380159 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698461c9-94a0-4be0-98e9-335ac9cb6224 service cinder] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:18.380434 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698461c9-94a0-4be0-98e9-335ac9cb6224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:18.390196 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698461c9-94a0-4be0-98e9-335ac9cb6224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:18.391660 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698461c9-94a0-4be0-98e9-335ac9cb6224 service cinder] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:18.402016 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1443/2879] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:27:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:27:18.571441 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66437563-ebbb-441e-b642-bb94753e5f90 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:18.633799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66437563-ebbb-441e-b642-bb94753e5f90 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:18.638271 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ad1d4-faf4-439c-87b0-f92b5cbd0a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:18.639203 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ad1d4-faf4-439c-87b0-f92b5cbd0a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:18.639484 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ad1d4-faf4-439c-87b0-f92b5cbd0a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:18.639758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ad1d4-faf4-439c-87b0-f92b5cbd0a34 admin admin] PATH_INFO: `/v3/users/d043793d1d4040fd86f5e6f7dbb43ac0` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:18.640929 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ad1d4-faf4-439c-87b0-f92b5cbd0a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d043793d1d4040fd86f5e6f7dbb43ac0)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:18.643048 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ad1d4-faf4-439c-87b0-f92b5cbd0a34 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:18.664819 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:18.690725 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8a3ad1d4-faf4-439c-87b0-f92b5cbd0a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd043793d1d4040fd86f5e6f7dbb43ac0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:18.691372 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8a3ad1d4-faf4-439c-87b0-f92b5cbd0a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd043793d1d4040fd86f5e6f7dbb43ac0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:18.703130 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8a3ad1d4-faf4-439c-87b0-f92b5cbd0a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd043793d1d4040fd86f5e6f7dbb43ac0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:18.703759 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8a3ad1d4-faf4-439c-87b0-f92b5cbd0a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd043793d1d4040fd86f5e6f7dbb43ac0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:18.711982 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-8a3ad1d4-faf4-439c-87b0-f92b5cbd0a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd043793d1d4040fd86f5e6f7dbb43ac0'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:18.725540 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1437/2880] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:27:18 2022] DELETE /identity/v3/users/d043793d1d4040fd86f5e6f7dbb43ac0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:18.731554 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2f4ed-2e79-4fdd-8adc-804199614a64 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:18.731851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2f4ed-2e79-4fdd-8adc-804199614a64 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:18.732138 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2f4ed-2e79-4fdd-8adc-804199614a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:18.750040 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-12c2f4ed-2e79-4fdd-8adc-804199614a64 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:18.751202 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-12c2f4ed-2e79-4fdd-8adc-804199614a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:18.798893 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:18.813993 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1444/2881] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:18.823892 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ad1d4-faf4-439c-87b0-f92b5cbd0a34 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:18.825364 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-8a3ad1d4-faf4-439c-87b0-f92b5cbd0a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:18.882843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ad1d4-faf4-439c-87b0-f92b5cbd0a34 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:18.886538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcb11f-2cce-47ed-ba55-4dec1d894717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:18.887265 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb11f-2cce-47ed-ba55-4dec1d894717 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:18.887549 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb11f-2cce-47ed-ba55-4dec1d894717 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:18.887827 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb11f-2cce-47ed-ba55-4dec1d894717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:18.897172 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcb11f-2cce-47ed-ba55-4dec1d894717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:18.899209 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcb11f-2cce-47ed-ba55-4dec1d894717 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:18.909287 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1438/2882] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:27:19.185864 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2f4ed-2e79-4fdd-8adc-804199614a64 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:19.187403 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-12c2f4ed-2e79-4fdd-8adc-804199614a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:19.202323 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2f4ed-2e79-4fdd-8adc-804199614a64 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:19.207346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:19.208309 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:19.208666 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:19.209493 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3 admin admin] PATH_INFO: `/v3/projects/4c37c56fa62b47ce9a0e78f5541d0e8a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:19.211816 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c37c56fa62b47ce9a0e78f5541d0e8a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:19.214155 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:19.261347 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c37c56fa62b47ce9a0e78f5541d0e8a', 'request_id': 'req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:19.267212 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c37c56fa62b47ce9a0e78f5541d0e8a', 'request_id': 'req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:19.275784 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c37c56fa62b47ce9a0e78f5541d0e8a', 'request_id': 'req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:19.287547 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3 admin admin] The token cache is being invalidate because project 4c37c56fa62b47ce9a0e78f5541d0e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:27:19.287835 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:19.288562 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:19.290103 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1445/2883] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:27:19 2022] DELETE /identity/v3/projects/4c37c56fa62b47ce9a0e78f5541d0e8a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:19.294041 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcb11f-2cce-47ed-ba55-4dec1d894717 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:19.303837 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcb11f-2cce-47ed-ba55-4dec1d894717 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:19.360978 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dade7-a009-4292-ac38-e7314c979db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:19.361857 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dade7-a009-4292-ac38-e7314c979db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:19.362141 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dade7-a009-4292-ac38-e7314c979db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:19.362417 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dade7-a009-4292-ac38-e7314c979db7 admin admin] PATH_INFO: `/v3/users/29567ccf12be4b3e917aa1edc8b54e79` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:19.363640 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dade7-a009-4292-ac38-e7314c979db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29567ccf12be4b3e917aa1edc8b54e79)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:19.365565 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dade7-a009-4292-ac38-e7314c979db7 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:19.407646 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:19.413526 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c43dade7-a009-4292-ac38-e7314c979db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29567ccf12be4b3e917aa1edc8b54e79'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:19.414377 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c43dade7-a009-4292-ac38-e7314c979db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29567ccf12be4b3e917aa1edc8b54e79'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:19.427056 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c43dade7-a009-4292-ac38-e7314c979db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29567ccf12be4b3e917aa1edc8b54e79'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:19.427709 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c43dade7-a009-4292-ac38-e7314c979db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29567ccf12be4b3e917aa1edc8b54e79'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:19.435537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-c43dade7-a009-4292-ac38-e7314c979db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29567ccf12be4b3e917aa1edc8b54e79'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:19.449246 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1439/2884] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:27:19 2022] DELETE /identity/v3/users/29567ccf12be4b3e917aa1edc8b54e79 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:19.738079 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:19.739692 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:19.753370 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11ffe6-0438-4fa2-8ecf-c7090923a3a3 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:19.818535 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9355ece-a5da-4d95-ac3b-0136720a9302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:19.819418 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9355ece-a5da-4d95-ac3b-0136720a9302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:19.819872 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9355ece-a5da-4d95-ac3b-0136720a9302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:19.820411 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9355ece-a5da-4d95-ac3b-0136720a9302 admin admin] PATH_INFO: `/v3/projects/02a73da814f5467384c8bb36f4220b7a` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:19.821380 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9355ece-a5da-4d95-ac3b-0136720a9302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a73da814f5467384c8bb36f4220b7a)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:19.823346 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9355ece-a5da-4d95-ac3b-0136720a9302 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:19.872332 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d9355ece-a5da-4d95-ac3b-0136720a9302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a73da814f5467384c8bb36f4220b7a', 'request_id': 'req-d9355ece-a5da-4d95-ac3b-0136720a9302'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:19.877760 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d9355ece-a5da-4d95-ac3b-0136720a9302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a73da814f5467384c8bb36f4220b7a', 'request_id': 'req-d9355ece-a5da-4d95-ac3b-0136720a9302'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:19.885150 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d9355ece-a5da-4d95-ac3b-0136720a9302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a73da814f5467384c8bb36f4220b7a', 'request_id': 'req-d9355ece-a5da-4d95-ac3b-0136720a9302'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:19.896265 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d9355ece-a5da-4d95-ac3b-0136720a9302 admin admin] The token cache is being invalidate because project 02a73da814f5467384c8bb36f4220b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:27:19.896549 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d9355ece-a5da-4d95-ac3b-0136720a9302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:19.897168 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-d9355ece-a5da-4d95-ac3b-0136720a9302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:19.898834 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1446/2885] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:27:19 2022] DELETE /identity/v3/projects/02a73da814f5467384c8bb36f4220b7a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:19.904503 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58a8e1-5a75-43b5-9c9f-18253b316722 None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:19.904843 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58a8e1-5a75-43b5-9c9f-18253b316722 None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:19.905194 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58a8e1-5a75-43b5-9c9f-18253b316722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:19.923593 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-3a58a8e1-5a75-43b5-9c9f-18253b316722 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:19.924791 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-3a58a8e1-5a75-43b5-9c9f-18253b316722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:19.984833 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1440/2886] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:19.993074 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89bbb8-60db-4ee5-a779-4c5868b4805c None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:19.993366 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89bbb8-60db-4ee5-a779-4c5868b4805c None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:19.993644 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89bbb8-60db-4ee5-a779-4c5868b4805c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:20.001050 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:20.013978 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-be89bbb8-60db-4ee5-a779-4c5868b4805c None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:20.015259 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-be89bbb8-60db-4ee5-a779-4c5868b4805c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:20.023987 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1447/2887] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:20.028129 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58a8e1-5a75-43b5-9c9f-18253b316722 None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:20.037993 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58a8e1-5a75-43b5-9c9f-18253b316722 None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:20.046126 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f753f7-f904-4018-a360-022b4177b264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:20.046834 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f753f7-f904-4018-a360-022b4177b264 admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:20.047124 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f753f7-f904-4018-a360-022b4177b264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:20.047401 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f753f7-f904-4018-a360-022b4177b264 admin admin] PATH_INFO: `/v3/domains` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:20.048133 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f753f7-f904-4018-a360-022b4177b264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80323) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 16:27:20.048446 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f753f7-f904-4018-a360-022b4177b264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:20.050045 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f753f7-f904-4018-a360-022b4177b264 admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:20.063869 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1441/2888] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 16 16:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 16:27:20.068343 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89bbb8-60db-4ee5-a779-4c5868b4805c None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:20.079707 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89bbb8-60db-4ee5-a779-4c5868b4805c None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:20.084466 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb28ef2-7e7f-413e-95c3-4423adccd278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:20.085134 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb28ef2-7e7f-413e-95c3-4423adccd278 admin admin] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:20.085732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb28ef2-7e7f-413e-95c3-4423adccd278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:20.086068 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb28ef2-7e7f-413e-95c3-4423adccd278 admin admin] PATH_INFO: `/v3/projects` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:20.086851 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb28ef2-7e7f-413e-95c3-4423adccd278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:20.088791 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb28ef2-7e7f-413e-95c3-4423adccd278 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:20.114754 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1448/2889] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 16 16:27:20 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 16:27:20.119608 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f753f7-f904-4018-a360-022b4177b264 admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:20.129758 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f753f7-f904-4018-a360-022b4177b264 admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:20.190623 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d8a7c-a4c6-483f-88d0-62f1f26c239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:20.191297 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d8a7c-a4c6-483f-88d0-62f1f26c239f admin admin] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:20.191585 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d8a7c-a4c6-483f-88d0-62f1f26c239f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:20.191866 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d8a7c-a4c6-483f-88d0-62f1f26c239f admin admin] PATH_INFO: `/v3/users` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:20.192559 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d8a7c-a4c6-483f-88d0-62f1f26c239f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:20.194521 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d8a7c-a4c6-483f-88d0-62f1f26c239f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:20.214855 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1442/2890] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 16 16:27:20 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 16:27:20.219072 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb28ef2-7e7f-413e-95c3-4423adccd278 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:20.230300 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb28ef2-7e7f-413e-95c3-4423adccd278 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:20.234960 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921eeee-6795-424c-a4c1-63521cc7f4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:20.235617 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921eeee-6795-424c-a4c1-63521cc7f4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:20.236025 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921eeee-6795-424c-a4c1-63521cc7f4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:20.236308 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921eeee-6795-424c-a4c1-63521cc7f4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:20.237026 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921eeee-6795-424c-a4c1-63521cc7f4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:20.238628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921eeee-6795-424c-a4c1-63521cc7f4b9 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:20.249031 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1449/2891] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:20.252913 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d8a7c-a4c6-483f-88d0-62f1f26c239f admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:20.264026 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d8a7c-a4c6-483f-88d0-62f1f26c239f admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:20.268713 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1050672-4554-40b2-9c2d-7533bdf6168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:20.269398 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1050672-4554-40b2-9c2d-7533bdf6168f admin admin] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:20.269773 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1050672-4554-40b2-9c2d-7533bdf6168f admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:20.270067 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1050672-4554-40b2-9c2d-7533bdf6168f admin admin] PATH_INFO: `/v3/roles` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:20.270828 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1050672-4554-40b2-9c2d-7533bdf6168f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:20.272425 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1050672-4554-40b2-9c2d-7533bdf6168f admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:20.284496 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1443/2892] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 16 16:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 16:27:20.290195 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921eeee-6795-424c-a4c1-63521cc7f4b9 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:20.300328 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921eeee-6795-424c-a4c1-63521cc7f4b9 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:20.306009 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5512cd-9f2d-4427-bd7b-9b79f2424bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:20.306990 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5512cd-9f2d-4427-bd7b-9b79f2424bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:20.307282 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5512cd-9f2d-4427-bd7b-9b79f2424bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:20.307566 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5512cd-9f2d-4427-bd7b-9b79f2424bb6 admin admin] PATH_INFO: `/v3/projects/89fc654371734136b7cfc8ece3207363/users/aa7705dec1444cdb84589792d2264593/roles/2c5988d189bd4b4482fb3649b9cf1de4` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:20.323291 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5512cd-9f2d-4427-bd7b-9b79f2424bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89fc654371734136b7cfc8ece3207363, user_id=aa7705dec1444cdb84589792d2264593, role_id=2c5988d189bd4b4482fb3649b9cf1de4)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:20.325866 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5512cd-9f2d-4427-bd7b-9b79f2424bb6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:20.339721 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1450/2893] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 16 16:27:20 2022] PUT /identity/v3/projects/89fc654371734136b7cfc8ece3207363/users/aa7705dec1444cdb84589792d2264593/roles/2c5988d189bd4b4482fb3649b9cf1de4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:20.350318 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebec63-e535-448e-9c60-deb84ab52a4b None None] REQUEST_METHOD: `POST` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:20.350878 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebec63-e535-448e-9c60-deb84ab52a4b None None] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:20.351533 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebec63-e535-448e-9c60-deb84ab52a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:20.379553 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.auth.core [None req-26ebec63-e535-448e-9c60-deb84ab52a4b None None] MFA Rules not processed for user `aa7705dec1444cdb84589792d2264593`. Rule list: `[]` (Enabled: `True`). {{(pid=80323) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:20.380794 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-26ebec63-e535-448e-9c60-deb84ab52a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:20.392831 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:20.447718 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1444/2894] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 16:27:20.459554 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5512cd-9f2d-4427-bd7b-9b79f2424bb6 admin admin] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:20.461910 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-ae5512cd-9f2d-4427-bd7b-9b79f2424bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:20.518961 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5512cd-9f2d-4427-bd7b-9b79f2424bb6 admin admin] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:20.522635 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd707b6-8992-49e0-b8f5-2d7ec1405da6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59174974208c469b8bb44d94d0e55427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:20.523933 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd707b6-8992-49e0-b8f5-2d7ec1405da6 service glance] REQUEST_METHOD: `GET` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:20.524221 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd707b6-8992-49e0-b8f5-2d7ec1405da6 service glance] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:20.524501 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd707b6-8992-49e0-b8f5-2d7ec1405da6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:20.532871 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd707b6-8992-49e0-b8f5-2d7ec1405da6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:20.534596 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd707b6-8992-49e0-b8f5-2d7ec1405da6 service glance] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:20.543694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1451/2895] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:27:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 16:27:30.444538 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=21 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:30.539694 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=51,keystone:INSERT=2 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:42.209544 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebec63-e535-448e-9c60-deb84ab52a4b None None] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:42.283896 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebec63-e535-448e-9c60-deb84ab52a4b None None] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:42.288437 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11285f5-59dd-400e-b83c-9c8dee110a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:42.289311 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11285f5-59dd-400e-b83c-9c8dee110a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:42.293391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11285f5-59dd-400e-b83c-9c8dee110a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:42.293391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11285f5-59dd-400e-b83c-9c8dee110a0d admin admin] PATH_INFO: `/v3/users/aa7705dec1444cdb84589792d2264593` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:42.293391 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11285f5-59dd-400e-b83c-9c8dee110a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7705dec1444cdb84589792d2264593)` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:42.294492 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11285f5-59dd-400e-b83c-9c8dee110a0d admin admin] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:42.342511 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a11285f5-59dd-400e-b83c-9c8dee110a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7705dec1444cdb84589792d2264593'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:42.343239 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a11285f5-59dd-400e-b83c-9c8dee110a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7705dec1444cdb84589792d2264593'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:42.356088 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a11285f5-59dd-400e-b83c-9c8dee110a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7705dec1444cdb84589792d2264593'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:42.356799 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a11285f5-59dd-400e-b83c-9c8dee110a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7705dec1444cdb84589792d2264593'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:42.363653 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.notifications [None req-a11285f5-59dd-400e-b83c-9c8dee110a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7705dec1444cdb84589792d2264593'} {{(pid=80323) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:42.377524 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1445/2896] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 16 16:27:42 2022] DELETE /identity/v3/users/aa7705dec1444cdb84589792d2264593 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:42.382122 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd97b5c-75d5-41fd-9688-c1389aaa0bd2 None None] REQUEST_METHOD: `POST` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:42.382628 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd97b5c-75d5-41fd-9688-c1389aaa0bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:42.382732 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd97b5c-75d5-41fd-9688-c1389aaa0bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:42.399905 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.auth.core [None req-8dd97b5c-75d5-41fd-9688-c1389aaa0bd2 None None] MFA Rules not processed for user `0da3a74593ae46b281650aa7e2026c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80324) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 16:27:42.401119 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8dd97b5c-75d5-41fd-9688-c1389aaa0bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:42.459884 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1452/2897] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 16 16:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 16:27:42.469955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11285f5-59dd-400e-b83c-9c8dee110a0d admin admin] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:42.471413 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-a11285f5-59dd-400e-b83c-9c8dee110a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:42.529920 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11285f5-59dd-400e-b83c-9c8dee110a0d admin admin] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:42.533872 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c1135-cf70-4188-9bad-32e29491ec35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087adcbf737843db97dabfa9708484c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:42.534537 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c1135-cf70-4188-9bad-32e29491ec35 service neutron] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:42.534821 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c1135-cf70-4188-9bad-32e29491ec35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:42.535094 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c1135-cf70-4188-9bad-32e29491ec35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:42.545631 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c1135-cf70-4188-9bad-32e29491ec35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:42.547128 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c1135-cf70-4188-9bad-32e29491ec35 service neutron] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:42.558102 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1446/2898] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:27:42.832207 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd97b5c-75d5-41fd-9688-c1389aaa0bd2 None None] Authenticating user token {{(pid=80324) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:27:42.833618 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.fernet_utils [None req-8dd97b5c-75d5-41fd-9688-c1389aaa0bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80324) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:27:42.846359 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd97b5c-75d5-41fd-9688-c1389aaa0bd2 None None] Validating token access rules against request {{(pid=80324) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:27:42.850992 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b918b-b3ad-46d9-b823-c9a404c1efd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0da3a74593ae46b281650aa7e2026c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95faccee4f0940e98a9d62a275c0548c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80324) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:27:42.851863 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b918b-b3ad-46d9-b823-c9a404c1efd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:27:42.852145 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b918b-b3ad-46d9-b823-c9a404c1efd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:27:42.852423 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b918b-b3ad-46d9-b823-c9a404c1efd6 admin admin] PATH_INFO: `/v3/projects/89fc654371734136b7cfc8ece3207363` {{(pid=80324) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:27:42.853588 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b918b-b3ad-46d9-b823-c9a404c1efd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89fc654371734136b7cfc8ece3207363)` {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:27:42.856109 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b918b-b3ad-46d9-b823-c9a404c1efd6 admin admin] RBAC: Authorization granted {{(pid=80324) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:27:42.903321 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1d7b918b-b3ad-46d9-b823-c9a404c1efd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89fc654371734136b7cfc8ece3207363', 'request_id': 'req-1d7b918b-b3ad-46d9-b823-c9a404c1efd6'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:42.909201 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1d7b918b-b3ad-46d9-b823-c9a404c1efd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89fc654371734136b7cfc8ece3207363', 'request_id': 'req-1d7b918b-b3ad-46d9-b823-c9a404c1efd6'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:42.917060 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1d7b918b-b3ad-46d9-b823-c9a404c1efd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89fc654371734136b7cfc8ece3207363', 'request_id': 'req-1d7b918b-b3ad-46d9-b823-c9a404c1efd6'} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:42.930086 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1d7b918b-b3ad-46d9-b823-c9a404c1efd6 admin admin] The token cache is being invalidate because project 89fc654371734136b7cfc8ece3207363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80324) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 16:27:42.930377 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1d7b918b-b3ad-46d9-b823-c9a404c1efd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:42.931064 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG keystone.notifications [None req-1d7b918b-b3ad-46d9-b823-c9a404c1efd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80324) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 16:27:42.932623 dv-cinder-837355-2-smb devstack@keystone.service[80324]: [pid: 80324|app: 0|req: 1453/2899] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 16 16:27:42 2022] DELETE /identity/v3/projects/89fc654371734136b7cfc8ece3207363 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 16:27:52.552955 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:27:52.925855 dv-cinder-837355-2-smb devstack@keystone.service[80324]: DEBUG dbcounter [-] [80324] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:30:46.019916 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c1135-cf70-4188-9bad-32e29491ec35 service neutron] Authenticating user token {{(pid=80323) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 16:30:46.022046 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-1e3c1135-cf70-4188-9bad-32e29491ec35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:30:46.185942 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c1135-cf70-4188-9bad-32e29491ec35 service neutron] Validating token access rules against request {{(pid=80323) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 16:30:46.248618 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ddee4-dbf1-47e4-b44c-381c63eb8dd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e8222d303aa487ca2b5c5bed6124f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '227cd348bea64e1f89d77ae2cf63a031', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80323) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 16:30:46.249432 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ddee4-dbf1-47e4-b44c-381c63eb8dd3 service placement] REQUEST_METHOD: `GET` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 16:30:46.249872 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ddee4-dbf1-47e4-b44c-381c63eb8dd3 service placement] SCRIPT_NAME: `/identity` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 16:30:46.250158 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ddee4-dbf1-47e4-b44c-381c63eb8dd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80323) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 16:30:46.252081 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.fernet_utils [None req-809ddee4-dbf1-47e4-b44c-381c63eb8dd3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80323) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 16:30:46.264726 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ddee4-dbf1-47e4-b44c-381c63eb8dd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 16:30:46.266362 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ddee4-dbf1-47e4-b44c-381c63eb8dd3 service placement] RBAC: Authorization granted {{(pid=80323) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 16:30:46.277461 dv-cinder-837355-2-smb devstack@keystone.service[80323]: [pid: 80323|app: 0|req: 1447/2900] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 16 16:30:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 16:30:56.273221 dv-cinder-837355-2-smb devstack@keystone.service[80323]: DEBUG dbcounter [-] [80323] Writing DB stats keystone:SELECT=89 {{(pid=80323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}